[apycotlib] set a 'tmpdir' CheckResultInfo if keep_dir is True

[entities] Project.recommends may not exist (it's defined in cubicweb-forge)

add a quick recipe that uses virtualenv also rename ATest.dependencie in src_configuration

kill preprocessor, since there is nothing left there Preprocessing is now handled via dedicated recipes.

[test] update test_functionnal

[test] improve unittest_apycot

[test] improve unittest_entities

[test] improve hooks tests

[apycotlib] kill _apycotlib.repositories it's now handled by checkout recipes

[views] GetConfiguration work directly with a TC or a PE

[testutils] small improvements

[recipes] update quick ans setup.distutils recipes

[narval] ATest has no project_path() any more

[narval] kill DistutilsProcessor it's now handled by setup recipes

[apycotlib] no more checker.need_preprocessor

[apycotlib] the get_configuration view now returns only the configuration of the given entity for TestConfig or ProjectEnvironment

[apycotlib] remove the install_environment function from narvalactions

[apycotlib] remove 'preprocessor' and 'repository' registries

[apycotlib] replace the use of create_subentity controller by rqlio

[atest] ensure an error in a recipe execution (even a SyntaxError) is reported instead of crashing the process

[atest] improve environment variable reporting

[apycotlib] use writer.raw instead of removed writer.version

Big Refactoring (BR) of the test execution model Get rid of narval preprocessors in favor of Recipes - Each preprocessing recipe must be run from the "main" recipe (thus we add a ATest.exec_recipe() method that can be called from Recipe execution). - We add a (Repository, checkout_recipe, Recipe) relation, which is the Recipe that tells how to retrieve the code for a given Repository - Also add a (ProjectEnvironment, setup_recipe, Recip) dedicated to perform the installation for a project (compile and install) - Add implementations for these recipes for Python project - Rewrite the quick recipe using this new model

update to vcsfile 2 - kill SVN support - update to new vcsfile 2 schema

[recipe] improve recipes' comments

[schema] remove useless status vocabulary elements

[apycotlib] port to narval 4.2 The connection handler is now a CWProxy (cwclientlib), and there is no CreateSubEntity view any more since we can now create File entity using cwclientlib and rqlcontroller.

[test] fix StartTestTC.launch_all_tests method Ensure TestExecution are listed only once

[test] compatibility with vcsfile 2 use HGRCMixin in some tests

Added tag apycot-version-3.2.0, apycot-debian-version-3.2.0-1 for changeset 09fb0fe7cedb

[debian] stop using deprecated dh_clean -k

[debian] work around dh_python2 silliness If you give it a private dir, it won't act on the public one.

[debian] use dh_python2 instead of dh_pysupport

[pkg] require vcsfile 2

[pkg] 3.2.0

[apycotlib] remove support for SVN repositories Closes #4786982

[apycotlib] improve docstrings

[test] set up evolve extension so vcsfile import can do its thing Related to #4786982

Stop using Repository.path, gone in vcsfile 2 Use a file:// source_url instead. Related to #4786982.

[narval] any has been a python builtin forever

[schema] deal with vcsfile 2 Related to #4786982

Drop support for use_pkginfo_python_versions Unused.

[narval] fix pylint checker for pylint 1.4 (closes #4771946) Our custom reporter was not calling its parent's __init__, leading to a crash when add_message tried to access path_strip_prefix.

[apycotlib] stop using logilab.common.hg (closes #4639284) It was removed in 0.63.0. Use hglib instead, which gives a stable python API to mercurial.

Fix line vs column confusion in pylint checker pylint 0.24 added column offset to its messages, meaning location[-1] is no longer the line number.

[views] use StringIO from the io module

[hooks] silence cubicweb 3.17 deprecation warning

[test] port to cubicweb 3.19

[hooks] port to cubicweb 3.19 Also, stop translating validation error message here, it's handled by the web side of things.

Silence cubicweb 3.16 deprecation warnings set_attributes/set_relations became cw_set.

Silence cubicweb 3.16 deprecation warnings cubicweb.web.uicfg → cubicweb.web.views.uicfg

Silence cubicweb 3.15 deprecation warnings cubicweb.selectors → cubicweb.predicates

Added tag apycot-version-3.1.0, apycot-debian-version-3.1.0-1 for changeset a42ed51d1594

[i18n] update

[pkg] prepare 3.1.0

Don't hide TestConfig.name from the primary view If the testconfig has a label, the name may not be in the title.

[narval] adjust jslint checker for jslint update It's no longer a command line utility, so add a tiny wrapper to call it.

[test] ignore the user's hgrc Tests shouldn't depend on the user's own config.

[apycotlib] upgrade to narval 4.1 in which cwuri is not used any more and to follow the change in TestDataWriter API.

[test] fix unit tests - fix the narval-cw-sources.ini (token_id+secret instead of user+password), - update MockConnection which should not pretend to be a pyro repository any more, but a http connection handler, - code cleanup.

[apycotlib] fix url used to upload files (related to #4112497) also use cnxh logger in TestDataWriter (and add more debug statements) since this former logger is reported in the execution logs (in TestExecution.execution_log).

[narval/debcheck] use a glob instead of a recursive os.walk to find *.changes We know where those files are, there's no need to do a recursive search. This also avoids issues with os.walk with non-ascii file names. ***

[narval] remove broken test_print_log method lgp says "a build log is available at $path" before that's true (it only copies it there afterwards), so we always said "$path not found".

Added tag apycot-version-3.0.1, apycot-debian-version-3.0.1-1 for changeset 35b873cea565

[pkg] release

[pkg] attempt to fix things up after modname change Things get sort of confused with a cube named 'apycot' and a public library named 'apycotlib'. Maybe this will help...

[pkg] modname is apycotlib, not apycot

[narval] update copy of jslint (closes #4016718) Downloaded from https://raw.githubusercontent.com/douglascrockford/JSLint/master/jslint.js Update debian/copyright.

[debian] change source package name to match pkginfo's distname Otherwise we fail to use the sdist-generated tarball and get a native debian package. Closes #4016396

[narval] fix pypi.upload checker harder Thanks, pylint. Related to #4002584

[pkg] 3.0.1

[lgp] refresh log in the lgp log handler (closes #4002751) Should give us more progress information while things are building.

[narval] Fix pypi.upload checker (closes #4002584) 1. NameError for apycotlib 2. NotImplementedError because apycot was looking for a do_check() method, not run() And drop the unused path argument to do_check.

[pkg] missing deps

[apycotlib] build "sane" URL for log file upload (closes #3886463)

[pkg] make __pkginfo__ unsensitive to current working directory

Added tag apycot-version-3.0.0, apycot-debian-version-3.0.0-1 for changeset 7157179d08dd

[test] fix test_functionnal.py Bot had no proper cw source configuration.

[test] add mimssing unittest_main() calls

[pkg] prepare 3.0.0 - ensure MANIFEST.in is correct - add entry in the debian/changelog

[test] fix tests when executed in an apycot environment ie. when tests are executed from sources towards an installed apycot. The fix consist mainly in "moving" the input_path function from testutils.py (which is part of the installed modules) into unittest_checkers.py so we are sure we look for test data files relatively to the test directory (and not the location of the installation).

[pkg] fix jslint.js handling in __pkginfo__ and install it in /usr/share/narval/data directly (instead of /usr/share/narval/data/apycot) for the sake of simplicity.

[apycotlib] keep a reference on the options dict in ATest So it can be easily used from recipes

[narval] add a pypi.upload checker cen be used to upload a tarball on pypi

[narval] fix recipes (when run from sources) checkers must be imported first (required when run from sources) so apycotlib is importable

[narval] ensure narval plugins can be imported (closes #3804730) both in tests, when run from sources and from installed packages

[pkg] remove useless install_data from setup() preprocessors (and checkers) can naw be just copied as data files.

[narval] use the new _narval standard directory

[schema] remove useless rdef redefinition (execution_log) Since it's the exact same definition in narval's schema.

[migration] fix migration script for 3.0.0 - most migration steps are managed by narval (4.0.0) - ensure conversion of log attribute into log_file does not consume too much memory

[entities] make sure log files are *not* indexed (FTI)

[test] ensure cubicweb.devtools is imported first so the cubes are in sys.path

[test] fill-in incomplete test docstring

[test] kill commented tests

[checkers] move lgp checkers to apycot since it's more consistent to have lintian and piuparts checkers alongside the lgp build checker.

[test] do not run PyLintChecker tests if pylint is not available

[doc] update the documentation - remove deprecated content - adapt to signedrequest dependency

[pkg] remove dependency on pyro and recommend logilab-devtools

[migration] a few simplifications and fixes - use rename_relation_type instead of deprecated rename_relation - look at Plan's default workflow, not any workflow - we don't need to log in as narval, managers should be able to fire transitions - avoid a few useless sync_schema_props_perms calls - drop TestExecution.arguments

[test] fix imports for distutils preprocessor

[apycotlib] do not add carriage return between log blocks

[pkg] create the checkers and preprocesors folders in /usr/share/narval these folders where previously created by narval. They are part of what is added by apycot and should therefore be created by apycot. The main changes is to include the __init__ files at the root folder of checkers and preprocessors.

[apycotlib] update testexec status to error when preprocessor fails previously, the status would stay at 'waiting execution' or 'success' even if no checker was run.

[apycotlib] update the refresh-log method using the new append-to-file controller

[apycotlib] fix archive upload of narvalbot - use texec eid in archive name (previously, the URL containing unauthorized characters was used) - put relative path in archive instead of absolute path - don't go through useless StringIO when we can just pass the file object to requests

[hooks] force status to failed if status not updated by checker normally, the testexecution status is updated by the narvalbot. However, if the recipe code fails the transition to fail is fired, but the testexecution is not changed. In case of a 'publish recipe', this is an issue as only a single testexecution must be in the 'waiting execution' state. This patch adds a test showing the issue and the associated hook modification.

[apycotlib] do not crash when the repository is not in the data

[views] fix json dumps: add data in the correct format and only if available

[apycotlib] add and update piuparts checker

[apycotlib] update debian checkers for narval 4 - avoid name collision with existing python module "debian" - fix pylint_threshod option name (from jpl configs)

[apycotlib] mirror changes in narval 4 for file-upload - rename of 'field' to 'r(elation)name' - rename of 'log' to 'data'

[schema] fix permissions for execution_log (TestExecution to File) The relation execution_log, inherited from Plan by TestExecution does not inherit the associated permissions unless they are explicit.

[migration] fix migration to mirror narval (closes #3687137) - log_files contained the archive of the run, they have been renamed to execution_archive - make sure the schema inherited entities are updated - create workflow data for all testexecutions

[apycotlib] make cnxh attribute from writer public the connection handler is used directly, for example to get the cubicweb instance url.

[apycotlib] remove explicit _cw_fields creation The field is created automatically by the http method.

[apycotlib] improve calls to http_get /post when communicating with cubicweb: - use get to get information from the cubicweb instance - use post to send information to modify the cubicweb instance - do not use object cwuri but concatenate cnxh url with eid

[apycotlib] also try to get a human-readable description of the signal Sadly the stdlib doesn't expose strsignal, so hack around it with ctypes.

[apycotlib] when a child dies from a signal, look up the signal name Should make for more readable logging.

Add css class corresponding to check status in summary tables

[hooks] don't crash in start_period_tests if we can't find a branch head If branch_head(branch) returns None, just ignore it instead of crashing.

[test] add missing elements in test __pkginfo__ to avoid warnings

[test] update/fix previously skipped tests - replace SetUpModule and TearDownModule by in class equivalent (repo reset needed between tests) - update old code in test_new_vc_trigger

[apycotlib] move checkers/preprocessors to have same organisation in dev and packages various necessary changes: - path updates - import cubes.apycot in tests to be sure _apycotlib is added to path - rename pylint checkers to pycheckers to avoid confusion with package checkers - fix js path in jslint.py why: If you install a pkg, the checkers are installed in:: /usr/share/narval/checkers/apycot/* and /usr/share/narval is added to the path when launching them. In a dev environment, they were previously in :: _apycotlib/checkers/* This required specific paths to make a dev environment work (added in __init__.py). The new organisation puts checkers in:: _apycotlib/checkers/apycot/* The new organisation only requires to add _apycotlib to path to make checkers work. Same thing was done for preprpocessors.

[doc] multiple doc upgrades: - Add Apycot architecture specification. Remove deprecated file. - Add Apycot quick start tutorial which replaces the French step by step - integrate old doc and remove deprecated files - Update checkers doc

[apycotlib] fix unwanted path replacement This could be a previous copy-paste mistake. The path can be predefined and should only be forced to test.project_path() if it is initially at None (else, dependencies install/config fails).

Add test to justify last change

[apycotlib] Correct dependency name call for new ProjectEnvironment format (dict).

[migration] Refactor migration script (use more RQL)

[apycotlib] Correct pyunit and pycoverage behavior by updating coverage_data Also add pycoverage checker in recipe, run if unit tests don't explode.

[migration] fix recipes not appearing because of missing commit

[checkers] Fix "name" lookup

[debian] various packaging updates and fixes - rename source package into cubicweb-apycot for the sake of consistency - bump debhelper and policy versions - use python-support and add proper dependencies - tell setup.py to move things to debian/tmp and dispatch with dh_install instead of with manual 'mv' calls - add (no-op) build-arch debian/rules target - ensure checkers and preprocessor are installed in usr/share/narval/

[apycotlib] manage preprocessors like checkers they should be installed in /usr/share/narval/

[test] fix unittest_apycot.py (follow change in narval) Narval now generates <div> instead of <pre> in formatted log views.

[test] move test/utils.py to testutils.py (closes #3241611) so it can be used from other cubes; also make the executed script an attribute of the ApycotBaseTC class (to easy reuse by other cubes).

[apycotlib] add a 'displayname' argument to the atest.Test.run_checker method (closes #3241610) so one can run the same checker several times in one test session, like:: with na.apycot_environment(plan) as test: na.install_environment(test) checker, status = test.run_checker('pyunit', displayname='Unit tests') checker, status = test.run_checker('pyunit', displayname='Regressions', test_dirs=['reg'])

[apycotlib] add a 'test_prefixes' config option for PyUnitTestChecker (closes #3241609) so one can configure the prefixes of the files identified as test to be run

[entities] fix anchor_name() to remove space chars also

[test] add config file in tests following narval changes to use instance_id

[pkg] checkers should now be installed in narval.checkers.apycot (closes #3241608) but they should still be available from source (when running unit tests), so make sure apycot/__init__.py fake the installed situation. The dummy 'checkers' module is necessary to create 'checkers.apycot'

[migration] update the script attribute of recipes, testexecutions and plans related to #e50f134e41b7 changes

[apycotlib] remove last remaining dependency to cubes (closes #3241607) we do not want apycotlib to depend on the apycot cube.

[apycotlib] embed a copy of __pkginfo__ in apycotlib made using a symlink that points to the original __pkginfo__. The apycotlib library can be installed separately from the cube. It must have a possibility to check its version without the cube

[apycotlib] typo

[apycotlib] PyTestChecker's extra_argument should be of 'csv' type instead of 'string' has this 'string' option type ever been working?

[foldunder] do not fail if pylints imports fail

[test] do not fail if pylint is not available

[test] make sure commits in data/project test hg reop are public,

[recipes] full: do not execute the pylint checker if pylint is unavailable also remove the pycoverage checker from this recipe since it's been not working for a while now.

[apycotlib] correct post for sending log archive

[views] use tag_subject_of instead of tag_attribute execution_log is now a file and not a string attribute

[schema] replace the 'log' by a log_file relation to a File (closes #3241606) also update tests. As the logs can be big, it is a better idea to handle them using files. It also makes it easier to download them from cubicweb.

[migration] pep8 + utf-8 header

[schema] rename log_file to execution_archive (closes #3241605) the "log_file" (when it exists) contains the archive of the running environment and not the logs. This commit frees the name "log_file" to be used by real logs in a commit downstream.

[apycotlib] only send the difference between actual logs and total logs (closes #3241602) in refreshlog, used by narval. This enables other connexions to send logs in between

[apycotlib] move registration of checkers in recipes

[apycotlib] change option names to avoid "." (closes #3024946) These option names are passed as parameters and parameters cannot contains dots. The names have been simplified when possible, or . replaced by _ in case of collision. Also update tests to take these changes into account

[apycotlib] use new http_upload for uploading logs (closes #3241603) this avoids issues with character encoding and is better for big files.

[apycotlib] add back lintian checker (closes #2925088)

[view] checkresults tabs and summary are now ordered by creation_date order Closes #2923618

[view] display colorized recipe in test report (closes #3241604) uses pygments (also add dependency). The imported "pygments.css" file is available in cubicweb.

[view] check for tracker cube before using it

[apycotlib] add ScriptRunner to run custom files as checks, (closes #2882718) The new checker can be derived to run any file provided the user writes a custom filename_filter method. The method has three parameters and two roles: - the first parameter (dirpath) is the path being explored; - the second parameter (dirname) is a list of directory names, the function must remove from the list the directories which should not be explored by os.walk; - the third parameter (filenames) is a list of files. The user should yield a list of files which should be run by the checker. This method uses the syntax of os.walk (see python doc). Add corresponding tests and example recipe.

[apycotlib] Add git hidden folder name to ignored files.

[apycotlib] modify AbstractFilteredFileChecker to use os.walk os.path.walk (previously used) is deprecated in python 3. This requires to move the file checks in a separate method

[test] kill skipped tests (deprecated now) in unittest_task.py

[test] update to deal with dicts instead of mock entities This is all client side where we no longer have an orm.

[test] ConnectionHandler is now HTTPConnectionHandler

Don't enable pyro The communication between cubicweb and narvalbot is now over http.

restore and unittest apycot.recipe.full

[test] reload quick recipe on startup

RESTify apycotlib

narval/piuparts: replace @DIST@ with the actual dist in apt repository uris

narval: add piuparts checker Runs after lgp.build, and calls piuparts on all the changes files.

Deal with narval's workflow changes starttime and endtime are gone, replace them by looking at related TrInfo entities. The starttime facet is being removed though, hopefully temporarily.

follow narval v4 API changes (closes #2557390) - recipes are now simple Python scripts stored in Plan.script, - no more "arguments" on the Plan CW entity, - add functional tests.

merge from stable

Added tag apycot-debian-version-2.2.7-1 for changeset 00a869904b15

Added tag apycot-version-2.2.7 for changeset 7e2fab53d5c8

2.2.7

apycotlib: give a more useful error when a project env has no repository Replaces AttributeError: 'NoneType' object has no attribute 'type' with Exception: Project environment foo has no repository

apycotlib: xml_escape strings before sending them to cw Otherwise the log can't get displayed properly. Closes #2883714

Added tag apycot-debian-version-2.2.6-1 for changeset f910f2423830

Added tag apycot-version-2.2.6 for changeset c727a537bae1

2.2.6

Brown paper bag fix for StartTestOp operation (closes #2822711) - need to use DataOperationMixIn for get_instance - operations have .session, not ._cw

Added tag apycot-version-2.2.5, apycot-debian-version-2.2.5-1 for changeset 03c81aef4a70

2.2.5

[views] kill unused import

[apycotlib] Remove broken handling of C/C++ extensions from the distutils preprocessor The extensions were being installed to /tmp/tmpXXXXXX/local/lib/python2.X/site-packages, but INSTALL_PREFIX pretended it was in /tmp/tmpXXXX/local/lib/python2.X (or /usr/bin/python, if pyversions happened to return sys.executable). While I'm at it, make pyversions not do that. Closes #2683937

[views] test presence of jqplot before using it (closes #2345646)

views/uicfg: allow to link to an existing repository (closes #2746273)

Avoid duplicate using_revision relations (closes #2766223) For some reason sometimes two CheckResultInfo entities with the same information are created, which causes things to explode.

hooks: only start tests on new public revisions (closes #2741838) Tests should be run if - a new public revision is addded, or - an existing draft revision is made public. Use an operation to group both cases, called from two separate hooks.

apycotlib: restrict hg up to public changesets (closes #2741838) With vcreview now supporting draft changesets as patches, apycot starts testing those draft changesets instead of the public heads, wreaking havoc. As a short term fix, make it not do that (eventually we might want to actually run unit tests on drafts, just not now).

Added tag apycot-debian-version-2.2.4-1 for changeset 0705ec800c17

Added tag apycot-version-2.2.4 for changeset ff4868ee734f

2.2.4

properly use PackageInfo object. Avoid crash because distname ends up being None, closes #2509968

Set umask to 022 instead of the default 077 (closes #2551840) When running tests, make sure we generate world-readable files, because: - checking out a hg repo obeys umask - distutils sdist uses hard links from the source tree when preparing its release tree (and thus uses the same permissions) - distutils sdist doesn't force sane file permissions when it creates a tarball - we could work around the above by setting TAR_OPTIONS when calling sdist, but that would only work with python 2.6 because 2.7 uses the tarfile module instead of forking tar This should fix issues like https://www.logilab.org/ticket/115578