[entities] make sure log files are *not* indexed (FTI)

[test] ensure cubicweb.devtools is imported first so the cubes are in sys.path

[test] fill-in incomplete test docstring

[test] kill commented tests

[checkers] move lgp checkers to apycot since it's more consistent to have lintian and piuparts checkers alongside the lgp build checker.

[test] do not run PyLintChecker tests if pylint is not available

[doc] update the documentation - remove deprecated content - adapt to signedrequest dependency

[pkg] remove dependency on pyro and recommend logilab-devtools

[migration] a few simplifications and fixes - use rename_relation_type instead of deprecated rename_relation - look at Plan's default workflow, not any workflow - we don't need to log in as narval, managers should be able to fire transitions - avoid a few useless sync_schema_props_perms calls - drop TestExecution.arguments

[test] fix imports for distutils preprocessor

[apycotlib] do not add carriage return between log blocks

[pkg] create the checkers and preprocesors folders in /usr/share/narval these folders where previously created by narval. They are part of what is added by apycot and should therefore be created by apycot. The main changes is to include the __init__ files at the root folder of checkers and preprocessors.

[apycotlib] update testexec status to error when preprocessor fails previously, the status would stay at 'waiting execution' or 'success' even if no checker was run.

[apycotlib] update the refresh-log method using the new append-to-file controller

[apycotlib] fix archive upload of narvalbot - use texec eid in archive name (previously, the URL containing unauthorized characters was used) - put relative path in archive instead of absolute path - don't go through useless StringIO when we can just pass the file object to requests

[hooks] force status to failed if status not updated by checker normally, the testexecution status is updated by the narvalbot. However, if the recipe code fails the transition to fail is fired, but the testexecution is not changed. In case of a 'publish recipe', this is an issue as only a single testexecution must be in the 'waiting execution' state. This patch adds a test showing the issue and the associated hook modification.

[apycotlib] do not crash when the repository is not in the data

[views] fix json dumps: add data in the correct format and only if available

[apycotlib] add and update piuparts checker

[apycotlib] update debian checkers for narval 4 - avoid name collision with existing python module "debian" - fix pylint_threshod option name (from jpl configs)

[apycotlib] mirror changes in narval 4 for file-upload - rename of 'field' to 'r(elation)name' - rename of 'log' to 'data'

[schema] fix permissions for execution_log (TestExecution to File) The relation execution_log, inherited from Plan by TestExecution does not inherit the associated permissions unless they are explicit.

[migration] fix migration to mirror narval (closes #3687137) - log_files contained the archive of the run, they have been renamed to execution_archive - make sure the schema inherited entities are updated - create workflow data for all testexecutions

[apycotlib] make cnxh attribute from writer public the connection handler is used directly, for example to get the cubicweb instance url.

[apycotlib] remove explicit _cw_fields creation The field is created automatically by the http method.

[apycotlib] improve calls to http_get /post when communicating with cubicweb: - use get to get information from the cubicweb instance - use post to send information to modify the cubicweb instance - do not use object cwuri but concatenate cnxh url with eid

[apycotlib] also try to get a human-readable description of the signal Sadly the stdlib doesn't expose strsignal, so hack around it with ctypes.

[apycotlib] when a child dies from a signal, look up the signal name Should make for more readable logging.

Add css class corresponding to check status in summary tables

[hooks] don't crash in start_period_tests if we can't find a branch head If branch_head(branch) returns None, just ignore it instead of crashing.

[test] add missing elements in test __pkginfo__ to avoid warnings

[test] update/fix previously skipped tests - replace SetUpModule and TearDownModule by in class equivalent (repo reset needed between tests) - update old code in test_new_vc_trigger

[apycotlib] move checkers/preprocessors to have same organisation in dev and packages various necessary changes: - path updates - import cubes.apycot in tests to be sure _apycotlib is added to path - rename pylint checkers to pycheckers to avoid confusion with package checkers - fix js path in jslint.py why: If you install a pkg, the checkers are installed in:: /usr/share/narval/checkers/apycot/* and /usr/share/narval is added to the path when launching them. In a dev environment, they were previously in :: _apycotlib/checkers/* This required specific paths to make a dev environment work (added in __init__.py). The new organisation puts checkers in:: _apycotlib/checkers/apycot/* The new organisation only requires to add _apycotlib to path to make checkers work. Same thing was done for preprpocessors.

[doc] multiple doc upgrades: - Add Apycot architecture specification. Remove deprecated file. - Add Apycot quick start tutorial which replaces the French step by step - integrate old doc and remove deprecated files - Update checkers doc

[apycotlib] fix unwanted path replacement This could be a previous copy-paste mistake. The path can be predefined and should only be forced to test.project_path() if it is initially at None (else, dependencies install/config fails).

Add test to justify last change

[apycotlib] Correct dependency name call for new ProjectEnvironment format (dict).

[migration] Refactor migration script (use more RQL)

[apycotlib] Correct pyunit and pycoverage behavior by updating coverage_data Also add pycoverage checker in recipe, run if unit tests don't explode.

[migration] fix recipes not appearing because of missing commit

[checkers] Fix "name" lookup

[debian] various packaging updates and fixes - rename source package into cubicweb-apycot for the sake of consistency - bump debhelper and policy versions - use python-support and add proper dependencies - tell setup.py to move things to debian/tmp and dispatch with dh_install instead of with manual 'mv' calls - add (no-op) build-arch debian/rules target - ensure checkers and preprocessor are installed in usr/share/narval/

[apycotlib] manage preprocessors like checkers they should be installed in /usr/share/narval/

[test] fix unittest_apycot.py (follow change in narval) Narval now generates <div> instead of <pre> in formatted log views.

[test] move test/utils.py to testutils.py (closes #3241611) so it can be used from other cubes; also make the executed script an attribute of the ApycotBaseTC class (to easy reuse by other cubes).

[apycotlib] add a 'displayname' argument to the atest.Test.run_checker method (closes #3241610) so one can run the same checker several times in one test session, like:: with na.apycot_environment(plan) as test: na.install_environment(test) checker, status = test.run_checker('pyunit', displayname='Unit tests') checker, status = test.run_checker('pyunit', displayname='Regressions', test_dirs=['reg'])

[apycotlib] add a 'test_prefixes' config option for PyUnitTestChecker (closes #3241609) so one can configure the prefixes of the files identified as test to be run

[entities] fix anchor_name() to remove space chars also

[test] add config file in tests following narval changes to use instance_id

[pkg] checkers should now be installed in narval.checkers.apycot (closes #3241608) but they should still be available from source (when running unit tests), so make sure apycot/__init__.py fake the installed situation. The dummy 'checkers' module is necessary to create 'checkers.apycot'

[migration] update the script attribute of recipes, testexecutions and plans related to #e50f134e41b7 changes

[apycotlib] remove last remaining dependency to cubes (closes #3241607) we do not want apycotlib to depend on the apycot cube.

[apycotlib] embed a copy of __pkginfo__ in apycotlib made using a symlink that points to the original __pkginfo__. The apycotlib library can be installed separately from the cube. It must have a possibility to check its version without the cube

[apycotlib] typo

[apycotlib] PyTestChecker's extra_argument should be of 'csv' type instead of 'string' has this 'string' option type ever been working?

[foldunder] do not fail if pylints imports fail

[test] do not fail if pylint is not available

[test] make sure commits in data/project test hg reop are public,

[recipes] full: do not execute the pylint checker if pylint is unavailable also remove the pycoverage checker from this recipe since it's been not working for a while now.

[apycotlib] correct post for sending log archive

[views] use tag_subject_of instead of tag_attribute execution_log is now a file and not a string attribute

[schema] replace the 'log' by a log_file relation to a File (closes #3241606) also update tests. As the logs can be big, it is a better idea to handle them using files. It also makes it easier to download them from cubicweb.

[migration] pep8 + utf-8 header

[schema] rename log_file to execution_archive (closes #3241605) the "log_file" (when it exists) contains the archive of the running environment and not the logs. This commit frees the name "log_file" to be used by real logs in a commit downstream.

[apycotlib] only send the difference between actual logs and total logs (closes #3241602) in refreshlog, used by narval. This enables other connexions to send logs in between

[apycotlib] move registration of checkers in recipes

[apycotlib] change option names to avoid "." (closes #3024946) These option names are passed as parameters and parameters cannot contains dots. The names have been simplified when possible, or . replaced by _ in case of collision. Also update tests to take these changes into account

[apycotlib] use new http_upload for uploading logs (closes #3241603) this avoids issues with character encoding and is better for big files.

[apycotlib] add back lintian checker (closes #2925088)

[view] checkresults tabs and summary are now ordered by creation_date order Closes #2923618

[view] display colorized recipe in test report (closes #3241604) uses pygments (also add dependency). The imported "pygments.css" file is available in cubicweb.

[view] check for tracker cube before using it

[apycotlib] add ScriptRunner to run custom files as checks, (closes #2882718) The new checker can be derived to run any file provided the user writes a custom filename_filter method. The method has three parameters and two roles: - the first parameter (dirpath) is the path being explored; - the second parameter (dirname) is a list of directory names, the function must remove from the list the directories which should not be explored by os.walk; - the third parameter (filenames) is a list of files. The user should yield a list of files which should be run by the checker. This method uses the syntax of os.walk (see python doc). Add corresponding tests and example recipe.

[apycotlib] Add git hidden folder name to ignored files.

[apycotlib] modify AbstractFilteredFileChecker to use os.walk os.path.walk (previously used) is deprecated in python 3. This requires to move the file checks in a separate method

[test] kill skipped tests (deprecated now) in unittest_task.py

[test] update to deal with dicts instead of mock entities This is all client side where we no longer have an orm.

[test] ConnectionHandler is now HTTPConnectionHandler

Don't enable pyro The communication between cubicweb and narvalbot is now over http.

restore and unittest apycot.recipe.full

[test] reload quick recipe on startup

RESTify apycotlib

narval/piuparts: replace @DIST@ with the actual dist in apt repository uris

narval: add piuparts checker Runs after lgp.build, and calls piuparts on all the changes files.

Deal with narval's workflow changes starttime and endtime are gone, replace them by looking at related TrInfo entities. The starttime facet is being removed though, hopefully temporarily.

follow narval v4 API changes (closes #2557390) - recipes are now simple Python scripts stored in Plan.script, - no more "arguments" on the Plan CW entity, - add functional tests.

merge from stable

Added tag apycot-debian-version-2.2.7-1 for changeset 00a869904b15

Added tag apycot-version-2.2.7 for changeset 7e2fab53d5c8

2.2.7

apycotlib: give a more useful error when a project env has no repository Replaces AttributeError: 'NoneType' object has no attribute 'type' with Exception: Project environment foo has no repository

apycotlib: xml_escape strings before sending them to cw Otherwise the log can't get displayed properly. Closes #2883714

Added tag apycot-debian-version-2.2.6-1 for changeset f910f2423830

Added tag apycot-version-2.2.6 for changeset c727a537bae1

2.2.6

Brown paper bag fix for StartTestOp operation (closes #2822711) - need to use DataOperationMixIn for get_instance - operations have .session, not ._cw

Added tag apycot-version-2.2.5, apycot-debian-version-2.2.5-1 for changeset 03c81aef4a70

2.2.5

[views] kill unused import

[apycotlib] Remove broken handling of C/C++ extensions from the distutils preprocessor The extensions were being installed to /tmp/tmpXXXXXX/local/lib/python2.X/site-packages, but INSTALL_PREFIX pretended it was in /tmp/tmpXXXX/local/lib/python2.X (or /usr/bin/python, if pyversions happened to return sys.executable). While I'm at it, make pyversions not do that. Closes #2683937

[views] test presence of jqplot before using it (closes #2345646)

views/uicfg: allow to link to an existing repository (closes #2746273)

Avoid duplicate using_revision relations (closes #2766223) For some reason sometimes two CheckResultInfo entities with the same information are created, which causes things to explode.

hooks: only start tests on new public revisions (closes #2741838) Tests should be run if - a new public revision is addded, or - an existing draft revision is made public. Use an operation to group both cases, called from two separate hooks.

apycotlib: restrict hg up to public changesets (closes #2741838) With vcreview now supporting draft changesets as patches, apycot starts testing those draft changesets instead of the public heads, wreaking havoc. As a short term fix, make it not do that (eventually we might want to actually run unit tests on drafts, just not now).

Added tag apycot-debian-version-2.2.4-1 for changeset 0705ec800c17

Added tag apycot-version-2.2.4 for changeset ff4868ee734f

2.2.4

properly use PackageInfo object. Avoid crash because distname ends up being None, closes #2509968

Set umask to 022 instead of the default 077 (closes #2551840) When running tests, make sure we generate world-readable files, because: - checking out a hg repo obeys umask - distutils sdist uses hard links from the source tree when preparing its release tree (and thus uses the same permissions) - distutils sdist doesn't force sane file permissions when it creates a tarball - we could work around the above by setting TAR_OPTIONS when calling sdist, but that would only work with python 2.6 because 2.7 uses the tarfile module instead of forking tar This should fix issues like https://www.logilab.org/ticket/115578

backport stable

Fix crash with new pylint (closes #2465604) The pylint checker was exploding due to missing on_set_current_module method.

Added tag apycot-debian-version-2.2.3-1 for changeset ae91a0cc488e

Added tag apycot-version-2.2.3 for changeset 5d1b7e01c4bc

[test] fix pyunit checker test (due to uncleaned PYTHONPATH manipulation)

[test] fix tests for python 2.6 and 2.7

make cubicweb-jqplot a recommends in __pkginfo__

2.2.3 is now stable

2.2.3

[views] do no depend on jqplot (closes #2266840)

2.2.2-2 missing cubicweb-jqplot (recommends)

Added tag apycot-debian-version-2.2.2-1 for changeset 372245c5bbb0

Added tag apycot-version-2.2.2 for changeset 1e8dff8bfd1b

2.2.2

backport stable

distname in __pkginfo__.py is optional (closes #2192271) Default to the value of modname. This should let rql tests pass.

[ui] refactor project graphs view so it can be used in various places (#2176598)

[visualisation] add pylint bars

remove box title for dropdown

[visualisation] ajax form for graph visualisation of test executions

[visualisation] graph of time taken by tests in "test reports" tabs (closes #2176598) using clickable charts by testconfig/branch in the "test results" tab view (with filter when not enough results)

Fix links to CheckResult tabs (closes #2162091) When a check's name includes a '.' we need to replace it with '_'.

drop deprecated migration script: recipes don't exist anymore

fix debian control w/ python 2.7

backport stable

Added tag apycot-debian-version-2.2.1-1 for changeset 74f6596c6246

Added tag apycot-version-2.2.1 for changeset 35bdc8c657d6

2.2.1

Switch TestExecution tables to new table views (closes #1965435) Use three variants: - with all columns - with everything but the PE, for use in PE executions tab and project test reports tab - with everything but the TC, for use in TC executions tab

Escape <> in TestExecution outofcontext view (closes #2127106)

Drop debian package recipes (closes #2122154) They're Logilab-specific, better maintained elsewhere.

archive=False will generate an archive anyway. Closes #2120342

Fix error in 2.2.1 migration script

drop 2 additional call to xml_escape on already escape, html content. Closes #2089074

Fix typo in 'get dependencies' action name (closes #1777405)

fix rss view: starttime may be None. Closes #2089063

[css] Use purple instead of blue for errors (closes #1519422)

Added tag apycot-debian-version-2.2.0-1 for changeset 5b157776204a

Added tag apycot-version-2.2.0 for changeset d2e8558a7e91

2.2

use cw 3.12.7 repairing selector

update to cw 3.14 api. Closes #2063529

with vcsfile 1.9 and proper options set, don't need rely on repository's source anymore

fix call to update_env: pythonpath is multi-valued, hence separator should be specified

fix typo

fix typo in comments

fix bad arguments given to update_env in 785:7d8a3645e20d

Closes #2054465 by adding special case for cubes on installation path detection Also properly update python path when a cube is detected so that non standard 'cubes' directory is in sys.path.

Fix File permissions In 2.0.0 we switched from the 'apycot' to the 'narval' group for test execution, but the 'File' entity permissions weren't updated in the migration script. Fix that.

test fixes and drop unittest2 warnings

use path instead of url to avoid clone attempt

default is stable

Added tag apycot-debian-version-2.1.1-1 for changeset 6f767ca1279b

Added tag apycot-version-2.1.1 for changeset bd5595577b1b

2.1.1

Add a method to get the local revision number of a VersionedRepository (closes #1936768) Useful when we want something ordered, as opposed to a unique changeset id.

Rename VersionedRepository.revision to changeset (see #1936768) Should be a bit less confusing that way.

avoid useless output

backport stable

Added tag apycot-debian-version-2.1.0-1 for changeset 29da7647fd8d

Added tag apycot-version-2.1.0 for changeset 4e0f53b3d90a

2.1

Make sure test configs aren't started on a branch they're not configured for If a branch is configured in the project environment, make sure we aren't asked to start the test on a different one.

Only consider the tipmost head of a branch for testing (closes #1876193) Other heads never get tested, instead we would just keep rescheduling tests that would run against the tipmost head.

Create recipes to build/upload packages

Fix computed_start_mode computation (closes #1835791) When a TestConfig is added or its start_mode attribute is modified: - if start_mode is "inherited", set computed_start_mode based on the parent config - else set computed_start_mode to start_mode - then recursively update computed_start_mode for refined configs whose start_mode is "inherited"

Fix iterator over project environments (closes #1832903) Returning the same environment multiple times is unhelpful.

Add lintian checker (closes #1832901)

backport stable

Added tag apycot-debian-version-2.0.8-1 for changeset 2a3cc936ae63

Added tag apycot-version-2.0.8 for changeset 4dc0f60af992

oops

2.0.8

closes #1818477: kill remaining pre-narval code

closes #1818546: buggy test config may block revision creation

[migration] subpath is not actually a TestConfigGroup attribute. oops.

backport stable

Added tag apycot-debian-version-2.0.7-1 for changeset efb752c01e7b

Added tag apycot-version-2.0.7 for changeset 290d13125375

[packaging] prepare 2.0.7

When migrating to 2.0.0, don't ignore some attributes from TestConfigGroup entities We use these later on in the migration.

Fix setup instructions in README

[hooks] refactor email subject()

note

fix 2.0 migration: remember checks by serializing it into check_config

[view] xml escape TestExecution attribute in TE view

note about pyro-server

update README

remove to avoid crash when migrating from version < 1.9

encode to avoid pb when sys.stdout is None (that should be fixed...)