| |
- Method resolution order:
- JetPerf
- mozharness.mozilla.testing.talos.Talos
- mozharness.mozilla.testing.testbase.TestingMixin
- mozharness.base.python.VirtualenvMixin
- mozharness.mozilla.buildbot.BuildbotMixin
- mozharness.base.vcs.vcsbase.MercurialScript
- mozharness.base.vcs.vcsbase.VCSScript
- mozharness.base.vcs.vcsbase.VCSMixin
- mozharness.base.script.BaseScript
- mozharness.base.script.ShellMixin
- mozharness.base.script.OSMixin
- mozharness.base.log.LogMixin
- __builtin__.object
Methods defined here:
- __init__(self, require_config_file=False)
- addons_from_directory(self, directory)
- scans a directory for jetpack addon sources and returns a list
- baseline(self)
- run baseline ts tests
- baseline_results_filename(self)
- build(self)
- Build each test add-on with the add-ons SDK
- cfx(self)
- returns path to cfx
- pull(self)
- clone the needed repositories
- report_tbpl_status(self)
- results_filename(self)
- return the results file path from self.results_url
- run_talos(self, name, *args, **kw)
- runs PerfConfigurator and talos
- test(self)
- run talos tests
Data and other attributes defined here:
- actions = ['clobber', 'pull', 'build', 'read-buildbot-config', 'download-and-extract', 'create-virtualenv', 'install', 'test', 'baseline']
- config_options = [[['--talos-url'], {'action': 'store', 'default': 'http://hg.mozilla.org/build/talos/archive/tip.tar.gz', 'dest': 'talos_url', 'help': 'Specify the talos package url'}], [['--add-option'], {'action': 'extend', 'default': None, 'dest': 'talos_options', 'help': 'extra options to PerfConfigurator'}], [['-a', '--tests'], {'action': 'extend', 'default': [], 'dest': 'tests', 'help': 'Specify the tests to run'}], [['--results-url'], {'action': 'store', 'default': None, 'dest': 'results_url', 'help': 'URL to send results to'}], [['--installer-url'], {'action': 'store', 'default': None, 'dest': 'installer_url', 'help': 'URL to the installer to install'}], [['--installer-path'], {'action': 'store', 'default': None, 'dest': 'installer_path', 'help': 'Path to the installer to install. This is set automatically if run with --download-and-extract.'}], [['--binary-path'], {'action': 'store', 'default': None, 'dest': 'binary_path', 'help': 'Path to installed binary. This is set automatically if run with --install.'}], [['--test-url'], {'action': 'store', 'default': None, 'dest': 'test_url', 'help': 'URL to the zip file containing the actual tests'}], [['--venv-path', '--virtualenv-path'], {'action': 'store', 'default': 'venv', 'dest': 'virtualenv_path', 'help': 'Specify the path to the virtualenv top level directory'}], [['--virtualenv'], {'action': 'store', 'dest': 'virtualenv', 'help': 'Specify the virtualenv executable to use'}], [['--pypi-url'], {'action': 'store', 'dest': 'pypi_url', 'help': 'Base URL of Python Package Index (default http://pypi.python.org/simple/)'}], [['--find-links'], {'action': 'extend', 'dest': 'find_links', 'help': 'URL to look for packages at'}], [['--addon'], {'action': 'extend', 'default': [], 'dest': 'addon-directories', 'help': 'paths to addon directories'}]]
- default_actions = ['clobber', 'pull', 'build', 'download-and-extract', 'create-virtualenv', 'install', 'test', 'baseline', 'report-tbpl-status']
- default_repos = [{'dest': 'addon-sdk', 'repo': 'http://hg.mozilla.org/projects/addon-sdk', 'revision': 'default'}, {'dest': 'addons_clone', 'repo': 'http://hg.mozilla.org/projects/addon-sdk-jetperf-tests/', 'revision': 'default'}]
Methods inherited from mozharness.mozilla.testing.talos.Talos:
- PerfConfigurator_options(self, args=None, **kw)
- return options to PerfConfigurator
- generate_config(self, conf='talos.yml', options=None)
- generate talos configuration
- preflight_generate_config(self)
- run_tests(self, conf='talos.yml')
- talos_conf_path(self, conf)
- return the full path for a talos .yml configuration file
Data and other attributes inherited from mozharness.mozilla.testing.talos.Talos:
- talos_options = [[['-a', '--tests'], {'action': 'extend', 'default': [], 'dest': 'tests', 'help': 'Specify the tests to run'}], [['--results-url'], {'action': 'store', 'default': None, 'dest': 'results_url', 'help': 'URL to send results to'}]]
Methods inherited from mozharness.mozilla.testing.testbase.TestingMixin:
- download_and_extract(self)
- Create virtualenv and install dependencies
- install(self)
- Dependent on mozinstall
- postflight_read_buildbot_config(self)
- Determine which files to download from the buildprops.json file
created via the buildbot ScriptFactory.
- preflight_download_and_extract(self)
- preflight_install(self)
Data and other attributes inherited from mozharness.mozilla.testing.testbase.TestingMixin:
- binary_path = None
- installer_path = None
- installer_url = None
- test_url = None
- test_zip_path = None
Methods inherited from mozharness.base.python.VirtualenvMixin:
- create_virtualenv(self)
- Create a python virtualenv.
The virtualenv exe can be defined in c['virtualenv'] or
c['exes']['virtualenv'], as a string (path) or list (path +
arguments).
c['virtualenv_python_dll'] is an optional config item that works
around an old windows virtualenv bug.
virtualenv_modules can be a list of module names to install, e.g.
virtualenv_modules = ['module1', 'module2']
or it can be a list of dicts that define a module: url-or-path,
or a combination.
virtualenv_modules = [
'module1',
{'module2': 'http://url/to/package'},
{'module3': os.path.join('path', 'to', 'setup_py', 'dir')},
]
- install_module(self, module, module_url=None, install_method=None)
- Install module via pip.
module_url can be a url to a python package tarball, a path to
a directory containing a setup.py (absolute or relative to work_dir)
or None, in which case it will default to the module name.
- is_python_package_installed(self, package_name, error_level='warning')
- Return whether the package is installed
- package_versions(self, pip_freeze_output=None, error_level='warning')
- reads packages from `pip freeze` output and returns a dict of
{package_name: 'version'}
- query_python_path(self, binary='python')
- Return the path of a binary inside the virtualenv, if
c['virtualenv_path'] is set; otherwise return the binary name.
Otherwise return None
- query_python_site_packages_path(self)
- query_virtualenv_path(self)
Data descriptors inherited from mozharness.base.python.VirtualenvMixin:
- __dict__
- dictionary for instance variables (if defined)
- __weakref__
- list of weak references to the object (if defined)
Data and other attributes inherited from mozharness.base.python.VirtualenvMixin:
- python_paths = {}
- site_packages_path = None
Methods inherited from mozharness.mozilla.buildbot.BuildbotMixin:
- buildbot_status(self, tbpl_status, level=None)
- dump_buildbot_properties(self, prop_list=None, file_name='properties', error_level='error')
- query_buildbot_property(self, prop_name)
- read_buildbot_config(self)
- set_buildbot_property(self, prop_name, prop_value, write_to_file=False)
- tryserver_email(self)
Data and other attributes inherited from mozharness.mozilla.buildbot.BuildbotMixin:
- buildbot_config = None
- buildbot_properties = {}
Data and other attributes inherited from mozharness.base.vcs.vcsbase.MercurialScript:
- default_vcs = 'hg'
Methods inherited from mozharness.base.vcs.vcsbase.VCSMixin:
- vcs_checkout(self, vcs=None, **kwargs)
- Check out a single repo.
- vcs_checkout_repos(self, repo_list, parent_dir=None, tag_override=None, **kwargs)
- Check out a list of repos.
Methods inherited from mozharness.base.script.BaseScript:
- action_message(self, message)
- add_failure(self, key, message='%(key)s failed.', level='error')
- add_summary(self, message, level='info')
- clobber(self)
- Delete the working directory
- copy_to_upload_dir(self, target, dest=None, short_desc='unknown', long_desc='unknown', log_level='debug', error_level='error', rotate=False, max_backups=None)
- Copy target file to upload_dir/dest.
Potentially update a manifest in the future if we go that route.
Currently only copies a single file; would be nice to allow for
recursive copying; that would probably done by creating a helper
_copy_file_to_upload_dir().
short_desc and long_desc are placeholders for if/when we add
upload_dir manifests.
- dump_config(self, file_path=None)
- Dump self.config to localconfig.json
- new_log_obj(self, default_log_level='info')
- # logging {{{2
- query_abs_dirs(self)
- We want to be able to determine where all the important things
are. Absolute paths lend themselves well to this, though I wouldn't
be surprised if this causes some issues somewhere.
This should be overridden in any script that has additional dirs
to query.
The query_* methods tend to set self.VAR variables as their
runtime cache.
- query_failure(self, key)
- run(self)
- Default run method.
This is the "do everything" method, based on actions and all_actions.
First run dump_config() if it exists.
Second, go through the list of all_actions.
If they're in the list of self.actions, try to run
preflight_ACTION(), ACTION(), and postflight_ACTION().
Preflight is sanity checking before doing anything time consuming or
destructive.
Postflight is quick testing for success after an action.
Run summary() at the end.
- summarize_success_count(self, success_count, total_count, message='%d of %d successful.')
- summary(self)
- Print out all the summary lines added via add_summary()
throughout the script.
I'd like to revisit how to do this in a prettier fashion.
Methods inherited from mozharness.base.script.ShellMixin:
- get_output_from_command(self, command, cwd=None, halt_on_failure=False, env=None, silent=False, log_level='info', tmpfile_base_path='tmpfile', return_type='output', save_tmpfiles=False, throw_exception=False)
- Similar to run_command, but where run_command is an
os.system(command) analog, get_output_from_command is a `command`
analog.
Less error checking by design, though if we figure out how to
do it without borking the output, great.
TODO: binary mode? silent is kinda like that.
TODO: since p.wait() can take a long time, optionally log something
every N seconds?
TODO: optionally only keep the first or last (N) line(s) of output?
TODO: optionally only return the tmp_stdout_filename?
- query_env(self, partial_env=None, replace_dict=None, set_self_env=None)
- Environment query/generation method.
The default, query_env(), will look for self.config['env']
and replace any special strings in there ( %(PATH)s ).
It will then store it as self.env for speeding things up later.
If you specify partial_env, partial_env will be used instead of
self.config['env'], and we don't save self.env as it's a one-off.
- query_exe(self, exe_name, exe_dict='exes', default=None, return_type=None, error_level='fatal')
- One way to work around PATH rewrites.
By default, return exe_name, and we'll fall through to searching
os.environ["PATH"].
However, if self.config[exe_dict][exe_name] exists, return that.
This lets us override exe paths via config file.
'return_type' can be None (don't do anything to the value),
'list' (return a list), or 'string' (return a string).
If we need runtime setting, we can build in self.exes support later.
- run_command(self, command, cwd=None, error_list=None, parse_at_end=False, halt_on_failure=False, success_codes=None, env=None, return_type='status', throw_exception=False)
- Run a command, with logging and error parsing.
TODO: parse_at_end, context_lines
TODO: retry_interval?
TODO: error_level_override?
TODO: Add a copy-pastable version of |command| if it's a list.
TODO: print env if set
error_list example:
[{'regex': re.compile('^Error: LOL J/K'), level=IGNORE},
{'regex': re.compile('^Error:'), level=ERROR, contextLines='5:5'},
{'substr': 'THE WORLD IS ENDING', level=FATAL, contextLines='20:'}
]
(context_lines isn't written yet)
Methods inherited from mozharness.base.script.OSMixin:
- chdir(self, dir_name, ignore_if_noop=False)
- chmod(self, path, mode)
- copyfile(self, src, dest, log_level='info', error_level='error')
- download_file(self, url, file_name=None, parent_dir=None, create_parent_dir=True, error_level='error', exit_code=-1)
- Python wget.
TODO: should noop touch the filename? seems counter-noop.
TODO: the initial log line should say "Downloading url to file_name"
- get_filename_from_url(self, url)
- mkdir_p(self, path, error_level='error')
- Returns None for success, not None for failure
- move(self, src, dest, log_level='info', error_level='error', exit_code=-1)
- read_from_file(self, file_path, verbose=True, open_mode='r', error_level='error')
- Reads from file_path.
Returns contents if successful, None if not.
- rmtree(self, path, log_level='info', error_level='error', exit_code=-1)
- Returns None for success, not None for failure
- which(self, program)
- OS independent implementation of Unix's which command
Takes in a program name
Returns path to executable or None
- write_to_file(self, file_path, contents, verbose=True, open_mode='w', create_parent_dir=False, error_level='error')
- Write contents to file_path.
This doesn't currently create the parent_dir or translate into
abs_path; that needs to be done beforehand, since OSMixin doesn't
necessarily have access to query_abs_dirs().
Returns file_path if successful, None if not.
Methods inherited from mozharness.base.log.LogMixin:
- critical(self, message)
- debug(self, message)
- dump_exception(self, message=None, level='error')
- # Copying Bear's dumpException():
# http://hg.mozilla.org/build/tools/annotate/1485f23c38e0/sut_tools/sut_lib.py#l23
- error(self, message)
- fatal(self, message, exit_code=-1)
- info(self, message)
- log(self, message, level='info', exit_code=-1)
- warning(self, message)
|