Changes Report

Release History

Version Date Description
0.7.3-alpha 03-02-2009 Ninth Alpha Release. New tools and productivity features.
0.7.2-alpha 02-04-2009 Eight Alpha Release. Productivity and robustness features.
0.7.1-alpha 12-30-2008 Seventh Alpha Release. Infrastructure and new tools.
0.7.0-alpha 12-01-2008 Sixth Alpha Release. Major reachitecture.
0.6.4-alpha 08-27-2008 Fifth Alpha Release. Feature and maintenance release.
0.6.3-alpha 06-19-2008 Fourth Alpha Release. Feature and maintenance release.
0.6.2-alpha 04-07-2008 Third Alpha Release. Feature and maintenance release.
0.6.1-alpha 02-28-2008 Second Alpha Release. Feature and maintenance release.
0.6.0-alpha 02-11-2008 Initial Alpha Release. Complete infrastructure plus limited feature set.


Release 0.7.3-alpha - 03-02-2009

Type Changes By
add First working draft of the new "Results Browser": infrastructure for local daemons and integration into Web Control Panel. Fixes GWE- . mruiz
update Redesign and implementation of P2EL compilation cycles: compilation -> system resolution -> runtime resolution. Fixes GWE- . mruiz
add New order "permutation dumps" features: CSV and generated commands of order submitted. Fixes GWE- . mruiz
add New server side (user API) preview order feature and integration with the client side preview (macro expansions) available in the Web Control Panel. Fixes GWE- . mruiz
update Enhancements to "regExp" P2EL function to support specific matching interest. Fixes GWE- . mruiz
add Configurable resource managers per daemon to take precedence over the resource manager auto-discovery process. Fixes GWE- . mruiz
add New resource manager driver to support clusters managed by "bsub" based systems (LSF, Lava). Fixes GWE- . mruiz
add New "compute node connection timeout" feature and configuration option. Fixes GWE- . mruiz
fix Fix stalling allocations for "local" resource manager. Fixes GWE-155 . mruiz
add New P2EL macros categorization infrastructure and integration into the Web Control Panel. Fixes GWE- . mruiz
add Option to select daemon bundle type to deploy for installation. Fixes GWE- . mruiz
fix Fix key store encryption problems for 64-bits machines. Fixes GWE- . mruiz

Release 0.7.2-alpha - 02-04-2009

Type Changes By
add Configurable HTTP authentication. Fixes GWE-166 . mruiz
add Support for special "root" variable for P2EL macros. Legacy macros update to take advantage of this variable. Fixes GWE-167 . mruiz
add P2EL macros to support XNAT operations through the REST API. Fixes GWE-168 . mruiz
update Configurable daemon's product installation and operational database path. Replaced 'gweHome' from key store configuration. Fixes GWE-164 . mruiz
add Secure read of passwords and pass phrases and encryption of the complete key store. Fixes GWE-162, GWE_85 . mruiz
add New P2EL value generator function: text file parser. Fixes GWE-169 . mruiz
update Infrastructure enhancements to the test host feature and integration into GWE terminal. Fixes GWE-165 . mruiz
add Files related to allocations disposed are now stored in a special workspace folder. New option in the web control panel to clean up this folder. Fixes GWE-9 . mruiz
add Delete order feature implementation and integration into "GWE Terminal" and "GWE Web Control Panel". Fixes GWE-76 . mruiz
add Pause and resume order feature implementation and integration into "GWE Terminal" and "GWE Web Control Panel". Fixes GWE-41 . mruiz

Release 0.7.1-alpha - 12-30-2008

Type Changes By
add New "GWE Web Control Panel" sub-project. Full feature, rich web client application to manage a GWE Grid. Fixes GWE-138 . mruiz
add Full feature P2EL macro module. Includes some out-of-the-box macros. Fixes GWE-124 . mruiz
add New P2EL value generator function: XPath based parser. Fixes GWE-134 . mruiz
update Resource handle factory infrastructure to replace the convoluted drivers framework. Fixes GWE-139 . mruiz
add P2EL inline editor in the GWE Terminal application. Fixes GWE-140 . mruiz
add Registry for host tunnels to keep a better control on when and what ports should be tunneled. Fixes GWE-141 . mruiz
fix IP port conflicts created by opening tunnels on ports without even checking if they are being used. Uses the new tunnels registry. Fixes GWE-142 . mruiz
update Client sessions registry to replace hardcoded the grid controller "single session per client" functionality. Fixes GWE-143 . mruiz
update More data available to the clients through opening more APIs and capturing more data related to the execution of jobs. Fixes GWE-144 . mruiz
add Keystore test feature using test hosts per authentication info. Fixes GWE-145 . mruiz
add Logging infrastructure (to make logging level configurable per application). Fixes GWE-146 . mruiz
add "Hasher" type of P2EL value space generator functions: hexadecimal MD5 calculator and UUID random generator. Fixes GWE-147 . mruiz

Release 0.7.0-alpha - 12-01-2008

Type Changes By
update Replaced multi-user paradigm (and its associated extra security layer, user workspace resolution, user virtual file system resolution, etc). A GWE daemon per user will now be used instead. This will be far easier to use and provides more robustness by relying on the OS multi-user features. Fixes GWE-127 . mruiz
update Consolidation of all operational data under workspace (virtual file system, generated scripts, processes results, job managers submission files, logs, etc) Fixes GWE-127 . mruiz
update GWE level login will transparently reuse the SSH credentials. Replaced the old explicit GWE login. Fixes GWE-128 . mruiz
update Single daemon services registry for multiple daemons running in a host - uniqueness scheme for registering services based on daemon's installation path. Fixes GWE-86 . mruiz
update Daemon auto/silent installer. More robust than the previous one and doesn't require any manual intervention. Fixes GWE-32 . mruiz
update Simplified, cleaner configuration. Fixes GWE-98 . mruiz
add Configurable P2EL variables per daemon. Fixes GWE-136 . mruiz
add "Local cluster" driver. It emulates a cluster out of the local machine. Fixes GWE-126 . mruiz
add Configurable job managers submission templates. Fixes GWE-135 . mruiz
add New (optional) feature for the P2EL download function to auto-decompress downloaded files. Fixes GWE-137 . mruiz
add Framework to support order execution profiles to configure execution behavior (first draft). Fixes GWE-89 . mruiz
add Capabilities for job retries and failures tracking (using the execution profiles framework). Fixes GWE-100 . mruiz
update Dramatic increase in robustness and performance in the routines for agent failover and recovery and daemon and agent launching. Fixes GWE-83 . mruiz
add Ignore SSH host keys verifications. Fixes GWE-84 . mruiz
update Slicer integration updated with all the current features. Fixes GWE-129 . mruiz
fix New HTTP driver based on core java. The commons vfs library has nasty multi-threading deadlocks issues. Fixes GWE-24 . mruiz

Release 0.6.4-alpha - 08-27-2008

Type Changes By
add Generic parser framework based on regular expression rules (as infrastructure for P2EL version 2). Fixes GWE-117 . mruiz
remove P2EL version 1 and its integration with GWE. Fixes GWE-110 . mruiz
add P2EL version 2. Language design (syntax and semantics), module design, implementation and documentation. Fixes GWE-110 . mruiz
update Migration of functionality of old P2EL into the new version. Fixes GWE-112 . mruiz
update Integration of P2EL version 2 with GWE. Fixes GWE-120 . mruiz
add Implementation of multidimensional variables features (variables of type array) into the new version of P2EL. Fixes GWE-113 . mruiz
add Implementation of variables co-dependency features into the new version of P2EL. This has the nice side effect of allowing function invocation aggregation functionality. Fixes GWE-114 . mruiz
add Upload/download functions to support directories in addition to just files. Fixes GWE-116 . mruiz
update Redesign and re-implementation P2EL "dir" function (old "expand") to make it more versatile by allowing matching patterns per file branches. Fixes GWE-118 . mruiz
add "grep" like function for P2EL. Fixes GWE-116 . mruiz
update Friendlier error messages for user mistakes while using GWE generic clients. Fixes GWE-121 . mruiz
update More status information added to the generic client query commands. Fixes GWE-122 . mruiz

Release 0.6.3-alpha - 06-19-2008

Type Changes By
add Full PKI (public key infrastructure) authentication support, including private key passphrase prompting on shell based applications when necessary. Fixes GWE-7 . mruiz
add Utility to read private key's passphrases from the prompt of shell based applications. Usage of this utility to add its feature to the generic GWE clients. Fixes GWE-77 . mruiz
fix Misleading exception messages (output in the generic GWE clients) have been replaced with actual user and system errors. Fixes GWE-22 . mruiz
add Full feature framework to support pluggable, life cycle based, P2EL functions. Fixes GWE-56 . mruiz
add Abstract resource stager framework built as an extension of the P2EL function framework. Fixes GWE-58 . mruiz
update Re-implementation of file staging feature as pluggable functions into the new resource stager framework. Fixes GWE-57 . mruiz
update Performance improvement of core file transfer routines. Fixes GWE-81 . mruiz
add Support for P2EL anonymous variables, as a P2EL function. Fixes GWE-55 . mruiz
add Support for P2EL wildcard support to traverse on file names, as a P2EL function. Fixes GWE-3 . mruiz
update Increased robustness of condor resource manager driver discovery by using condor_version instead of condor_status. Fixes GWE-75 . mruiz
update Revamped Slicer3 CLMP framework to increase flexibility and robustness to the Slicer3 CLMP framework. Motivated mainly to be able to reuse it to create the side project "Slicer3 Chain Modules Engine". Fixes GWE-80 . mruiz
fix Job result stored in the DB compressed to prevent it from reaching the 32K size limit (DB updates were crashing because of this). Fixes GWE-82 . mruiz
add New online forum for the GWE community to share their experiences and comments. mruiz
update "P2EL Guide" and "Configuration Guide" updated according to changes. mruiz

Release 0.6.2-alpha - 04-07-2008

Type Changes By
fix Processing of jobs in compute nodes using the user that submitted the job rather than the user running the GWE daemon. Fixes GWE-10 . mruiz
add Regular and administrator user domain integrated with GWE level authentication and authorization. Fixes GWE-19 . mruiz
add Rich set of features added to the terminal application (powered by JLine). Among these are: masked password capturing, inline command edition, command history, tab completion and tab suggestion. Fixes GWE-39 . mruiz
add Major refactoring of the configuration API for tool integration. It has been made simpler, more robust and flexible. Fixes GWE-46 . mruiz
add New startup service beacon on the GWE daemon to report initialization progress to the remote client installing/configuring/launching it. Fixes GWE-50 . mruiz
fix SSH tunnels opened using logged in users authentication information and not that of the user running the GWE daemon. Fixes GWE-62 . mruiz
fix Condor system id retrieved in the condor driver. Fixes GWE-63 . mruiz
update Re-architect package manager and application factory as grid level factories by extending the driver framework (GridBundleManager and GridOSAppManager). Fixes GWE-64 . mruiz
add GWE security domain authorization layer module using AOP security interceptors. Fixes GWE-65 . mruiz
update Simplified session and accessor API for tool integration Fixes GWE-66 . mruiz
update Integrated simplified session and accessor API with shell based applications (terminal and command) and slicer CLMPs Fixes GWE-67 . mruiz
add GWE security authentication layer module using hierarchy encryption (daemon encryptor, over user passwords MD5 hash, over user sensitive data) Fixes GWE-68 . mruiz
add Security authentication utility module using MD5 based symmetric keys and AES encryption. Fixes GWE-69 . mruiz
update Increased robustness and flexibility of the utility to install, configure and launch a GWE daemon. Fixes GWE-70 . mruiz
add Added GWE authentication information capturing capabilities to Slicer3 CLMP modules. Fixes GWE-71 . mruiz
add User translation layer module for pre-processing (downloading files) and post processing (uploading files and clean up) job related activities. These functions will no longer be performed by the user running the GWE daemon. Fixes GWE-72 . mruiz
add Relocated user workspace to user's home directory in cluster head node. Fixes GWE-73 . mruiz

Release 0.6.1-alpha - 02-28-2008

Type Changes By
update Changed scripts naming conventions. All command scripts have been renamed with the prefix "gwe-cmd" and all utility type of scripts have been renamed with "gwe-util". mruiz
add Generic download manager framework to stage files. Includes garbage collection and file caching. Fixes GWE-52 . mruiz
add Virtual file system sandbox per user to stage files. Built on top of new generic download manager framework. Fixes GWE-4 . mruiz
add Order life cycle hooks to start processing in a particular cluster and clean up after done. This was only available at the job level before. Concrete usage allocates a download manager for file staging of an order and delete the virtual file system from the cluster file system once finished. Fixes GWE-53 . mruiz
update Renamed P2L as P2EL (Processes Parallel Execution Language) to more accurately represent it. mruiz
update P2EL interpreter robustness. Still in progress though. Fixes GWE-12 . mruiz
fix P2EL now accepts P2EL script files as a parameter for queuing orders. Fixes GWE-23 . mruiz
add P2EL semantics to support float ranges. Fixes GWE-1 . mruiz
add P2EL semantics to support optional range stepping information. Fixes GWE-1 . mruiz
add P2EL semantics to support optional formatting and precision information for numeric value ranges. Fixes GWE-47 . mruiz
add P2EL semantics to support stage file renaming. Fixes GWE-51 . mruiz
fix Fixed allocations disposal timeouts to respect the aging and laziness tolerance level of the system towards an allocated compute resource. Fixes GWE-2 . mruiz
add "Slicer Integration" module. See "GWE Tool Integration > Case: 3D Slicer" for more details its feature set and user guide. mruiz
update Removed, created and overall clean up of messages to be output in log files. mruiz
add Issue management system for the project. mruiz
add Mailing lists for the project. mruiz
update Updated project site with an improved navigation, a feature list page, release notes, source code browser and javadocs and other useful project information and reports. mruiz
add Progress documentation of the "3D Slicer integration" effort. mruiz

Release 0.6.0-alpha - 02-11-2008

Type Changes By
add Complete abstract infrastructure plus a limited feature set. Check features page for details. mruiz