v0.30.1

The present release fixes a linking issue on Mac.

• [build] Fix linkage on Mac

v0.30.0

The present release brings important fixes and reliability improvements throughout AliECS, including support for vars in task templates, reflection support in the OCC components and debugging facilities.

• Workflow:

  • [core] Ensure an autoenvironment that fails to deploy doesn't configure
  • [core] Add Dump(var, filepath) function to template system
  • [core] Add support for vars in task templates
  • [workflow] Revert role parallelization

• Miscellaneous:

  • [coconut] Increase max gRPC payload size to 50M
  • [occ] Add reflection support to OCC gRPC server
  • [repos] Clean ssh repos git dir on refresh

v0.29.2

The present patch release adds support for just-in-time (JIT) generation of DPL subworkflows, as well as improving workflow template processing performance.

• [apricot] Add GetEntryWithLastIndex runtime service
• [core] Add RepoAccessFuncs in templates
• [core] Add JIT func in templates (provisional)
• [core] Use Component config for JIT consul payloads
• [repo] Clean repo on refresh
• [repos] Remove apricot dependency from package
• [workflow] Best effort aggregator & iterator parallelization

v0.29.1

The present patch release improves some debug output in the O² Bookkeeping integration client.

• [core] Print debug message to IL on Bookkeeping client calls

v0.29.0

The present release brings important improvements in the template system and in the ODC client, adding support for the PDP panel in the GUI and the EPN processing script generator.

• Template improvements:
  • [core] Add ObjectStack + CallStack to plugin system
  • [core] Support script vs topology alternatives in ODC calls
  • [core] Implementation of GenerateEPNWorkflowScript + usage in Configure
  • [core] Add missing initialization in ODC plugin
  • [core] Ensure all plugin functions are deep-copied into template context
  • [core] Improve EPN script generator default behaviour
  • [core] Use default as default string for PDP detector lists

v0.28.0

This release brings improvements to AliECS, a cleanup mechanism for the TRG (formerly CTP) integration plugin and minified versions of some API calls. It also brings a new feature, hook weights, which allows a workflow author to append a + or - signed integer to trigger and await expressions to make call execution sequential.

• Minified API:

  • [core][coconut] Add minification switches to GetEnvs/GetEnv calls

• DCS cleanup fix:

  • [core] Improve DCS client logging and run number cache
  • [core] Greedy run number caching in DCS client
  • [core] Track DCS operation status for each detector

• TRG integration plugin:

  • [core] Trigger client run number cache and Cleanup function
  • [core] The ctp plugin is now called trg

• Hook weight index:

  • [core] Support weight in hook target/await expressions
  • [core] New plugin "testplugin" with call testplugin.Noop()
  • [core] Ensure the testplugin can be loaded
  • [core] Fix hook call weights list generation

v0.27.80

This release brings improvements to AliECS, a cleanup mechanism for the TRG (formerly CTP) integration plugin and minified versions of some API calls.

• Minified API:

  • [core][coconut] Add minification switches to GetEnvs/GetEnv calls

• TRG integration plugin:

  • [core] Improve DCS client logging and run number cache
  • [core] Trigger client run number cache and Cleanup function
  • [core] The ctp plugin is now called trg

v0.27.1

The present patch release in the v0.27 series brings important improvements to the AliECS core, including ODC integration facilities and hook handling.

• [core] Improve debug output of ODC cleanup operations
• [core] Relax locking in environment manager
• [core] Improve thread safety in task manager class cache
• [core] Only query for active ODC partitions, and immediately Shutdown
• [core] Parallelize ODC Shutdown calls during cleanup
• [core] Parallelize AwaitAll in hook call processing
• [core] Send run number in ODC Start/Stop calls
• [core] Also send run number to ODC in SetProperties call

v0.27.0

This release brings major improvements to AliECS, including an overhaul of timeouts and locking in the AliECS core, CTS (trigger system) integration, and improvements to Bookkeeping integration and other integration facilities.

• Core locking and timeouts:

  • [core] Improve error response consolidation and mutex granularity
  • [core] Improve mutex granularity in environment manager
  • [core] Declare offending roles in failed DEPLOY transition
  • [core] Correctly report nil error if no tasks failed to CONFIGURE
  • [core] Expose call traits (including timeout) to called function
  • [core] Return inline error of the correct type
  • [core] Don't crash when parsing error on MesosCommandResponse

• Integration:

  • [core] Bookkeeping get JWT from consul
  • [core] Ensure all ODC calls are bound by a context with timeout
  • [core] Move acquireTimeout utility function to the callable package
  • [core] Ensure all DCS calls are bound by a context with timeout
  • [core] Ensure all DDsched calls are bound by a context with timeout
  • [core] Adjust level of DCS client log messages
  • [core] Forward ODC error messages
  • [core] Pass detectors to Bookkeeping API
  • [core] Pass any var ddsched_ to DD scheduler as param
  • [core] Pass any var odc_ to ODC except known named params
  • [core] Update ODC protofile
  • [core] Make environment.Manager single instance accessible from outside
  • [core] New cleanup facilities for ODC

• CTS/CTP integration plugin:

  • [core] Add ctpecs protos
  • [core] Create CTS client
  • [core] Create CTS plugin
  • [core] Register CTS plugin
  • [core] CTS plugin cleanup debug messages
  • [core] Update ctp proto file
  • [core] Rename cts to ctp
  • [core] Add RunUnload and extend logic for the remaining ones
  • [core] CTP run start read config from consul
  • [core] Add GetRuntimeConfig func in templates
  • [core] CTP get global config

• Miscellaneous:

  • [build] Minor go.mod adjustment
  • [core] Improve logging in env.handleHooks
  • [core] Reduce verbosity of recurrent log messages
  • [executor] Remove excessive debug output
  • [executor] Fix MesosCommandResponse error handling

v0.26.82

This release brings major improvements to AliECS, including an overhaul of timeouts and locking in the AliECS core, CTS (trigger system) integration, and improvements to Bookkeeping integration and other integration facilities.

• Core locking and timeouts:

  • [core] Improve error response consolidation and mutex granularity
  • [core] Improve mutex granularity in environment manager
  • [core] Declare offending roles in failed DEPLOY transition
  • [core] Correctly report nil error if no tasks failed to CONFIGURE
  • [core] Expose call traits (including timeout) to called function
  • [core] Return inline error of the correct type
  • [core] Don't crash when parsing error on MesosCommandResponse

• Integration:

  • [core] Bookkeeping get JWT from consul
  • [core] Ensure all ODC calls are bound by a context with timeout
  • [core] Move acquireTimeout utility function to the callable package
  • [core] Ensure all DCS calls are bound by a context with timeout
  • [core] Ensure all DDsched calls are bound by a context with timeout
  • [core] Adjust level of DCS client log messages
  • [core] Forward ODC error messages
  • [core] Pass detectors to Bookkeeping API

• CTS integration plugin:

  • [core] Add ctpecs protos
  • [core] Create CTS client
  • [core] Create CTS plugin
  • [core] Register CTS plugin
  • [core] CTS plugin cleanup debug messages
  • [core] Update ctp proto file
  • [core] Rename cts to ctp
  • [core] Add RunUnload and extend logic for the remaining ones
  • [core] CTP run start read config from consul
  • [core] Add GetRuntimeConfig func in templates

• Miscellaneous:

  • [build] Minor go.mod adjustment
  • [core] Improve logging in env.handleHooks
  • [core] Reduce verbosity of recurrent log messages
  • [executor] Remove excessive debug output
  • [executor] Fix MesosCommandResponse error handling