How to spawn slow / background commands from cf-agent? #4504

olehermanse · 2021-02-11T19:36:47Z

olehermanse
Feb 11, 2021
Maintainer

I'm writing some policy that will spawn ffmpeg to convert video files.

I want to spawn quite a few of these, in parallel, and sometimes they will take several minutes to complete.

I definitely want to keep running cf-agent at a 1 minute interval, without overlapping agent runs, and I need locking so the same command is not started the next minute. What is the recommended approach?

The command will be like this:

ffmpeg -i some_video.mkv some_video.mp4

Answered by nickanderson

Feb 11, 2021

Alternatively, you can detach the commands from the agent run, but if you do this cf-agent won't be tracking anything at all about the result of the commands.
For that, there is a daemonize bundle in the stdlib you may find helpful.

exec 2>&1
cf-locate daemonize | head 1
cf-locate -f -p daemonize
:


bundle agent daemonize(command)
# @brief Run a command as a daemon. I.e., fully detaches from Cfengine.
# @param command The command to run detached
# Note: There will be no output from the command reported by cf-agent. This
# bundle has no effect on windows
#
# **Example:**
# ```cf3
# methods:
#   "Launch Daemon"
#     usebundle => daemonize("/bin/sleep 30");
# ```
{
  commands:
    !windows…

View full answer

nickanderson · 2021-02-11T19:56:39Z

nickanderson
Feb 11, 2021
Maintainer

You can background the promise, which lets other promises go ahead and run, cf-agent won't terminate until the promises finish.

bundle agent main
{
  commands:
    "/bin/sleep 10" action => my_background; 
    "/bin/echo `I won't wait for the sleep to finish`";

}
body action my_background
{
   background => "true"; 
} 

2021-02-11T13:54:08-0600  verbose: Successfully opened extension plugin 'cfengine-enterprise.so' from '/home/nickanderson/.cfagent/lib/cfengine-enterprise.so'
2021-02-11T13:54:08-0600  verbose: Successfully loaded extension plugin 'cfengine-enterprise.so'
2021-02-11T13:54:08-0600  verbose:  CFEngine Core 3.17.0
2021-02-11T13:54:08-0600  verbose: ----------------------------------------------------------------
2021-02-11T13:54:08-0600  verbose:  Initialization preamble 
2021-02-11T13:54:08-0600  verbose: ----------------------------------------------------------------
2021-02-11T13:54:08-0600  verbose: Default port for cfengine is 5308
2021-02-11T13:54:08-0600  verbose: Work directory is /home/nickanderson/.cfagent
2021-02-11T13:54:08-0600  verbose: '/home/nickanderson/.cfagent/bin' is a symbolic link, not a directory
2021-02-11T13:54:08-0600  verbose: Making sure that internal directories are private...
2021-02-11T13:54:08-0600  verbose: Checking integrity of the trusted workdir
2021-02-11T13:54:08-0600  verbose: Checking integrity of the state database
2021-02-11T13:54:08-0600  verbose: Checking integrity of the module directory
2021-02-11T13:54:08-0600  verbose: Checking integrity of the PKI directory
2021-02-11T13:54:08-0600  verbose: Loaded private key at '/home/nickanderson/.cfagent/ppkeys/localhost.priv'
2021-02-11T13:54:08-0600  verbose: Loaded public key '/home/nickanderson/.cfagent/ppkeys/localhost.pub'
2021-02-11T13:54:08-0600  verbose: Reference time set to 'Thu Feb 11 13:54:08 2021'
2021-02-11T13:54:08-0600  verbose: CFEngine Core 3.17.0 - ready
2021-02-11T13:54:08-0600  verbose: ----------------------------------------------------------------
2021-02-11T13:54:08-0600  verbose:  Environment discovery 
2021-02-11T13:54:08-0600  verbose: ----------------------------------------------------------------
2021-02-11T13:54:08-0600  verbose: Host name is: nickanderson-ThinkPad-W550s
2021-02-11T13:54:08-0600  verbose: Operating System Type is linux
2021-02-11T13:54:08-0600  verbose: Operating System Release is 5.4.0-65-lowlatency
2021-02-11T13:54:08-0600  verbose: Architecture = x86_64
2021-02-11T13:54:08-0600  verbose: CFEngine detected operating system description is linux
2021-02-11T13:54:08-0600  verbose: The time is now Thu Feb 11 13:54:08 2021
2021-02-11T13:54:08-0600  verbose: Additional hard class defined as: 64_bit
2021-02-11T13:54:08-0600  verbose: Additional hard class defined as: linux_5_4_0_65_lowlatency
2021-02-11T13:54:08-0600  verbose: Additional hard class defined as: linux_x86_64
2021-02-11T13:54:08-0600  verbose: Additional hard class defined as: linux_x86_64_5_4_0_65_lowlatency
2021-02-11T13:54:08-0600  verbose: GNU autoconf class from compile time: compiled_on_linux_gnu
2021-02-11T13:54:08-0600  verbose: Address given by nameserver: 127.0.1.1
2021-02-11T13:54:08-0600  verbose: No interface exception file /home/nickanderson/.cfagent/inputs/ignore_interfaces.rx
2021-02-11T13:54:08-0600  verbose: Interface 1: lo
2021-02-11T13:54:08-0600  verbose: Interface 2: eth0
2021-02-11T13:54:08-0600  verbose: IP address of host set to 192.168.42.160
2021-02-11T13:54:08-0600  verbose: Interface 3: virbr0
2021-02-11T13:54:08-0600  verbose: Interface 4: docker0
2021-02-11T13:54:08-0600  verbose: Interface 5: tun0
2021-02-11T13:54:08-0600  verbose: Interface 6: vboxnet0
2021-02-11T13:54:08-0600  verbose: Interface 7: vboxnet3
2021-02-11T13:54:08-0600  verbose: Trying to locate my IPv6 address
2021-02-11T13:54:08-0600  verbose: Found IPv6 address fe80::6921:c957:423a:5f3d
2021-02-11T13:54:08-0600  verbose: Found IPv6 address fe80::1852:f8a8:1c10:1c24
2021-02-11T13:54:08-0600  verbose: Found IPv6 address fe80::800:27ff:fe00:0
2021-02-11T13:54:08-0600  verbose: Adding MAC address: 0a:00:27:00:00:01 for vboxnet1
2021-02-11T13:54:08-0600  verbose: Adding MAC address: 0a:00:27:00:00:02 for vboxnet2
2021-02-11T13:54:08-0600  verbose: Found IPv6 address fe80::800:27ff:fe00:3
2021-02-11T13:54:08-0600  verbose: Adding MAC address: 0a:00:27:00:00:04 for vboxnet4
2021-02-11T13:54:08-0600  verbose: Adding MAC address: 0a:00:27:00:00:05 for vboxnet5
2021-02-11T13:54:08-0600  verbose: Adding MAC address: 0a:00:27:00:00:06 for vboxnet6
2021-02-11T13:54:08-0600  verbose: Adding MAC address: 0a:00:27:00:00:07 for vboxnet7
2021-02-11T13:54:08-0600  verbose: Adding MAC address: 0a:00:27:00:00:08 for vboxnet8
2021-02-11T13:54:08-0600  verbose: Adding MAC address: 0a:00:27:00:00:09 for vboxnet9
2021-02-11T13:54:08-0600  verbose: Adding MAC address: 0a:00:27:00:00:0a for vboxnet10
2021-02-11T13:54:08-0600  verbose: Adding MAC address: 0a:00:27:00:00:0b for vboxnet11
2021-02-11T13:54:08-0600  verbose: Adding MAC address: 0a:00:27:00:00:0c for vboxnet12
2021-02-11T13:54:08-0600  verbose: Adding MAC address: 0a:00:27:00:00:0d for vboxnet13
2021-02-11T13:54:08-0600  verbose: Adding MAC address: 0a:00:27:00:00:0e for vboxnet14
2021-02-11T13:54:08-0600  verbose: Adding MAC address: 5c:e0:c5:9f:f3:8f for wlan0
2021-02-11T13:54:08-0600  verbose: Reading netstat info from /proc/net/netstat
2021-02-11T13:54:08-0600  verbose: Reading (null) info from /proc/net/route
2021-02-11T13:54:08-0600  verbose: Reading (null) info from /proc/net/snmp6
2021-02-11T13:54:08-0600  verbose: Reading (null) info from /proc/net/ipv6_route
2021-02-11T13:54:08-0600  verbose: Reading (null) info from /proc/net/if_inet6
2021-02-11T13:54:08-0600  verbose: Reading interfaces_data info from /proc/net/dev
2021-02-11T13:54:08-0600  verbose: Looking for environment from cf-monitord...
2021-02-11T13:54:08-0600  verbose: Unable to detect environment from cf-monitord
2021-02-11T13:54:08-0600  verbose: This appears to be a debian system.
2021-02-11T13:54:08-0600  verbose: Looking for Debian version...
2021-02-11T13:54:08-0600  verbose: Found 4 processors
2021-02-11T13:54:08-0600  verbose: Loading persistent classes
2021-02-11T13:54:08-0600  verbose: This agent is bootstrapped to: 192.168.33.2
2021-02-11T13:54:08-0600  verbose: Loading JSON augments from '/home/nickanderson/org/def.json' (input dir '/home/nickanderson/org', input file '/home/nickanderson/org/cfengine3-bLXL6w'
2021-02-11T13:54:08-0600  verbose: could not load JSON augments from '/home/nickanderson/org/def.json'
2021-02-11T13:54:08-0600  verbose: Input file is outside default repository, validating it
2021-02-11T13:54:08-0600  verbose: Input file '/home/nickanderson/org/cfengine3-bLXL6w' has changed since the last policy read attempt (file is newer than previous)
2021-02-11T13:54:08-0600  verbose: Input file is changed since last validation, validating it
2021-02-11T13:54:08-0600  verbose: Verifying the syntax of the inputs...
2021-02-11T13:54:08-0600  verbose: Checking policy with command '"/home/nickanderson/.cfagent/bin/cf-promises" -c "/home/nickanderson/org/cfengine3-bLXL6w"'
2021-02-11T13:54:08-0600  verbose: Saved policy validated marker file '/home/nickanderson/.cfagent/state/cf_promises_validated'
2021-02-11T13:54:08-0600  verbose: ----------------------------------------------------------------
2021-02-11T13:54:08-0600  verbose:  Loading policy 
2021-02-11T13:54:08-0600  verbose: ----------------------------------------------------------------
2021-02-11T13:54:08-0600  verbose: BEGIN parsing file: /home/nickanderson/org/cfengine3-bLXL6w
2021-02-11T13:54:08-0600  verbose: END   parsing file: /home/nickanderson/org/cfengine3-bLXL6w
2021-02-11T13:54:08-0600  verbose: Running full policy integrity checks
2021-02-11T13:54:08-0600  verbose: ----------------------------------------------------------------
2021-02-11T13:54:08-0600  verbose: PREFIX LEGEND:
2021-02-11T13:54:08-0600  verbose:  V: variable or parameter new definition in scope
2021-02-11T13:54:08-0600  verbose:  C: class/context new definition 
2021-02-11T13:54:08-0600  verbose:  B: bundle start/end execution marker
2021-02-11T13:54:08-0600  verbose:  P: promise execution output 
2021-02-11T13:54:08-0600  verbose:  A: accounting output 
2021-02-11T13:54:08-0600  verbose:  T: time measurement for stated object (promise or bundle)
2021-02-11T13:54:08-0600  verbose: ----------------------------------------------------------------
2021-02-11T13:54:08-0600  verbose: ----------------------------------------------------------------
2021-02-11T13:54:08-0600  verbose: BEGIN Discovered hard classes:
2021-02-11T13:54:08-0600  verbose: C: discovered hard class 127_0_0_1
2021-02-11T13:54:08-0600  verbose: C: discovered hard class 172_17_0_1
2021-02-11T13:54:08-0600  verbose: C: discovered hard class 172_27_224_184
2021-02-11T13:54:08-0600  verbose: C: discovered hard class 192_168_122_1
2021-02-11T13:54:08-0600  verbose: C: discovered hard class 192_168_33_1
2021-02-11T13:54:08-0600  verbose: C: discovered hard class 192_168_42_160
2021-02-11T13:54:08-0600  verbose: C: discovered hard class 4_cpus
2021-02-11T13:54:08-0600  verbose: C: discovered hard class 64_bit
2021-02-11T13:54:08-0600  verbose: C: discovered hard class Afternoon
2021-02-11T13:54:08-0600  verbose: C: discovered hard class Day11
2021-02-11T13:54:08-0600  verbose: C: discovered hard class February
2021-02-11T13:54:08-0600  verbose: C: discovered hard class GMT_Day11
2021-02-11T13:54:08-0600  verbose: C: discovered hard class GMT_Evening
2021-02-11T13:54:08-0600  verbose: C: discovered hard class GMT_February
2021-02-11T13:54:08-0600  verbose: C: discovered hard class GMT_Hr19
2021-02-11T13:54:08-0600  verbose: C: discovered hard class GMT_Hr19_Q4
2021-02-11T13:54:08-0600  verbose: C: discovered hard class GMT_Lcycle_2
2021-02-11T13:54:08-0600  verbose: C: discovered hard class GMT_Min50_55
2021-02-11T13:54:08-0600  verbose: C: discovered hard class GMT_Min54
2021-02-11T13:54:08-0600  verbose: C: discovered hard class GMT_Q4
2021-02-11T13:54:08-0600  verbose: C: discovered hard class GMT_Thursday
2021-02-11T13:54:08-0600  verbose: C: discovered hard class GMT_Yr2021
2021-02-11T13:54:08-0600  verbose: C: discovered hard class Hr13
2021-02-11T13:54:08-0600  verbose: C: discovered hard class Hr13_Q4
2021-02-11T13:54:08-0600  verbose: C: discovered hard class Lcycle_2
2021-02-11T13:54:08-0600  verbose: C: discovered hard class Min50_55
2021-02-11T13:54:08-0600  verbose: C: discovered hard class Min54
2021-02-11T13:54:08-0600  verbose: C: discovered hard class PK_SHA_43c979e264924d0b4a2d3b568d71ab8c768ef63487670f2c51cd85e8cec63834
2021-02-11T13:54:08-0600  verbose: C: discovered hard class Q4
2021-02-11T13:54:08-0600  verbose: C: discovered hard class Thursday
2021-02-11T13:54:08-0600  verbose: C: discovered hard class Yr2021
2021-02-11T13:54:08-0600  verbose: C: discovered hard class agent
2021-02-11T13:54:08-0600  verbose: C: discovered hard class any
2021-02-11T13:54:08-0600  verbose: C: discovered hard class cfengine
2021-02-11T13:54:08-0600  verbose: C: discovered hard class cfengine_3
2021-02-11T13:54:08-0600  verbose: C: discovered hard class cfengine_3_17
2021-02-11T13:54:08-0600  verbose: C: discovered hard class cfengine_3_17_0
2021-02-11T13:54:08-0600  verbose: C: discovered hard class compiled_on_linux_gnu
2021-02-11T13:54:08-0600  verbose: C: discovered hard class debian
2021-02-11T13:54:08-0600  verbose: C: discovered hard class debian_bullseye
2021-02-11T13:54:08-0600  verbose: C: discovered hard class enterprise
2021-02-11T13:54:08-0600  verbose: C: discovered hard class enterprise_3
2021-02-11T13:54:08-0600  verbose: C: discovered hard class enterprise_3_17
2021-02-11T13:54:08-0600  verbose: C: discovered hard class enterprise_3_17_0
2021-02-11T13:54:08-0600  verbose: C: discovered hard class enterprise_edition
2021-02-11T13:54:08-0600  verbose: C: discovered hard class fe80__1852_f8a8_1c10_1c24
2021-02-11T13:54:08-0600  verbose: C: discovered hard class fe80__6921_c957_423a_5f3d
2021-02-11T13:54:08-0600  verbose: C: discovered hard class fe80__800_27ff_fe00_0
2021-02-11T13:54:08-0600  verbose: C: discovered hard class fe80__800_27ff_fe00_3
2021-02-11T13:54:08-0600  verbose: C: discovered hard class feature
2021-02-11T13:54:08-0600  verbose: C: discovered hard class feature_curl
2021-02-11T13:54:08-0600  verbose: C: discovered hard class feature_def
2021-02-11T13:54:08-0600  verbose: C: discovered hard class feature_def_json
2021-02-11T13:54:08-0600  verbose: C: discovered hard class feature_def_json_preparse
2021-02-11T13:54:08-0600  verbose: C: discovered hard class feature_tls
2021-02-11T13:54:08-0600  verbose: C: discovered hard class feature_tls_1
2021-02-11T13:54:08-0600  verbose: C: discovered hard class feature_tls_1_0
2021-02-11T13:54:08-0600  verbose: C: discovered hard class feature_tls_1_1
2021-02-11T13:54:08-0600  verbose: C: discovered hard class feature_tls_1_2
2021-02-11T13:54:08-0600  verbose: C: discovered hard class feature_tls_1_3
2021-02-11T13:54:08-0600  verbose: C: discovered hard class feature_xml
2021-02-11T13:54:08-0600  verbose: C: discovered hard class feature_yaml
2021-02-11T13:54:08-0600  verbose: C: discovered hard class inform_mode
2021-02-11T13:54:08-0600  verbose: C: discovered hard class ipv4_127
2021-02-11T13:54:08-0600  verbose: C: discovered hard class ipv4_127_0
2021-02-11T13:54:08-0600  verbose: C: discovered hard class ipv4_127_0_0
2021-02-11T13:54:08-0600  verbose: C: discovered hard class ipv4_127_0_0_1
2021-02-11T13:54:08-0600  verbose: C: discovered hard class ipv4_172
2021-02-11T13:54:08-0600  verbose: C: discovered hard class ipv4_172_17
2021-02-11T13:54:08-0600  verbose: C: discovered hard class ipv4_172_17_0
2021-02-11T13:54:08-0600  verbose: C: discovered hard class ipv4_172_17_0_1
2021-02-11T13:54:08-0600  verbose: C: discovered hard class ipv4_172_27
2021-02-11T13:54:08-0600  verbose: C: discovered hard class ipv4_172_27_224
2021-02-11T13:54:08-0600  verbose: C: discovered hard class ipv4_172_27_224_184
2021-02-11T13:54:08-0600  verbose: C: discovered hard class ipv4_192
2021-02-11T13:54:08-0600  verbose: C: discovered hard class ipv4_192_168
2021-02-11T13:54:08-0600  verbose: C: discovered hard class ipv4_192_168_122
2021-02-11T13:54:08-0600  verbose: C: discovered hard class ipv4_192_168_122_1
2021-02-11T13:54:08-0600  verbose: C: discovered hard class ipv4_192_168_33
2021-02-11T13:54:08-0600  verbose: C: discovered hard class ipv4_192_168_33_1
2021-02-11T13:54:08-0600  verbose: C: discovered hard class ipv4_192_168_42
2021-02-11T13:54:08-0600  verbose: C: discovered hard class ipv4_192_168_42_160
2021-02-11T13:54:08-0600  verbose: C: discovered hard class ipv4_gw_172_27_224_129
2021-02-11T13:54:08-0600  verbose: C: discovered hard class ipv4_gw_192_168_42_1
2021-02-11T13:54:08-0600  verbose: C: discovered hard class ipv6_fe80__1852_f8a8_1c10_1c24
2021-02-11T13:54:08-0600  verbose: C: discovered hard class ipv6_fe80__6921_c957_423a_5f3d
2021-02-11T13:54:08-0600  verbose: C: discovered hard class ipv6_fe80__800_27ff_fe00_0
2021-02-11T13:54:08-0600  verbose: C: discovered hard class ipv6_fe80__800_27ff_fe00_3
2021-02-11T13:54:08-0600  verbose: C: discovered hard class linux
2021-02-11T13:54:08-0600  verbose: C: discovered hard class linux_5_4_0_65_lowlatency
2021-02-11T13:54:08-0600  verbose: C: discovered hard class linux_x86_64
2021-02-11T13:54:08-0600  verbose: C: discovered hard class linux_x86_64_5_4_0_65_lowlatency
2021-02-11T13:54:08-0600  verbose: C: discovered hard class linux_x86_64_5_4_0_65_lowlatency__73_Ubuntu_SMP_PREEMPT_Mon_Jan_18_18_17_38_UTC_2021
2021-02-11T13:54:08-0600  verbose: C: discovered hard class mac_00_00_00_00_00_00
2021-02-11T13:54:08-0600  verbose: C: discovered hard class mac_02_42_e0_5a_c6_d4
2021-02-11T13:54:08-0600  verbose: C: discovered hard class mac_0a_00_27_00_00_00
2021-02-11T13:54:08-0600  verbose: C: discovered hard class mac_0a_00_27_00_00_03
2021-02-11T13:54:08-0600  verbose: C: discovered hard class mac_52_54_00_6b_62_06
2021-02-11T13:54:08-0600  verbose: C: discovered hard class mac_54_ee_75_5a_45_41
2021-02-11T13:54:08-0600  verbose: C: discovered hard class net_iface_docker0
2021-02-11T13:54:08-0600  verbose: C: discovered hard class net_iface_eth0
2021-02-11T13:54:08-0600  verbose: C: discovered hard class net_iface_lo
2021-02-11T13:54:08-0600  verbose: C: discovered hard class net_iface_tun0
2021-02-11T13:54:08-0600  verbose: C: discovered hard class net_iface_vboxnet0
2021-02-11T13:54:08-0600  verbose: C: discovered hard class net_iface_vboxnet3
2021-02-11T13:54:08-0600  verbose: C: discovered hard class net_iface_virbr0
2021-02-11T13:54:08-0600  verbose: C: discovered hard class nickanderson_thinkpad_w550s
2021-02-11T13:54:08-0600  verbose: C: discovered hard class nova
2021-02-11T13:54:08-0600  verbose: C: discovered hard class nova_3
2021-02-11T13:54:08-0600  verbose: C: discovered hard class nova_3_17
2021-02-11T13:54:08-0600  verbose: C: discovered hard class nova_3_17_0
2021-02-11T13:54:08-0600  verbose: C: discovered hard class nova_edition
2021-02-11T13:54:08-0600  verbose: C: discovered hard class systemd
2021-02-11T13:54:08-0600  verbose: C: discovered hard class ubuntu
2021-02-11T13:54:08-0600  verbose: C: discovered hard class ubuntu_20
2021-02-11T13:54:08-0600  verbose: C: discovered hard class ubuntu_20_04
2021-02-11T13:54:08-0600  verbose: C: discovered hard class verbose_mode
2021-02-11T13:54:08-0600  verbose: C: discovered hard class x86_64
2021-02-11T13:54:08-0600  verbose: END Discovered hard classes
2021-02-11T13:54:08-0600  verbose: ----------------------------------------------------------------
2021-02-11T13:54:08-0600  verbose: ----------------------------------------------------------------
2021-02-11T13:54:08-0600  verbose:  Preliminary variable/class-context convergence 
2021-02-11T13:54:08-0600  verbose: ----------------------------------------------------------------
2021-02-11T13:54:08-0600  verbose: Setting minimum acceptable TLS version: 1.1
2021-02-11T13:54:08-0600  verbose: Using the OpenSSL's default cipher list
2021-02-11T13:54:08-0600  verbose: ----------------------------------------------------------------
2021-02-11T13:54:08-0600  verbose:  Begin policy/promise evaluation 
2021-02-11T13:54:08-0600  verbose: ----------------------------------------------------------------
2021-02-11T13:54:08-0600  verbose: Using bundlesequence =>  {"main"}
2021-02-11T13:54:08-0600  verbose: B: *****************************************************************
2021-02-11T13:54:08-0600  verbose: B: BEGIN bundle main
2021-02-11T13:54:08-0600  verbose: B: *****************************************************************
2021-02-11T13:54:08-0600  verbose: T: Starting measuring time
2021-02-11T13:54:08-0600  verbose: T: Starting measuring time
2021-02-11T13:54:08-0600  verbose: P: .........................................................
2021-02-11T13:54:08-0600  verbose: P: BEGIN promise 'promise_cfengine3_bLXL6w_4' of type "commands" (pass 1)
2021-02-11T13:54:08-0600  verbose: P:    Promiser/affected object: '/bin/sleep 10'
2021-02-11T13:54:08-0600  verbose: P:    Part of bundle: main
2021-02-11T13:54:08-0600  verbose: P:    Base context class: any
2021-02-11T13:54:08-0600  verbose: P:    Stack path: /default/main/commands/'/bin/sleep 10'[1]
2021-02-11T13:54:08-0600  verbose: Promiser string contains a valid executable '/bin/sleep' - ok
2021-02-11T13:54:08-0600     info: Executing 'no timeout' ... '/bin/sleep 10'
2021-02-11T13:54:08-0600  verbose: T: Starting measuring time
2021-02-11T13:54:08-0600  verbose: Backgrounding job '/bin/sleep 10'
2021-02-11T13:54:08-0600     info: Completed execution of '/bin/sleep 10'
2021-02-11T13:54:08-0600  verbose: 
2021-02-11T13:54:08-0600  verbose: T: .........................................................
2021-02-11T13:54:08-0600  verbose: T: Promise timing summary for /bin/sleep 10
2021-02-11T13:54:08-0600  verbose: T: No measurement_class attribute set in action body
2021-02-11T13:54:08-0600  verbose: T: This execution measured 0.001265 seconds (use measurement_class to track)
2021-02-11T13:54:08-0600  verbose: T: .........................................................
2021-02-11T13:54:08-0600  verbose: A: Promise was KEPT
2021-02-11T13:54:08-0600  verbose: P: END commands promise (/bin/sleep 10)
2021-02-11T13:54:08-0600  verbose: T: Starting measuring time
2021-02-11T13:54:08-0600  verbose: P: .........................................................
2021-02-11T13:54:08-0600  verbose: P: BEGIN promise 'promise_cfengine3_bLXL6w_5' of type "commands" (pass 1)
2021-02-11T13:54:08-0600  verbose: P:    Promiser/affected object: '/bin/echo `I won't wait for the sleep to'
2021-02-11T13:54:08-0600  verbose: P:    Part of bundle: main
2021-02-11T13:54:08-0600  verbose: P:    Base context class: any
2021-02-11T13:54:08-0600  verbose: P:    Stack path: /default/main/commands/'/bin/echo `I won't wait for the sleep to finish`'[1]
2021-02-11T13:54:08-0600  verbose: Promiser string contains a valid executable '/bin/echo' - ok
2021-02-11T13:54:08-0600     info: Executing 'no timeout' ... '/bin/echo `I won't wait for the sleep to finish`'
2021-02-11T13:54:08-0600  verbose: T: Starting measuring time
2021-02-11T13:54:08-0600  verbose: Setting umask to 77
2021-02-11T13:54:08-0600  verbose: Additional promise info: source path '/home/nickanderson/org/cfengine3-bLXL6w' at line 5
2021-02-11T13:54:08-0600  verbose: Finished command related to promiser '/bin/echo `I won't wait for the sleep to finish`' -- succeeded
2021-02-11T13:54:08-0600   notice: Q: ".../bin/echo `I wo": I won't wait for the sleep to finish
2021-02-11T13:54:08-0600     info: Last 1 quoted lines were generated by promiser '/bin/echo `I won't wait for the sleep to finish`'
2021-02-11T13:54:08-0600     info: Completed execution of '/bin/echo `I won't wait for the sleep to finish`'
2021-02-11T13:54:08-0600  verbose: 
2021-02-11T13:54:08-0600  verbose: T: .........................................................
2021-02-11T13:54:08-0600  verbose: T: Promise timing summary for /bin/echo `I won't wait for the sleep to finish`
2021-02-11T13:54:08-0600  verbose: T: No measurement_class attribute set in action body
2021-02-11T13:54:08-0600  verbose: T: This execution measured 0.002656 seconds (use measurement_class to track)
2021-02-11T13:54:08-0600  verbose: T: .........................................................
2021-02-11T13:54:08-0600  verbose: A: Promise REPAIRED
2021-02-11T13:54:08-0600  verbose: P: END commands promise (/bin/echo `I won't wait for th...)
2021-02-11T13:54:08-0600  verbose: T: Starting measuring time
2021-02-11T13:54:08-0600  verbose: T: Starting measuring time
2021-02-11T13:54:08-0600  verbose: T: Starting measuring time
2021-02-11T13:54:08-0600  verbose: T: Starting measuring time
2021-02-11T13:54:08-0600  verbose: A: ...................................................
2021-02-11T13:54:08-0600  verbose: A: Bundle Accounting Summary for 'main' in namespace default
2021-02-11T13:54:08-0600  verbose: A: Promises kept in 'main' = 0
2021-02-11T13:54:08-0600  verbose: A: Promises not kept in 'main' = 0
2021-02-11T13:54:08-0600  verbose: A: Promises repaired in 'main' = 1
2021-02-11T13:54:08-0600  verbose: A: Aggregate compliance (promises kept/repaired) for bundle 'main' = 100.0%
2021-02-11T13:54:08-0600  verbose: T: This measurement event, alias 'default:main', measured at time Thu Feb 11 13:54:08 2021
2021-02-11T13:54:08-0600  verbose: T:   Last measured 69.000000 seconds ago
2021-02-11T13:54:08-0600  verbose: T:   This execution measured 0.006621 seconds
2021-02-11T13:54:08-0600  verbose: T:   Average execution time 0.015720 +/- 0.276291 seconds
2021-02-11T13:54:08-0600  verbose: Setting umask to 77
2021-02-11T13:54:08-0600  verbose: A: ...................................................
2021-02-11T13:54:08-0600  verbose: B: *****************************************************************
2021-02-11T13:54:08-0600  verbose: B: END bundle main
2021-02-11T13:54:08-0600  verbose: B: *****************************************************************
2021-02-11T13:54:08-0600  verbose: Waiting for background processes
2021-02-11T13:54:18-0600  verbose: Additional promise info: source path '/home/nickanderson/org/cfengine3-bLXL6w' at line 4
2021-02-11T13:54:18-0600  verbose: Finished command related to promiser '/bin/sleep 10' -- succeeded
2021-02-11T13:54:18-0600     info: Completed execution of '/bin/sleep 10'
2021-02-11T13:54:18-0600  verbose: Backgrounded command '/bin/sleep 10' is done - exiting
2021-02-11T13:54:18-0600  verbose: Background process 3230547 terminated
2021-02-11T13:54:18-0600  verbose: No more background processes to wait for
2021-02-11T13:54:18-0600  verbose: Generate diff state reports for policy '/home/nickanderson/org/cfengine3-bLXL6w' SKIPPED
2021-02-11T13:54:18-0600  verbose: No lock purging scheduled
2021-02-11T13:54:19-0600  verbose: Outcome of version (not specified) (agent-0): Promises observed - Total promise compliance: 0% kept, 100% repaired, 0% not kept (out of 1 events). User promise compliance: 0% kept, 100% repaired, 0% not kept (out of 1 events). CFEngine system compliance: 0% kept, 0% repaired, 0% not kept (out of 0 events).
2021-02-11T13:54:19-0600  verbose: T: This measurement event, alias 'CFEngine Execution (policy filename: '/home/nickanderson/org/cfengine3-bLXL6w')', measured at time Thu Feb 11 13:54:08 2021
2021-02-11T13:54:19-0600  verbose: T:   Last measured 0.000000 seconds ago
2021-02-11T13:54:19-0600  verbose: T:   This execution measured 10.107312 seconds
2021-02-11T13:54:19-0600  verbose: T:   Average execution time 10.107312 +/- 0.031623 seconds

Those backgrounded promises should still hold the lock, so concurrent runs of cf-agent should skip running the same command for that where the lock is held.

0 replies

nickanderson · 2021-02-11T20:11:14Z

nickanderson
Feb 11, 2021
Maintainer

Alternatively, you can detach the commands from the agent run, but if you do this cf-agent won't be tracking anything at all about the result of the commands.
For that, there is a daemonize bundle in the stdlib you may find helpful.

exec 2>&1
cf-locate daemonize | head 1
cf-locate -f -p daemonize
:


bundle agent daemonize(command)
# @brief Run a command as a daemon. I.e., fully detaches from Cfengine.
# @param command The command to run detached
# Note: There will be no output from the command reported by cf-agent. This
# bundle has no effect on windows
#
# **Example:**
# ```cf3
# methods:
#   "Launch Daemon"
#     usebundle => daemonize("/bin/sleep 30");
# ```
{
  commands:
    !windows::
      "exec 1>&-; exec 2>&-; $(command) &"
        contain => in_shell;

  reports:
    "windows.(DEBUG|DEBUG_$(this.bundle))"::
      "DEBUG $(this.bundle): This bundle does not support Windows";
}

1 reply

olehermanse Feb 12, 2021
Maintainer Author

This seems to be what I'm looking for, thanks!

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

How to spawn slow / background commands from cf-agent? #4504

{{title}}

Replies: 2 comments 1 reply

{{title}}

{{title}}

{{title}}

Select a reply

How to spawn slow / background commands from cf-agent? #4504

olehermanse Feb 11, 2021 Maintainer

Replies: 2 comments · 1 reply

nickanderson Feb 11, 2021 Maintainer

nickanderson Feb 11, 2021 Maintainer

olehermanse Feb 12, 2021 Maintainer Author

olehermanse
Feb 11, 2021
Maintainer

Replies: 2 comments 1 reply

nickanderson
Feb 11, 2021
Maintainer

nickanderson
Feb 11, 2021
Maintainer

olehermanse Feb 12, 2021
Maintainer Author