* 03:09:19 -- Checking if build provides SFA package...
-> 03:09:19 -- + curl --silent http://build.onelab.eu/lxc//2025.05.06--f41-nofed/RPMS/x86_64/
+ grep -q sfa-4
* 03:09:19 -- SFA package not found - removing steps with sfa or sfi
Sensing local substrate... xp qn Done
=============== Active plc VMs on buzzcocks {lxc-f41 257822.88671875 Mb} [max=20,free=19] (3 users, load: 0.97, 0.61, 0.26)
== vplc01 == [=2025.05.05--f41-nofed-1-vplc01] (pid=24746) @ 2025-05-05:03-10
=============== No qemu on boxtops {qemu-f41 257822.8828125 Mb} [max=64,free=64] (2 users, load: 0.04, 0.03, 0.00) kvm_intel OK
Sensing IP pool for vplcs * . . . . . . . . . . . . . . . . . . . . . . . . Done
After having loaded 'starting': IP pool
for vplcs * . . . . . S . . . . . . . . . . . . . . . . . .
* 03:09:47 -- PROVISION plc plctest1 in box buzzcocks at IP vplc02.pl.sophia.inria.fr as 2025.05.06--f41-nofed-1-vplc02
Sensing IP pool for vnodes . . . . . . . . . . . . . . . . . . . . Done
After having loaded 'starting': IP pool
for vnodes . S . . . . . . . . . . . . . . . . . .
* 03:10:07 -- PROVISION node node1 in box boxtops at IP vnode01 with MAC 02:34:56:00:00:01
=============== Active plc VMs on buzzcocks {lxc-f41 257822.88671875 Mb} [max=20,free=17] (3 users, load: 0.97, 0.61, 0.26)
== vplc01 == [=2025.05.05--f41-nofed-1-vplc01] (pid=24746) @ 2025-05-05:03-10
== dummy_vplc07.pl.sophia.inria.fr == [=dummy_vplc07.pl.sophia.inria.fr] (pid=0) @ 2025-05-06:03-09
== dummy_plctest1 == [=dummy_plctest1] (pid=0) @ 2025-05-06:03-09
=============== Qemus on boxtops {qemu-f41 257822.8828125 Mb} [max=64,free=62] (2 users, load: 0.04, 0.03, 0.00) kvm_intel OK
== dummy_vnode02 == [=None] not (yet?) running @ 2025-05-06:03-10
== dummy_vnode01 == [=None] not (yet?) running @ 2025-05-06:03-10
* 03:10:07 -- ********** 1 RUNNING step show on plc plctest1_vplc02
+ ======== site main site for plc number 1
+        nodes :  vnode01.pl.sophia.inria.fr  
+           node=node1 host_box=boxtops hostname= vnode01.pl.sophia.inria.fr ip= 138.96.112.101
* 03:10:07 -- ********** 1 SUCCESSFUL step show on plctest1_vplc02
TRACE: 1 03-10-07->0s=0:00:00.000397s status=OK step=show plc=plctest1_vplc02 force=False

* 03:10:07 -- ********** 1 RUNNING step plcvm_delete on plc plctest1_vplc02
-> 03:10:07 -- + ssh -n -o BatchMode=yes -o StrictHostKeyChecking=no -o CheckHostIP=no -o ConnectTimeout=5 -o UserKnownHostsFile=/dev/null buzzcocks mkdir -p 2025.05.06--f41-nofed
Warning: Permanently added 'buzzcocks' (ED25519) to the list of known hosts.
-> 03:10:08 -- + ssh -n -o BatchMode=yes -o StrictHostKeyChecking=no -o CheckHostIP=no -o ConnectTimeout=5 -o UserKnownHostsFile=/dev/null buzzcocks cd 2025.05.06--f41-nofed ';' rm -f /vservers/2025.05.06--f41-nofed-1-vplc02/2025.05.06--f41-nofed-1-vplc02.timestamp
Warning: Permanently added 'buzzcocks' (ED25519) to the list of known hosts.
-> 03:10:08 -- + ssh -n -o BatchMode=yes -o StrictHostKeyChecking=no -o CheckHostIP=no -o ConnectTimeout=5 -o UserKnownHostsFile=/dev/null buzzcocks cd 2025.05.06--f41-nofed ';' virsh -c lxc:/// destroy 2025.05.06--f41-nofed-1-vplc02
Warning: Permanently added 'buzzcocks' (ED25519) to the list of known hosts.

error: failed to get domain '2025.05.06--f41-nofed-1-vplc02'
-> 03:10:08 -- + ssh -n -o BatchMode=yes -o StrictHostKeyChecking=no -o CheckHostIP=no -o ConnectTimeout=5 -o UserKnownHostsFile=/dev/null buzzcocks cd 2025.05.06--f41-nofed ';' virsh -c lxc:/// undefine 2025.05.06--f41-nofed-1-vplc02
Warning: Permanently added 'buzzcocks' (ED25519) to the list of known hosts.

error: failed to get domain '2025.05.06--f41-nofed-1-vplc02'
-> 03:10:09 -- + ssh -n -o BatchMode=yes -o StrictHostKeyChecking=no -o CheckHostIP=no -o ConnectTimeout=5 -o UserKnownHostsFile=/dev/null buzzcocks cd 2025.05.06--f41-nofed ';' rm -fr /vservers/2025.05.06--f41-nofed-1-vplc02
Warning: Permanently added 'buzzcocks' (ED25519) to the list of known hosts.
* 03:10:09 -- ********** 1 SUCCESSFUL step plcvm_delete on plctest1_vplc02
TRACE: 1 03-10-07->1s=0:00:01.838385s status=OK step=plcvm_delete plc=plctest1_vplc02 force=False

* 03:10:09 -- ********** 1 RUNNING step plcvm_timestamp on plc plctest1_vplc02
-> 03:10:09 -- + ssh -n -o BatchMode=yes -o StrictHostKeyChecking=no -o CheckHostIP=no -o ConnectTimeout=5 -o UserKnownHostsFile=/dev/null buzzcocks mkdir -p /vservers/2025.05.06--f41-nofed-1-vplc02
Warning: Permanently added 'buzzcocks' (ED25519) to the list of known hosts.
-> 03:10:10 -- + ssh -n -o BatchMode=yes -o StrictHostKeyChecking=no -o CheckHostIP=no -o ConnectTimeout=5 -o UserKnownHostsFile=/dev/null buzzcocks echo 1746493809 '>' /vservers/2025.05.06--f41-nofed-1-vplc02/2025.05.06--f41-nofed-1-vplc02.timestamp
Warning: Permanently added 'buzzcocks' (ED25519) to the list of known hosts.
* 03:10:10 -- ********** 1 SUCCESSFUL step plcvm_timestamp on plctest1_vplc02
TRACE: 1 03-10-09->0s=0:00:00.732413s status=OK step=plcvm_timestamp plc=plctest1_vplc02 force=False

* 03:10:10 -- ********** 1 RUNNING step plcvm_create on plc plctest1_vplc02
-> 03:10:10 -- + ssh -n -o BatchMode=yes -o StrictHostKeyChecking=no -o CheckHostIP=no -o ConnectTimeout=5 -o UserKnownHostsFile=/dev/null buzzcocks rm -rf 2025.05.06--f41-nofed/build
Warning: Permanently added 'buzzcocks' (ED25519) to the list of known hosts.
-> 03:10:10 -- + scp -o BatchMode=yes -o StrictHostKeyChecking=no -o CheckHostIP=no -o ConnectTimeout=5 -r build buzzcocks:2025.05.06--f41-nofed/build
Cannot reverse lookup 138.96.112.72
This is considered fatal, as this might pollute the test results
* 03:10:13 -- ********** 1 FAILED step plcvm_create on plctest1_vplc02 (discarded from further steps)
TRACE: 1 03-10-10->3s=0:00:03.458990s status=KO step=plcvm_create plc=plctest1_vplc02 force=False

* 03:10:13 -- ********** 1 SKIPPED Step django_install on plctest1_vplc02 (has failed plcvm_create)
TRACE: 1 03-10-13->0s=0:00:00.000117s status=UNDEF step=django_install plc=plctest1_vplc02 force=False

* 03:10:13 -- ********** 1 SKIPPED Step plc_install on plctest1_vplc02 (has failed plcvm_create)
TRACE: 1 03-10-13->0s=0:00:00.000086s status=UNDEF step=plc_install plc=plctest1_vplc02 force=False

* 03:10:13 -- ********** 1 SKIPPED Step plc_configure on plctest1_vplc02 (has failed plcvm_create)
TRACE: 1 03-10-13->0s=0:00:00.000152s status=UNDEF step=plc_configure plc=plctest1_vplc02 force=False

* 03:10:13 -- ********** 1 SKIPPED Step plc_start on plctest1_vplc02 (has failed plcvm_create)
TRACE: 1 03-10-13->0s=0:00:00.000153s status=UNDEF step=plc_start plc=plctest1_vplc02 force=False

* 03:10:13 -- ********** 1 SKIPPED Step keys_fetch on plctest1_vplc02 (has failed plcvm_create)
TRACE: 1 03-10-13->0s=0:00:00.000083s status=UNDEF step=keys_fetch plc=plctest1_vplc02 force=False

* 03:10:13 -- ********** 1 SKIPPED Step keys_store on plctest1_vplc02 (has failed plcvm_create)
TRACE: 1 03-10-13->0s=0:00:00.000076s status=UNDEF step=keys_store plc=plctest1_vplc02 force=False

* 03:10:13 -- ********** 1 SKIPPED Step keys_clear_known_hosts on plctest1_vplc02 (has failed plcvm_create)
TRACE: 1 03-10-13->0s=0:00:00.000074s status=UNDEF step=keys_clear_known_hosts plc=plctest1_vplc02 force=False

* 03:10:13 -- ********** 1 SKIPPED Step plcapi_urls on plctest1_vplc02 (has failed plcvm_create)
TRACE: 1 03-10-13->0s=0:00:00.000075s status=UNDEF step=plcapi_urls plc=plctest1_vplc02 force=False

* 03:10:13 -- ********** 1 SKIPPED Step speed_up_slices on plctest1_vplc02 (has failed plcvm_create)
TRACE: 1 03-10-13->0s=0:00:00.000074s status=UNDEF step=speed_up_slices plc=plctest1_vplc02 force=False

* 03:10:13 -- ********** 1 SKIPPED Step initscripts on plctest1_vplc02 (has failed plcvm_create)
TRACE: 1 03-10-13->0s=0:00:00.000078s status=UNDEF step=initscripts plc=plctest1_vplc02 force=False

* 03:10:13 -- ********** 1 SKIPPED Step sites on plctest1_vplc02 (has failed plcvm_create)
TRACE: 1 03-10-13->0s=0:00:00.000074s status=UNDEF step=sites plc=plctest1_vplc02 force=False

* 03:10:13 -- ********** 1 SKIPPED Step nodes on plctest1_vplc02 (has failed plcvm_create)
TRACE: 1 03-10-13->0s=0:00:00.000073s status=UNDEF step=nodes plc=plctest1_vplc02 force=False

* 03:10:13 -- ********** 1 SKIPPED Step slices on plctest1_vplc02 (has failed plcvm_create)
TRACE: 1 03-10-13->0s=0:00:00.000100s status=UNDEF step=slices plc=plctest1_vplc02 force=False

* 03:10:13 -- ********** 1 SKIPPED Step nodegroups on plctest1_vplc02 (has failed plcvm_create)
TRACE: 1 03-10-13->0s=0:00:00.000153s status=UNDEF step=nodegroups plc=plctest1_vplc02 force=False

* 03:10:13 -- ********** 1 SKIPPED Step leases on plctest1_vplc02 (has failed plcvm_create)
TRACE: 1 03-10-13->0s=0:00:00.000153s status=UNDEF step=leases plc=plctest1_vplc02 force=False

* 03:10:13 -- ********** 1 RUNNING step gather_logs (forced after plcvm_create has failed) on plc plctest1_vplc02
-------------------- TestPlc.gather_logs : PLC's /var/log
-> 03:10:13 -- + mkdir -p logs/myplc.var-log.plctest1_vplc02.2025.05.06--f41-nofed-1-vplc02
-> 03:10:13 -- + ssh -n -o BatchMode=yes -o StrictHostKeyChecking=no -o CheckHostIP=no -o ConnectTimeout=5 -o UserKnownHostsFile=/dev/null buzzcocks ssh -o BatchMode=yes -o StrictHostKeyChecking=no -o CheckHostIP=no -o ConnectTimeout=5 -o UserKnownHostsFile=/dev/null vplc02 tar -C /var/log/ -cf - .
+ tar -C logs/myplc.var-log.plctest1_vplc02.2025.05.06--f41-nofed-1-vplc02 -xf -
Warning: Permanently added 'buzzcocks' (ED25519) to the list of known hosts.
ssh: connect to host vplc02 port 22: No route to host
tar: This does not look like a tar archive
tar: Exiting with failure status due to previous errors
-> 03:10:17 -- + chmod a+r,a+x logs/myplc.var-log.plctest1_vplc02.2025.05.06--f41-nofed-1-vplc02/httpd
chmod: cannot access 'logs/myplc.var-log.plctest1_vplc02.2025.05.06--f41-nofed-1-vplc02/httpd': No such file or directory
-------------------- TestPlc.gather_logs : PLC's /var/lib/psql/data/pg_log/
-> 03:10:17 -- + mkdir -p logs/myplc.pgsql-log.plctest1_vplc02.2025.05.06--f41-nofed-1-vplc02
-> 03:10:17 -- + ssh -n -o BatchMode=yes -o StrictHostKeyChecking=no -o CheckHostIP=no -o ConnectTimeout=5 -o UserKnownHostsFile=/dev/null buzzcocks ssh -o BatchMode=yes -o StrictHostKeyChecking=no -o CheckHostIP=no -o ConnectTimeout=5 -o UserKnownHostsFile=/dev/null vplc02 tar -C /var/lib/pgsql/data/pg_log/ -cf - .
+ tar -C logs/myplc.pgsql-log.plctest1_vplc02.2025.05.06--f41-nofed-1-vplc02 -xf -
Warning: Permanently added 'buzzcocks' (ED25519) to the list of known hosts.
ssh: connect to host vplc02 port 22: No route to host
tar: This does not look like a tar archive
tar: Exiting with failure status due to previous errors
-------------------- TestPlc.gather_logs : PLC's /root/sfi/
-> 03:10:20 -- + mkdir -p logs/sfi.plctest1_vplc02.2025.05.06--f41-nofed-1-vplc02
-> 03:10:20 -- + ssh -n -o BatchMode=yes -o StrictHostKeyChecking=no -o CheckHostIP=no -o ConnectTimeout=5 -o UserKnownHostsFile=/dev/null buzzcocks ssh -o BatchMode=yes -o StrictHostKeyChecking=no -o CheckHostIP=no -o ConnectTimeout=5 -o UserKnownHostsFile=/dev/null vplc02 tar -C /root/sfi/ -cf - .
+ tar -C logs/sfi.plctest1_vplc02.2025.05.06--f41-nofed-1-vplc02 -xf -
Warning: Permanently added 'buzzcocks' (ED25519) to the list of known hosts.
ssh: connect to host vplc02 port 22: No route to host
tar: This does not look like a tar archive
tar: Exiting with failure status due to previous errors
-------------------- TestPlc.gather_logs : nodes's QEMU logs
-> 03:10:24 -- + scp -o BatchMode=yes -o StrictHostKeyChecking=no -o CheckHostIP=no -o ConnectTimeout=5 boxtops:/vservers/2025.05.06--f41-nofed/qemu-vnode01.pl.sophia.inria.fr/log.txt logs/node.qemu.vnode01.pl.sophia.inria.fr.txt
scp: /vservers/2025.05.06--f41-nofed/qemu-vnode01.pl.sophia.inria.fr/log.txt: No such file or directory
-------------------- TestPlc.gather_logs : nodes's /var/log
-> 03:10:25 -- + mkdir -p logs/node.var-log.vnode01.pl.sophia.inria.fr
-> 03:10:25 -- + ssh -n -o BatchMode=yes -o StrictHostKeyChecking=no -o CheckHostIP=no -o ConnectTimeout=5 -o UserKnownHostsFile=/dev/null -i keys/key_admin.rsa vnode01.pl.sophia.inria.fr tar -C /var/log -cf - .
+ tar -C logs/node.var-log.vnode01.pl.sophia.inria.fr -xf -
Warning: Identity file keys/key_admin.rsa not accessible: No such file or directory.
ssh: connect to host vnode01.pl.sophia.inria.fr port 22: No route to host
tar: This does not look like a tar archive
tar: Exiting with failure status due to previous errors
-------------------- TestPlc.gather_logs : sample sliver's /var/log
Traceback (most recent call last):
  File "/root/2025.05.06--f41-nofed/TestMain.py", line 511, in run
    step_result = method(plc_obj)
  File "/root/2025.05.06--f41-nofed/TestPlc.py", line 1929, in gather_logs
    self.gather_slivers_var_logs()
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^
  File "/root/2025.05.06--f41-nofed/TestPlc.py", line 1933, in gather_slivers_var_logs
    for test_sliver in self.all_sliver_objs():
                       ~~~~~~~~~~~~~~~~~~~~^^
  File "/root/2025.05.06--f41-nofed/TestPlc.py", line 427, in all_sliver_objs
    result.append(self.locate_sliver_obj(nodename, slicename))
                  ~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^
  File "/root/2025.05.06--f41-nofed/TestPlc.py", line 438, in locate_sliver_obj
    return TestSliver(self, test_node, test_slice)
  File "/root/2025.05.06--f41-nofed/TestSliver.py", line 16, in __init__
    self.test_ssh = self.create_test_ssh()
                    ~~~~~~~~~~~~~~~~~~~~^^
  File "/root/2025.05.06--f41-nofed/TestSliver.py", line 29, in create_test_ssh
    raise Exception("Cannot find the private key for slice {}".format(self.test_slice.name()))
Exception: Cannot find the private key for slice inri_sl1
* 03:10:28 -- ********** 1 FAILED (exception) step gather_logs on plctest1_vplc02 (discarded from further steps)
TRACE: 1 03-10-13->14s=0:00:14.393575s status=KO step=gather_logs plc=plctest1_vplc02 force=True

TestMain exit code 1