Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................................X.........X...........] duration:
2.755415862s
FAIL (2025-07-05 21:20:19 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.755445493s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
411.459165ms
FAIL (2025-07-05 21:19:58 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 411.490567ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................................X.........X..........] duration:
2.750452773s
FAIL (2025-07-05 21:19:35 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.750480156s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
457.6758ms
FAIL (2025-07-05 21:18:54 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 457.716201ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................................X.........X.........] duration:
2.828902903s
FAIL (2025-07-05 21:18:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.829216753s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................................X.........X........] duration:
2.857345592s
FAIL (2025-07-05 21:18:20 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.857382077s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
495.710694ms
FAIL (2025-07-05 21:18:19 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 495.786721ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
1m0.027437859s
FAIL (2025-07-05 21:18:05 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 1m0.027472253s
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................................X.........X.......] duration:
2.801894771s
FAIL (2025-07-05 21:17:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.801926232s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................................X.........X......] duration:
2.801992545s
FAIL (2025-07-05 21:17:19 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.802021777s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................................X.........X.....] duration:
3.124432083s
FAIL (2025-07-05 21:16:05 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.124460542s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............................................X.........X....] duration:
2.696188881s
FAIL (2025-07-05 21:15:06 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.696271586s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............................................X.........X...] duration:
2.853037621s
FAIL (2025-07-05 21:14:39 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.853064028s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............................................X.........X..] duration:
2.972795822s
FAIL (2025-07-05 21:13:38 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.972817931s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [................................................X.........X.] duration:
2.54180561s
FAIL (2025-07-05 21:12:29 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.54190745s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................................................X.........X] duration:
30.0008976s
FAIL (2025-07-05 21:11:54 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.000925853s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
2.826938736s
FAIL (2025-07-05 21:10:24 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.82697347s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
3.270076862s
FAIL (2025-07-05 21:09:22 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.270100367s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
2.7956093s
FAIL (2025-07-05 21:08:19 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.795634431s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
2.631308258s
FAIL (2025-07-05 21:07:38 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.63133831s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
2.713527478s
FAIL (2025-07-05 21:07:19 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.713586584s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
3.076751489s
FAIL (2025-07-05 21:06:07 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.07679501s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
3.007772551s
FAIL (2025-07-05 21:05:07 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.007798118s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.651675455s
FAIL (2025-07-05 21:04:10 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.65171167s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
2.558401287s
FAIL (2025-07-05 21:02:59 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.558475456s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.002032308s
FAIL (2025-07-05 21:02:32 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.002098122s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
421.349085ms
FAIL (2025-07-05 20:52:45 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 15)
======LOGS======
492 (298h56m2.215210125s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Uploading piece...
Jul 5 20:07:02.431396637 (298h56m2.314810268s) [upload=239112]: Next returned nil segment
Jul 5 20:07:02.431421007 (298h56m2.314834638s) [upload=239112]: Waiting for error group managing segments...
Jul 5 20:07:02.447095606 (298h56m2.330509226s) [noise=true , address=89.149.201.147:4019 , piece_id=MAUEKAJFTZNJMXF57JO2VBOV7L4ZZKILGR65GRDLBSV22K3R2TXA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.448042898 (298h56m2.331456515s) [noise=true , address=89.149.201.147:4024 , piece_id=OT6RRS4XBYINP4QB3RJ7VWPY2AD7GJPAQIW2ATM6ZELXOWA526RQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.449028099 (298h56m2.332441731s) [noise=true , address=89.149.201.147:4005 , piece_id=JQQG4Y45XA3XZMIAKWUPLGEIRBGVNHM5NCWRTULQTVPYXO6FO55Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.450682866 (298h56m2.334096485s) [noise=true , address=81.171.14.70:4034 , piece_id=IFDTTFWJPB636YM4NP6747UFLLZE4KMVLQYO7J4KVY4G6QWSZXSQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.451864269 (298h56m2.335277896s) [noise=true , address=81.171.14.70:4032 , piece_id=O3DKC6N4KXI7IUOVRSJSLP6TW6XDWZNES7BH3KZXAPNUYWC5O2DA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.456410299 (298h56m2.339823915s) [noise=true , address=81.171.14.70:4044 , piece_id=D3LDMEEASIEDNMZWVBYYAVZHRLNQIRGLRDS2LELUCSI52KASMJNQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.457434058 (298h56m2.340847673s) [noise=true , address=81.171.14.70:4027 , piece_id=HSWN54OPPTUAXJ7SNL2QXEEZK2HMSMJSTYWKHL5LBUN2YB4ZB6FQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.461640690 (298h56m2.345054326s) [noise=true , address=89.149.201.147:4023 , piece_id=A663SYQPHVRID3JBQG5BJL4F74AV33U4TYLDGJSXMQIZS5OEXJVQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.470937271 (298h56m2.354350905s) [noise=true , address=89.149.201.147:4011 , piece_id=KJAFCNL5N2D4OUPG3NEVOMWOIHTXG7GZQYXKV2DG2GHZ3GELVARA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.479272848 (298h56m2.362686482s) [noise=true , address=81.171.14.70:4028 , piece_id=VVC3RQ2YDSK7BNDCMLVHD4ZOCOA3LDU25UWUD3DZEEID3KSSNEEQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.480764798 (298h56m2.364178415s) [noise=true , address=81.171.14.70:4036 , piece_id=M4HHHX7L3PHNMJJBRF7KITDTOCWMLXMYY7EAB6UZJQZYXEU6AHZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.481062475 (298h56m2.364476092s) [noise=true , address=89.149.201.147:4013 , piece_id=TCB2SEVENWPWROT6UVTQNFBCZQXY2BNGCJJSL5ZVNDCGM6VQ4PCQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.486941056 (298h56m2.37035467s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.488291026 (298h56m2.371704665s) [noise=true , address=89.149.201.147:4015 , piece_id=NBRDDGC23DXKQNGOFZHBJ25I6QI7TZYUJ5XCENKCJOJO6CE2QFPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.524985461 (298h56m2.40839908s) [noise=true , address=89.149.201.147:4002 , piece_id=2LMWF6FTCFJFTMZQK2SK4KBRDDYVJTSXNKM5A6FK6KOCRPXDYRUA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:08:02.219008955 (298h57m2.102422574s) [noise=true , address=185.167.204.205:4036 , piece_id=6DQYOQ3IEEJEE442KTZ7R3JCLGHJJTSKG4AUZFP5I4G2UOPMLWPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: write tcp 139.59.144.22:51574->185.167.204.205:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219117336 (298h57m2.102530954s) [noise=true , address=185.167.204.205:4013 , piece_id=B3AU5MMLPEFO22IMVEQ3LVEJSA4PFUG6V4GJFE2R3WOMUHH3VGJQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219177020 (298h57m2.102590639s) [noise=true , address=185.167.204.205:4035 , piece_id=EO5BO6VXN6HXRZRQN5TAPTNG4CNXQZXFSNYLCQS3DWCQ53XXIYDA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1TT3Cyz1GPrGa9P9jWePFarF4LFaJfyfRbGM1hH5ctGx65JUJp, address:185.167.204.205:4035): protocol: rpc: dial tcp 185.167.204.205:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219237059 (298h57m2.102650678s) [noise=true , address=185.167.204.206:4054 , piece_id=JBEJ4R5DXATRMFFRTD3C3ONJV2H2JA26ZF2HH7EHG5KJ3BYZ7KSA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219293293 (298h57m2.102706912s) [noise=true , address=185.167.204.205:4002 , piece_id=FMBOS5TD46M5HJKAYM67NI6YUFAD3LQXKIVPTP5GJ4MMKDOX3LGA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: rpc: dial tcp 185.167.204.205:4002: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219349725 (298h57m2.102763345s) [noise=true , address=185.167.204.206:4064 , piece_id=7ZSIBWN4TK6GOGXX5EE5MGCB5OYZWUCP6UUJO6W46IDDBH5PJM4A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219382140 (298h57m2.102795759s) [noise=true , address=185.167.204.206:4052 , piece_id=QTUGBOXPYWCVTZBM7WPLYIIQU62KKJZU76FPRRB2Y4LJVNGPTNZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: rpc: dial tcp 185.167.204.206:4052: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220015537 (298h57m2.103429157s) [noise=true , address=185.167.204.206:4065 , piece_id=IHI3OAB4YGQVXPUE6V72Y5CCRJNARF2GXAKJPQAGX6A7VIQWCS5Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: rpc: dial tcp 185.167.204.206:4065: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220073820 (298h57m2.103487439s) [noise=true , address=185.167.204.205:4006 , piece_id=UBVRDRVJ4A3UN6XUNR3CEKWQFM3OKPCYVWDUTGSQUG47BYW32FQQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, address:185.167.204.205:4006): protocol: rpc: dial tcp 185.167.204.205:4006: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220132743 (298h57m2.103546363s) [noise=true , address=185.167.204.205:4011 , piece_id=PX542Q2X6YQCEHSJJCGTQ67VPNHQFUVTGBY2H6A2K2N5LNX6MIOQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220185981 (298h57m2.1035996s) [noise=true , address=185.167.204.205:4024 , piece_id=FVAR6VVKANNWC4EUMBDI2GHMHBIFQZWO7QAIKJXJYQUVMNS5AVHQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:35118->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220252973 (298h57m2.103666593s) [noise=true , address=185.167.204.205:4030 , piece_id=T6XQJHO4KQYI7WBXVDXQ22FMMUWK3EJTCFNS33V4J7NAGVDAAL7A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12w5R2Whxgg4AYNNvTkKmFq4pzahF1uZiVzwgVygc9iZDAXMdSk, address:185.167.204.205:4030): protocol: rpc: dial tcp 185.167.204.205:4030: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.225370789 (298h57m2.108784408s) [noise=true , address=185.167.204.205:4009 , piece_id=OMCAI3O25625Q76QGQ2QH6YND3QFWSCUVBC5M66G63GOWX6HZ5NA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: rpc: dial tcp 185.167.204.205:4009: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jul 5 20:08:02.225430620 (298h57m2.108844238s) [seg_pos={0 0}, upload=239112]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil>
Jul 5 20:08:02.245478781 (298h57m2.128892402s) [upload=239112]: Done uploading segments...
Jul 5 20:08:02.245512127 (298h57m2.128925759s) [upload=239112]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15)
Duration: 421.375031ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
399.776388ms
FAIL (2025-07-05 20:51:35 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 15)
======LOGS======
492 (298h56m2.215210125s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Uploading piece...
Jul 5 20:07:02.431396637 (298h56m2.314810268s) [upload=239112]: Next returned nil segment
Jul 5 20:07:02.431421007 (298h56m2.314834638s) [upload=239112]: Waiting for error group managing segments...
Jul 5 20:07:02.447095606 (298h56m2.330509226s) [noise=true , address=89.149.201.147:4019 , piece_id=MAUEKAJFTZNJMXF57JO2VBOV7L4ZZKILGR65GRDLBSV22K3R2TXA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.448042898 (298h56m2.331456515s) [noise=true , address=89.149.201.147:4024 , piece_id=OT6RRS4XBYINP4QB3RJ7VWPY2AD7GJPAQIW2ATM6ZELXOWA526RQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.449028099 (298h56m2.332441731s) [noise=true , address=89.149.201.147:4005 , piece_id=JQQG4Y45XA3XZMIAKWUPLGEIRBGVNHM5NCWRTULQTVPYXO6FO55Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.450682866 (298h56m2.334096485s) [noise=true , address=81.171.14.70:4034 , piece_id=IFDTTFWJPB636YM4NP6747UFLLZE4KMVLQYO7J4KVY4G6QWSZXSQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.451864269 (298h56m2.335277896s) [noise=true , address=81.171.14.70:4032 , piece_id=O3DKC6N4KXI7IUOVRSJSLP6TW6XDWZNES7BH3KZXAPNUYWC5O2DA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.456410299 (298h56m2.339823915s) [noise=true , address=81.171.14.70:4044 , piece_id=D3LDMEEASIEDNMZWVBYYAVZHRLNQIRGLRDS2LELUCSI52KASMJNQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.457434058 (298h56m2.340847673s) [noise=true , address=81.171.14.70:4027 , piece_id=HSWN54OPPTUAXJ7SNL2QXEEZK2HMSMJSTYWKHL5LBUN2YB4ZB6FQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.461640690 (298h56m2.345054326s) [noise=true , address=89.149.201.147:4023 , piece_id=A663SYQPHVRID3JBQG5BJL4F74AV33U4TYLDGJSXMQIZS5OEXJVQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.470937271 (298h56m2.354350905s) [noise=true , address=89.149.201.147:4011 , piece_id=KJAFCNL5N2D4OUPG3NEVOMWOIHTXG7GZQYXKV2DG2GHZ3GELVARA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.479272848 (298h56m2.362686482s) [noise=true , address=81.171.14.70:4028 , piece_id=VVC3RQ2YDSK7BNDCMLVHD4ZOCOA3LDU25UWUD3DZEEID3KSSNEEQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.480764798 (298h56m2.364178415s) [noise=true , address=81.171.14.70:4036 , piece_id=M4HHHX7L3PHNMJJBRF7KITDTOCWMLXMYY7EAB6UZJQZYXEU6AHZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.481062475 (298h56m2.364476092s) [noise=true , address=89.149.201.147:4013 , piece_id=TCB2SEVENWPWROT6UVTQNFBCZQXY2BNGCJJSL5ZVNDCGM6VQ4PCQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.486941056 (298h56m2.37035467s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.488291026 (298h56m2.371704665s) [noise=true , address=89.149.201.147:4015 , piece_id=NBRDDGC23DXKQNGOFZHBJ25I6QI7TZYUJ5XCENKCJOJO6CE2QFPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.524985461 (298h56m2.40839908s) [noise=true , address=89.149.201.147:4002 , piece_id=2LMWF6FTCFJFTMZQK2SK4KBRDDYVJTSXNKM5A6FK6KOCRPXDYRUA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:08:02.219008955 (298h57m2.102422574s) [noise=true , address=185.167.204.205:4036 , piece_id=6DQYOQ3IEEJEE442KTZ7R3JCLGHJJTSKG4AUZFP5I4G2UOPMLWPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: write tcp 139.59.144.22:51574->185.167.204.205:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219117336 (298h57m2.102530954s) [noise=true , address=185.167.204.205:4013 , piece_id=B3AU5MMLPEFO22IMVEQ3LVEJSA4PFUG6V4GJFE2R3WOMUHH3VGJQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219177020 (298h57m2.102590639s) [noise=true , address=185.167.204.205:4035 , piece_id=EO5BO6VXN6HXRZRQN5TAPTNG4CNXQZXFSNYLCQS3DWCQ53XXIYDA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1TT3Cyz1GPrGa9P9jWePFarF4LFaJfyfRbGM1hH5ctGx65JUJp, address:185.167.204.205:4035): protocol: rpc: dial tcp 185.167.204.205:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219237059 (298h57m2.102650678s) [noise=true , address=185.167.204.206:4054 , piece_id=JBEJ4R5DXATRMFFRTD3C3ONJV2H2JA26ZF2HH7EHG5KJ3BYZ7KSA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219293293 (298h57m2.102706912s) [noise=true , address=185.167.204.205:4002 , piece_id=FMBOS5TD46M5HJKAYM67NI6YUFAD3LQXKIVPTP5GJ4MMKDOX3LGA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: rpc: dial tcp 185.167.204.205:4002: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219349725 (298h57m2.102763345s) [noise=true , address=185.167.204.206:4064 , piece_id=7ZSIBWN4TK6GOGXX5EE5MGCB5OYZWUCP6UUJO6W46IDDBH5PJM4A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219382140 (298h57m2.102795759s) [noise=true , address=185.167.204.206:4052 , piece_id=QTUGBOXPYWCVTZBM7WPLYIIQU62KKJZU76FPRRB2Y4LJVNGPTNZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: rpc: dial tcp 185.167.204.206:4052: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220015537 (298h57m2.103429157s) [noise=true , address=185.167.204.206:4065 , piece_id=IHI3OAB4YGQVXPUE6V72Y5CCRJNARF2GXAKJPQAGX6A7VIQWCS5Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: rpc: dial tcp 185.167.204.206:4065: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220073820 (298h57m2.103487439s) [noise=true , address=185.167.204.205:4006 , piece_id=UBVRDRVJ4A3UN6XUNR3CEKWQFM3OKPCYVWDUTGSQUG47BYW32FQQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, address:185.167.204.205:4006): protocol: rpc: dial tcp 185.167.204.205:4006: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220132743 (298h57m2.103546363s) [noise=true , address=185.167.204.205:4011 , piece_id=PX542Q2X6YQCEHSJJCGTQ67VPNHQFUVTGBY2H6A2K2N5LNX6MIOQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220185981 (298h57m2.1035996s) [noise=true , address=185.167.204.205:4024 , piece_id=FVAR6VVKANNWC4EUMBDI2GHMHBIFQZWO7QAIKJXJYQUVMNS5AVHQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:35118->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220252973 (298h57m2.103666593s) [noise=true , address=185.167.204.205:4030 , piece_id=T6XQJHO4KQYI7WBXVDXQ22FMMUWK3EJTCFNS33V4J7NAGVDAAL7A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12w5R2Whxgg4AYNNvTkKmFq4pzahF1uZiVzwgVygc9iZDAXMdSk, address:185.167.204.205:4030): protocol: rpc: dial tcp 185.167.204.205:4030: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.225370789 (298h57m2.108784408s) [noise=true , address=185.167.204.205:4009 , piece_id=OMCAI3O25625Q76QGQ2QH6YND3QFWSCUVBC5M66G63GOWX6HZ5NA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: rpc: dial tcp 185.167.204.205:4009: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jul 5 20:08:02.225430620 (298h57m2.108844238s) [seg_pos={0 0}, upload=239112]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil>
Jul 5 20:08:02.245478781 (298h57m2.128892402s) [upload=239112]: Done uploading segments...
Jul 5 20:08:02.245512127 (298h57m2.128925759s) [upload=239112]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15)
Duration: 399.814983ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
537.464395ms
FAIL (2025-07-05 20:50:47 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 15)
======LOGS======
492 (298h56m2.215210125s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Uploading piece...
Jul 5 20:07:02.431396637 (298h56m2.314810268s) [upload=239112]: Next returned nil segment
Jul 5 20:07:02.431421007 (298h56m2.314834638s) [upload=239112]: Waiting for error group managing segments...
Jul 5 20:07:02.447095606 (298h56m2.330509226s) [noise=true , address=89.149.201.147:4019 , piece_id=MAUEKAJFTZNJMXF57JO2VBOV7L4ZZKILGR65GRDLBSV22K3R2TXA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.448042898 (298h56m2.331456515s) [noise=true , address=89.149.201.147:4024 , piece_id=OT6RRS4XBYINP4QB3RJ7VWPY2AD7GJPAQIW2ATM6ZELXOWA526RQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.449028099 (298h56m2.332441731s) [noise=true , address=89.149.201.147:4005 , piece_id=JQQG4Y45XA3XZMIAKWUPLGEIRBGVNHM5NCWRTULQTVPYXO6FO55Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.450682866 (298h56m2.334096485s) [noise=true , address=81.171.14.70:4034 , piece_id=IFDTTFWJPB636YM4NP6747UFLLZE4KMVLQYO7J4KVY4G6QWSZXSQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.451864269 (298h56m2.335277896s) [noise=true , address=81.171.14.70:4032 , piece_id=O3DKC6N4KXI7IUOVRSJSLP6TW6XDWZNES7BH3KZXAPNUYWC5O2DA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.456410299 (298h56m2.339823915s) [noise=true , address=81.171.14.70:4044 , piece_id=D3LDMEEASIEDNMZWVBYYAVZHRLNQIRGLRDS2LELUCSI52KASMJNQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.457434058 (298h56m2.340847673s) [noise=true , address=81.171.14.70:4027 , piece_id=HSWN54OPPTUAXJ7SNL2QXEEZK2HMSMJSTYWKHL5LBUN2YB4ZB6FQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.461640690 (298h56m2.345054326s) [noise=true , address=89.149.201.147:4023 , piece_id=A663SYQPHVRID3JBQG5BJL4F74AV33U4TYLDGJSXMQIZS5OEXJVQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.470937271 (298h56m2.354350905s) [noise=true , address=89.149.201.147:4011 , piece_id=KJAFCNL5N2D4OUPG3NEVOMWOIHTXG7GZQYXKV2DG2GHZ3GELVARA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.479272848 (298h56m2.362686482s) [noise=true , address=81.171.14.70:4028 , piece_id=VVC3RQ2YDSK7BNDCMLVHD4ZOCOA3LDU25UWUD3DZEEID3KSSNEEQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.480764798 (298h56m2.364178415s) [noise=true , address=81.171.14.70:4036 , piece_id=M4HHHX7L3PHNMJJBRF7KITDTOCWMLXMYY7EAB6UZJQZYXEU6AHZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.481062475 (298h56m2.364476092s) [noise=true , address=89.149.201.147:4013 , piece_id=TCB2SEVENWPWROT6UVTQNFBCZQXY2BNGCJJSL5ZVNDCGM6VQ4PCQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.486941056 (298h56m2.37035467s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.488291026 (298h56m2.371704665s) [noise=true , address=89.149.201.147:4015 , piece_id=NBRDDGC23DXKQNGOFZHBJ25I6QI7TZYUJ5XCENKCJOJO6CE2QFPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.524985461 (298h56m2.40839908s) [noise=true , address=89.149.201.147:4002 , piece_id=2LMWF6FTCFJFTMZQK2SK4KBRDDYVJTSXNKM5A6FK6KOCRPXDYRUA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:08:02.219008955 (298h57m2.102422574s) [noise=true , address=185.167.204.205:4036 , piece_id=6DQYOQ3IEEJEE442KTZ7R3JCLGHJJTSKG4AUZFP5I4G2UOPMLWPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: write tcp 139.59.144.22:51574->185.167.204.205:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219117336 (298h57m2.102530954s) [noise=true , address=185.167.204.205:4013 , piece_id=B3AU5MMLPEFO22IMVEQ3LVEJSA4PFUG6V4GJFE2R3WOMUHH3VGJQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219177020 (298h57m2.102590639s) [noise=true , address=185.167.204.205:4035 , piece_id=EO5BO6VXN6HXRZRQN5TAPTNG4CNXQZXFSNYLCQS3DWCQ53XXIYDA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1TT3Cyz1GPrGa9P9jWePFarF4LFaJfyfRbGM1hH5ctGx65JUJp, address:185.167.204.205:4035): protocol: rpc: dial tcp 185.167.204.205:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219237059 (298h57m2.102650678s) [noise=true , address=185.167.204.206:4054 , piece_id=JBEJ4R5DXATRMFFRTD3C3ONJV2H2JA26ZF2HH7EHG5KJ3BYZ7KSA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219293293 (298h57m2.102706912s) [noise=true , address=185.167.204.205:4002 , piece_id=FMBOS5TD46M5HJKAYM67NI6YUFAD3LQXKIVPTP5GJ4MMKDOX3LGA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: rpc: dial tcp 185.167.204.205:4002: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219349725 (298h57m2.102763345s) [noise=true , address=185.167.204.206:4064 , piece_id=7ZSIBWN4TK6GOGXX5EE5MGCB5OYZWUCP6UUJO6W46IDDBH5PJM4A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219382140 (298h57m2.102795759s) [noise=true , address=185.167.204.206:4052 , piece_id=QTUGBOXPYWCVTZBM7WPLYIIQU62KKJZU76FPRRB2Y4LJVNGPTNZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: rpc: dial tcp 185.167.204.206:4052: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220015537 (298h57m2.103429157s) [noise=true , address=185.167.204.206:4065 , piece_id=IHI3OAB4YGQVXPUE6V72Y5CCRJNARF2GXAKJPQAGX6A7VIQWCS5Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: rpc: dial tcp 185.167.204.206:4065: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220073820 (298h57m2.103487439s) [noise=true , address=185.167.204.205:4006 , piece_id=UBVRDRVJ4A3UN6XUNR3CEKWQFM3OKPCYVWDUTGSQUG47BYW32FQQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, address:185.167.204.205:4006): protocol: rpc: dial tcp 185.167.204.205:4006: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220132743 (298h57m2.103546363s) [noise=true , address=185.167.204.205:4011 , piece_id=PX542Q2X6YQCEHSJJCGTQ67VPNHQFUVTGBY2H6A2K2N5LNX6MIOQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220185981 (298h57m2.1035996s) [noise=true , address=185.167.204.205:4024 , piece_id=FVAR6VVKANNWC4EUMBDI2GHMHBIFQZWO7QAIKJXJYQUVMNS5AVHQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:35118->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220252973 (298h57m2.103666593s) [noise=true , address=185.167.204.205:4030 , piece_id=T6XQJHO4KQYI7WBXVDXQ22FMMUWK3EJTCFNS33V4J7NAGVDAAL7A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12w5R2Whxgg4AYNNvTkKmFq4pzahF1uZiVzwgVygc9iZDAXMdSk, address:185.167.204.205:4030): protocol: rpc: dial tcp 185.167.204.205:4030: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.225370789 (298h57m2.108784408s) [noise=true , address=185.167.204.205:4009 , piece_id=OMCAI3O25625Q76QGQ2QH6YND3QFWSCUVBC5M66G63GOWX6HZ5NA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: rpc: dial tcp 185.167.204.205:4009: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jul 5 20:08:02.225430620 (298h57m2.108844238s) [seg_pos={0 0}, upload=239112]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil>
Jul 5 20:08:02.245478781 (298h57m2.128892402s) [upload=239112]: Done uploading segments...
Jul 5 20:08:02.245512127 (298h57m2.128925759s) [upload=239112]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15)
Duration: 537.503604ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
396.172707ms
FAIL (2025-07-05 20:49:43 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 15)
======LOGS======
492 (298h56m2.215210125s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Uploading piece...
Jul 5 20:07:02.431396637 (298h56m2.314810268s) [upload=239112]: Next returned nil segment
Jul 5 20:07:02.431421007 (298h56m2.314834638s) [upload=239112]: Waiting for error group managing segments...
Jul 5 20:07:02.447095606 (298h56m2.330509226s) [noise=true , address=89.149.201.147:4019 , piece_id=MAUEKAJFTZNJMXF57JO2VBOV7L4ZZKILGR65GRDLBSV22K3R2TXA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.448042898 (298h56m2.331456515s) [noise=true , address=89.149.201.147:4024 , piece_id=OT6RRS4XBYINP4QB3RJ7VWPY2AD7GJPAQIW2ATM6ZELXOWA526RQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.449028099 (298h56m2.332441731s) [noise=true , address=89.149.201.147:4005 , piece_id=JQQG4Y45XA3XZMIAKWUPLGEIRBGVNHM5NCWRTULQTVPYXO6FO55Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.450682866 (298h56m2.334096485s) [noise=true , address=81.171.14.70:4034 , piece_id=IFDTTFWJPB636YM4NP6747UFLLZE4KMVLQYO7J4KVY4G6QWSZXSQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.451864269 (298h56m2.335277896s) [noise=true , address=81.171.14.70:4032 , piece_id=O3DKC6N4KXI7IUOVRSJSLP6TW6XDWZNES7BH3KZXAPNUYWC5O2DA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.456410299 (298h56m2.339823915s) [noise=true , address=81.171.14.70:4044 , piece_id=D3LDMEEASIEDNMZWVBYYAVZHRLNQIRGLRDS2LELUCSI52KASMJNQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.457434058 (298h56m2.340847673s) [noise=true , address=81.171.14.70:4027 , piece_id=HSWN54OPPTUAXJ7SNL2QXEEZK2HMSMJSTYWKHL5LBUN2YB4ZB6FQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.461640690 (298h56m2.345054326s) [noise=true , address=89.149.201.147:4023 , piece_id=A663SYQPHVRID3JBQG5BJL4F74AV33U4TYLDGJSXMQIZS5OEXJVQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.470937271 (298h56m2.354350905s) [noise=true , address=89.149.201.147:4011 , piece_id=KJAFCNL5N2D4OUPG3NEVOMWOIHTXG7GZQYXKV2DG2GHZ3GELVARA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.479272848 (298h56m2.362686482s) [noise=true , address=81.171.14.70:4028 , piece_id=VVC3RQ2YDSK7BNDCMLVHD4ZOCOA3LDU25UWUD3DZEEID3KSSNEEQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.480764798 (298h56m2.364178415s) [noise=true , address=81.171.14.70:4036 , piece_id=M4HHHX7L3PHNMJJBRF7KITDTOCWMLXMYY7EAB6UZJQZYXEU6AHZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.481062475 (298h56m2.364476092s) [noise=true , address=89.149.201.147:4013 , piece_id=TCB2SEVENWPWROT6UVTQNFBCZQXY2BNGCJJSL5ZVNDCGM6VQ4PCQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.486941056 (298h56m2.37035467s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.488291026 (298h56m2.371704665s) [noise=true , address=89.149.201.147:4015 , piece_id=NBRDDGC23DXKQNGOFZHBJ25I6QI7TZYUJ5XCENKCJOJO6CE2QFPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.524985461 (298h56m2.40839908s) [noise=true , address=89.149.201.147:4002 , piece_id=2LMWF6FTCFJFTMZQK2SK4KBRDDYVJTSXNKM5A6FK6KOCRPXDYRUA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:08:02.219008955 (298h57m2.102422574s) [noise=true , address=185.167.204.205:4036 , piece_id=6DQYOQ3IEEJEE442KTZ7R3JCLGHJJTSKG4AUZFP5I4G2UOPMLWPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: write tcp 139.59.144.22:51574->185.167.204.205:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219117336 (298h57m2.102530954s) [noise=true , address=185.167.204.205:4013 , piece_id=B3AU5MMLPEFO22IMVEQ3LVEJSA4PFUG6V4GJFE2R3WOMUHH3VGJQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219177020 (298h57m2.102590639s) [noise=true , address=185.167.204.205:4035 , piece_id=EO5BO6VXN6HXRZRQN5TAPTNG4CNXQZXFSNYLCQS3DWCQ53XXIYDA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1TT3Cyz1GPrGa9P9jWePFarF4LFaJfyfRbGM1hH5ctGx65JUJp, address:185.167.204.205:4035): protocol: rpc: dial tcp 185.167.204.205:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219237059 (298h57m2.102650678s) [noise=true , address=185.167.204.206:4054 , piece_id=JBEJ4R5DXATRMFFRTD3C3ONJV2H2JA26ZF2HH7EHG5KJ3BYZ7KSA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219293293 (298h57m2.102706912s) [noise=true , address=185.167.204.205:4002 , piece_id=FMBOS5TD46M5HJKAYM67NI6YUFAD3LQXKIVPTP5GJ4MMKDOX3LGA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: rpc: dial tcp 185.167.204.205:4002: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219349725 (298h57m2.102763345s) [noise=true , address=185.167.204.206:4064 , piece_id=7ZSIBWN4TK6GOGXX5EE5MGCB5OYZWUCP6UUJO6W46IDDBH5PJM4A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219382140 (298h57m2.102795759s) [noise=true , address=185.167.204.206:4052 , piece_id=QTUGBOXPYWCVTZBM7WPLYIIQU62KKJZU76FPRRB2Y4LJVNGPTNZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: rpc: dial tcp 185.167.204.206:4052: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220015537 (298h57m2.103429157s) [noise=true , address=185.167.204.206:4065 , piece_id=IHI3OAB4YGQVXPUE6V72Y5CCRJNARF2GXAKJPQAGX6A7VIQWCS5Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: rpc: dial tcp 185.167.204.206:4065: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220073820 (298h57m2.103487439s) [noise=true , address=185.167.204.205:4006 , piece_id=UBVRDRVJ4A3UN6XUNR3CEKWQFM3OKPCYVWDUTGSQUG47BYW32FQQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, address:185.167.204.205:4006): protocol: rpc: dial tcp 185.167.204.205:4006: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220132743 (298h57m2.103546363s) [noise=true , address=185.167.204.205:4011 , piece_id=PX542Q2X6YQCEHSJJCGTQ67VPNHQFUVTGBY2H6A2K2N5LNX6MIOQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220185981 (298h57m2.1035996s) [noise=true , address=185.167.204.205:4024 , piece_id=FVAR6VVKANNWC4EUMBDI2GHMHBIFQZWO7QAIKJXJYQUVMNS5AVHQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:35118->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220252973 (298h57m2.103666593s) [noise=true , address=185.167.204.205:4030 , piece_id=T6XQJHO4KQYI7WBXVDXQ22FMMUWK3EJTCFNS33V4J7NAGVDAAL7A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12w5R2Whxgg4AYNNvTkKmFq4pzahF1uZiVzwgVygc9iZDAXMdSk, address:185.167.204.205:4030): protocol: rpc: dial tcp 185.167.204.205:4030: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.225370789 (298h57m2.108784408s) [noise=true , address=185.167.204.205:4009 , piece_id=OMCAI3O25625Q76QGQ2QH6YND3QFWSCUVBC5M66G63GOWX6HZ5NA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: rpc: dial tcp 185.167.204.205:4009: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jul 5 20:08:02.225430620 (298h57m2.108844238s) [seg_pos={0 0}, upload=239112]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil>
Jul 5 20:08:02.245478781 (298h57m2.128892402s) [upload=239112]: Done uploading segments...
Jul 5 20:08:02.245512127 (298h57m2.128925759s) [upload=239112]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15)
Duration: 396.208565ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
401.77054ms
FAIL (2025-07-05 20:49:23 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 15)
======LOGS======
492 (298h56m2.215210125s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Uploading piece...
Jul 5 20:07:02.431396637 (298h56m2.314810268s) [upload=239112]: Next returned nil segment
Jul 5 20:07:02.431421007 (298h56m2.314834638s) [upload=239112]: Waiting for error group managing segments...
Jul 5 20:07:02.447095606 (298h56m2.330509226s) [noise=true , address=89.149.201.147:4019 , piece_id=MAUEKAJFTZNJMXF57JO2VBOV7L4ZZKILGR65GRDLBSV22K3R2TXA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.448042898 (298h56m2.331456515s) [noise=true , address=89.149.201.147:4024 , piece_id=OT6RRS4XBYINP4QB3RJ7VWPY2AD7GJPAQIW2ATM6ZELXOWA526RQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.449028099 (298h56m2.332441731s) [noise=true , address=89.149.201.147:4005 , piece_id=JQQG4Y45XA3XZMIAKWUPLGEIRBGVNHM5NCWRTULQTVPYXO6FO55Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.450682866 (298h56m2.334096485s) [noise=true , address=81.171.14.70:4034 , piece_id=IFDTTFWJPB636YM4NP6747UFLLZE4KMVLQYO7J4KVY4G6QWSZXSQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.451864269 (298h56m2.335277896s) [noise=true , address=81.171.14.70:4032 , piece_id=O3DKC6N4KXI7IUOVRSJSLP6TW6XDWZNES7BH3KZXAPNUYWC5O2DA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.456410299 (298h56m2.339823915s) [noise=true , address=81.171.14.70:4044 , piece_id=D3LDMEEASIEDNMZWVBYYAVZHRLNQIRGLRDS2LELUCSI52KASMJNQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.457434058 (298h56m2.340847673s) [noise=true , address=81.171.14.70:4027 , piece_id=HSWN54OPPTUAXJ7SNL2QXEEZK2HMSMJSTYWKHL5LBUN2YB4ZB6FQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.461640690 (298h56m2.345054326s) [noise=true , address=89.149.201.147:4023 , piece_id=A663SYQPHVRID3JBQG5BJL4F74AV33U4TYLDGJSXMQIZS5OEXJVQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.470937271 (298h56m2.354350905s) [noise=true , address=89.149.201.147:4011 , piece_id=KJAFCNL5N2D4OUPG3NEVOMWOIHTXG7GZQYXKV2DG2GHZ3GELVARA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.479272848 (298h56m2.362686482s) [noise=true , address=81.171.14.70:4028 , piece_id=VVC3RQ2YDSK7BNDCMLVHD4ZOCOA3LDU25UWUD3DZEEID3KSSNEEQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.480764798 (298h56m2.364178415s) [noise=true , address=81.171.14.70:4036 , piece_id=M4HHHX7L3PHNMJJBRF7KITDTOCWMLXMYY7EAB6UZJQZYXEU6AHZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.481062475 (298h56m2.364476092s) [noise=true , address=89.149.201.147:4013 , piece_id=TCB2SEVENWPWROT6UVTQNFBCZQXY2BNGCJJSL5ZVNDCGM6VQ4PCQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.486941056 (298h56m2.37035467s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.488291026 (298h56m2.371704665s) [noise=true , address=89.149.201.147:4015 , piece_id=NBRDDGC23DXKQNGOFZHBJ25I6QI7TZYUJ5XCENKCJOJO6CE2QFPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.524985461 (298h56m2.40839908s) [noise=true , address=89.149.201.147:4002 , piece_id=2LMWF6FTCFJFTMZQK2SK4KBRDDYVJTSXNKM5A6FK6KOCRPXDYRUA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:08:02.219008955 (298h57m2.102422574s) [noise=true , address=185.167.204.205:4036 , piece_id=6DQYOQ3IEEJEE442KTZ7R3JCLGHJJTSKG4AUZFP5I4G2UOPMLWPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: write tcp 139.59.144.22:51574->185.167.204.205:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219117336 (298h57m2.102530954s) [noise=true , address=185.167.204.205:4013 , piece_id=B3AU5MMLPEFO22IMVEQ3LVEJSA4PFUG6V4GJFE2R3WOMUHH3VGJQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219177020 (298h57m2.102590639s) [noise=true , address=185.167.204.205:4035 , piece_id=EO5BO6VXN6HXRZRQN5TAPTNG4CNXQZXFSNYLCQS3DWCQ53XXIYDA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1TT3Cyz1GPrGa9P9jWePFarF4LFaJfyfRbGM1hH5ctGx65JUJp, address:185.167.204.205:4035): protocol: rpc: dial tcp 185.167.204.205:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219237059 (298h57m2.102650678s) [noise=true , address=185.167.204.206:4054 , piece_id=JBEJ4R5DXATRMFFRTD3C3ONJV2H2JA26ZF2HH7EHG5KJ3BYZ7KSA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219293293 (298h57m2.102706912s) [noise=true , address=185.167.204.205:4002 , piece_id=FMBOS5TD46M5HJKAYM67NI6YUFAD3LQXKIVPTP5GJ4MMKDOX3LGA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: rpc: dial tcp 185.167.204.205:4002: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219349725 (298h57m2.102763345s) [noise=true , address=185.167.204.206:4064 , piece_id=7ZSIBWN4TK6GOGXX5EE5MGCB5OYZWUCP6UUJO6W46IDDBH5PJM4A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219382140 (298h57m2.102795759s) [noise=true , address=185.167.204.206:4052 , piece_id=QTUGBOXPYWCVTZBM7WPLYIIQU62KKJZU76FPRRB2Y4LJVNGPTNZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: rpc: dial tcp 185.167.204.206:4052: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220015537 (298h57m2.103429157s) [noise=true , address=185.167.204.206:4065 , piece_id=IHI3OAB4YGQVXPUE6V72Y5CCRJNARF2GXAKJPQAGX6A7VIQWCS5Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: rpc: dial tcp 185.167.204.206:4065: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220073820 (298h57m2.103487439s) [noise=true , address=185.167.204.205:4006 , piece_id=UBVRDRVJ4A3UN6XUNR3CEKWQFM3OKPCYVWDUTGSQUG47BYW32FQQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, address:185.167.204.205:4006): protocol: rpc: dial tcp 185.167.204.205:4006: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220132743 (298h57m2.103546363s) [noise=true , address=185.167.204.205:4011 , piece_id=PX542Q2X6YQCEHSJJCGTQ67VPNHQFUVTGBY2H6A2K2N5LNX6MIOQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220185981 (298h57m2.1035996s) [noise=true , address=185.167.204.205:4024 , piece_id=FVAR6VVKANNWC4EUMBDI2GHMHBIFQZWO7QAIKJXJYQUVMNS5AVHQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:35118->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220252973 (298h57m2.103666593s) [noise=true , address=185.167.204.205:4030 , piece_id=T6XQJHO4KQYI7WBXVDXQ22FMMUWK3EJTCFNS33V4J7NAGVDAAL7A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12w5R2Whxgg4AYNNvTkKmFq4pzahF1uZiVzwgVygc9iZDAXMdSk, address:185.167.204.205:4030): protocol: rpc: dial tcp 185.167.204.205:4030: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.225370789 (298h57m2.108784408s) [noise=true , address=185.167.204.205:4009 , piece_id=OMCAI3O25625Q76QGQ2QH6YND3QFWSCUVBC5M66G63GOWX6HZ5NA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: rpc: dial tcp 185.167.204.205:4009: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jul 5 20:08:02.225430620 (298h57m2.108844238s) [seg_pos={0 0}, upload=239112]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil>
Jul 5 20:08:02.245478781 (298h57m2.128892402s) [upload=239112]: Done uploading segments...
Jul 5 20:08:02.245512127 (298h57m2.128925759s) [upload=239112]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15)
Duration: 401.803186ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
419.600747ms
FAIL (2025-07-05 20:48:57 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 15)
======LOGS======
492 (298h56m2.215210125s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Uploading piece...
Jul 5 20:07:02.431396637 (298h56m2.314810268s) [upload=239112]: Next returned nil segment
Jul 5 20:07:02.431421007 (298h56m2.314834638s) [upload=239112]: Waiting for error group managing segments...
Jul 5 20:07:02.447095606 (298h56m2.330509226s) [noise=true , address=89.149.201.147:4019 , piece_id=MAUEKAJFTZNJMXF57JO2VBOV7L4ZZKILGR65GRDLBSV22K3R2TXA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.448042898 (298h56m2.331456515s) [noise=true , address=89.149.201.147:4024 , piece_id=OT6RRS4XBYINP4QB3RJ7VWPY2AD7GJPAQIW2ATM6ZELXOWA526RQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.449028099 (298h56m2.332441731s) [noise=true , address=89.149.201.147:4005 , piece_id=JQQG4Y45XA3XZMIAKWUPLGEIRBGVNHM5NCWRTULQTVPYXO6FO55Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.450682866 (298h56m2.334096485s) [noise=true , address=81.171.14.70:4034 , piece_id=IFDTTFWJPB636YM4NP6747UFLLZE4KMVLQYO7J4KVY4G6QWSZXSQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.451864269 (298h56m2.335277896s) [noise=true , address=81.171.14.70:4032 , piece_id=O3DKC6N4KXI7IUOVRSJSLP6TW6XDWZNES7BH3KZXAPNUYWC5O2DA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.456410299 (298h56m2.339823915s) [noise=true , address=81.171.14.70:4044 , piece_id=D3LDMEEASIEDNMZWVBYYAVZHRLNQIRGLRDS2LELUCSI52KASMJNQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.457434058 (298h56m2.340847673s) [noise=true , address=81.171.14.70:4027 , piece_id=HSWN54OPPTUAXJ7SNL2QXEEZK2HMSMJSTYWKHL5LBUN2YB4ZB6FQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.461640690 (298h56m2.345054326s) [noise=true , address=89.149.201.147:4023 , piece_id=A663SYQPHVRID3JBQG5BJL4F74AV33U4TYLDGJSXMQIZS5OEXJVQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.470937271 (298h56m2.354350905s) [noise=true , address=89.149.201.147:4011 , piece_id=KJAFCNL5N2D4OUPG3NEVOMWOIHTXG7GZQYXKV2DG2GHZ3GELVARA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.479272848 (298h56m2.362686482s) [noise=true , address=81.171.14.70:4028 , piece_id=VVC3RQ2YDSK7BNDCMLVHD4ZOCOA3LDU25UWUD3DZEEID3KSSNEEQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.480764798 (298h56m2.364178415s) [noise=true , address=81.171.14.70:4036 , piece_id=M4HHHX7L3PHNMJJBRF7KITDTOCWMLXMYY7EAB6UZJQZYXEU6AHZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.481062475 (298h56m2.364476092s) [noise=true , address=89.149.201.147:4013 , piece_id=TCB2SEVENWPWROT6UVTQNFBCZQXY2BNGCJJSL5ZVNDCGM6VQ4PCQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.486941056 (298h56m2.37035467s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.488291026 (298h56m2.371704665s) [noise=true , address=89.149.201.147:4015 , piece_id=NBRDDGC23DXKQNGOFZHBJ25I6QI7TZYUJ5XCENKCJOJO6CE2QFPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.524985461 (298h56m2.40839908s) [noise=true , address=89.149.201.147:4002 , piece_id=2LMWF6FTCFJFTMZQK2SK4KBRDDYVJTSXNKM5A6FK6KOCRPXDYRUA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:08:02.219008955 (298h57m2.102422574s) [noise=true , address=185.167.204.205:4036 , piece_id=6DQYOQ3IEEJEE442KTZ7R3JCLGHJJTSKG4AUZFP5I4G2UOPMLWPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: write tcp 139.59.144.22:51574->185.167.204.205:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219117336 (298h57m2.102530954s) [noise=true , address=185.167.204.205:4013 , piece_id=B3AU5MMLPEFO22IMVEQ3LVEJSA4PFUG6V4GJFE2R3WOMUHH3VGJQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219177020 (298h57m2.102590639s) [noise=true , address=185.167.204.205:4035 , piece_id=EO5BO6VXN6HXRZRQN5TAPTNG4CNXQZXFSNYLCQS3DWCQ53XXIYDA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1TT3Cyz1GPrGa9P9jWePFarF4LFaJfyfRbGM1hH5ctGx65JUJp, address:185.167.204.205:4035): protocol: rpc: dial tcp 185.167.204.205:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219237059 (298h57m2.102650678s) [noise=true , address=185.167.204.206:4054 , piece_id=JBEJ4R5DXATRMFFRTD3C3ONJV2H2JA26ZF2HH7EHG5KJ3BYZ7KSA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219293293 (298h57m2.102706912s) [noise=true , address=185.167.204.205:4002 , piece_id=FMBOS5TD46M5HJKAYM67NI6YUFAD3LQXKIVPTP5GJ4MMKDOX3LGA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: rpc: dial tcp 185.167.204.205:4002: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219349725 (298h57m2.102763345s) [noise=true , address=185.167.204.206:4064 , piece_id=7ZSIBWN4TK6GOGXX5EE5MGCB5OYZWUCP6UUJO6W46IDDBH5PJM4A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219382140 (298h57m2.102795759s) [noise=true , address=185.167.204.206:4052 , piece_id=QTUGBOXPYWCVTZBM7WPLYIIQU62KKJZU76FPRRB2Y4LJVNGPTNZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: rpc: dial tcp 185.167.204.206:4052: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220015537 (298h57m2.103429157s) [noise=true , address=185.167.204.206:4065 , piece_id=IHI3OAB4YGQVXPUE6V72Y5CCRJNARF2GXAKJPQAGX6A7VIQWCS5Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: rpc: dial tcp 185.167.204.206:4065: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220073820 (298h57m2.103487439s) [noise=true , address=185.167.204.205:4006 , piece_id=UBVRDRVJ4A3UN6XUNR3CEKWQFM3OKPCYVWDUTGSQUG47BYW32FQQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, address:185.167.204.205:4006): protocol: rpc: dial tcp 185.167.204.205:4006: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220132743 (298h57m2.103546363s) [noise=true , address=185.167.204.205:4011 , piece_id=PX542Q2X6YQCEHSJJCGTQ67VPNHQFUVTGBY2H6A2K2N5LNX6MIOQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220185981 (298h57m2.1035996s) [noise=true , address=185.167.204.205:4024 , piece_id=FVAR6VVKANNWC4EUMBDI2GHMHBIFQZWO7QAIKJXJYQUVMNS5AVHQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:35118->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220252973 (298h57m2.103666593s) [noise=true , address=185.167.204.205:4030 , piece_id=T6XQJHO4KQYI7WBXVDXQ22FMMUWK3EJTCFNS33V4J7NAGVDAAL7A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12w5R2Whxgg4AYNNvTkKmFq4pzahF1uZiVzwgVygc9iZDAXMdSk, address:185.167.204.205:4030): protocol: rpc: dial tcp 185.167.204.205:4030: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.225370789 (298h57m2.108784408s) [noise=true , address=185.167.204.205:4009 , piece_id=OMCAI3O25625Q76QGQ2QH6YND3QFWSCUVBC5M66G63GOWX6HZ5NA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: rpc: dial tcp 185.167.204.205:4009: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jul 5 20:08:02.225430620 (298h57m2.108844238s) [seg_pos={0 0}, upload=239112]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil>
Jul 5 20:08:02.245478781 (298h57m2.128892402s) [upload=239112]: Done uploading segments...
Jul 5 20:08:02.245512127 (298h57m2.128925759s) [upload=239112]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15)
Duration: 419.633632ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
403.902427ms
FAIL (2025-07-05 20:48:05 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 15)
======LOGS======
492 (298h56m2.215210125s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Uploading piece...
Jul 5 20:07:02.431396637 (298h56m2.314810268s) [upload=239112]: Next returned nil segment
Jul 5 20:07:02.431421007 (298h56m2.314834638s) [upload=239112]: Waiting for error group managing segments...
Jul 5 20:07:02.447095606 (298h56m2.330509226s) [noise=true , address=89.149.201.147:4019 , piece_id=MAUEKAJFTZNJMXF57JO2VBOV7L4ZZKILGR65GRDLBSV22K3R2TXA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.448042898 (298h56m2.331456515s) [noise=true , address=89.149.201.147:4024 , piece_id=OT6RRS4XBYINP4QB3RJ7VWPY2AD7GJPAQIW2ATM6ZELXOWA526RQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.449028099 (298h56m2.332441731s) [noise=true , address=89.149.201.147:4005 , piece_id=JQQG4Y45XA3XZMIAKWUPLGEIRBGVNHM5NCWRTULQTVPYXO6FO55Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.450682866 (298h56m2.334096485s) [noise=true , address=81.171.14.70:4034 , piece_id=IFDTTFWJPB636YM4NP6747UFLLZE4KMVLQYO7J4KVY4G6QWSZXSQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.451864269 (298h56m2.335277896s) [noise=true , address=81.171.14.70:4032 , piece_id=O3DKC6N4KXI7IUOVRSJSLP6TW6XDWZNES7BH3KZXAPNUYWC5O2DA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.456410299 (298h56m2.339823915s) [noise=true , address=81.171.14.70:4044 , piece_id=D3LDMEEASIEDNMZWVBYYAVZHRLNQIRGLRDS2LELUCSI52KASMJNQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.457434058 (298h56m2.340847673s) [noise=true , address=81.171.14.70:4027 , piece_id=HSWN54OPPTUAXJ7SNL2QXEEZK2HMSMJSTYWKHL5LBUN2YB4ZB6FQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.461640690 (298h56m2.345054326s) [noise=true , address=89.149.201.147:4023 , piece_id=A663SYQPHVRID3JBQG5BJL4F74AV33U4TYLDGJSXMQIZS5OEXJVQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.470937271 (298h56m2.354350905s) [noise=true , address=89.149.201.147:4011 , piece_id=KJAFCNL5N2D4OUPG3NEVOMWOIHTXG7GZQYXKV2DG2GHZ3GELVARA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.479272848 (298h56m2.362686482s) [noise=true , address=81.171.14.70:4028 , piece_id=VVC3RQ2YDSK7BNDCMLVHD4ZOCOA3LDU25UWUD3DZEEID3KSSNEEQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.480764798 (298h56m2.364178415s) [noise=true , address=81.171.14.70:4036 , piece_id=M4HHHX7L3PHNMJJBRF7KITDTOCWMLXMYY7EAB6UZJQZYXEU6AHZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.481062475 (298h56m2.364476092s) [noise=true , address=89.149.201.147:4013 , piece_id=TCB2SEVENWPWROT6UVTQNFBCZQXY2BNGCJJSL5ZVNDCGM6VQ4PCQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.486941056 (298h56m2.37035467s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.488291026 (298h56m2.371704665s) [noise=true , address=89.149.201.147:4015 , piece_id=NBRDDGC23DXKQNGOFZHBJ25I6QI7TZYUJ5XCENKCJOJO6CE2QFPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.524985461 (298h56m2.40839908s) [noise=true , address=89.149.201.147:4002 , piece_id=2LMWF6FTCFJFTMZQK2SK4KBRDDYVJTSXNKM5A6FK6KOCRPXDYRUA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:08:02.219008955 (298h57m2.102422574s) [noise=true , address=185.167.204.205:4036 , piece_id=6DQYOQ3IEEJEE442KTZ7R3JCLGHJJTSKG4AUZFP5I4G2UOPMLWPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: write tcp 139.59.144.22:51574->185.167.204.205:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219117336 (298h57m2.102530954s) [noise=true , address=185.167.204.205:4013 , piece_id=B3AU5MMLPEFO22IMVEQ3LVEJSA4PFUG6V4GJFE2R3WOMUHH3VGJQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219177020 (298h57m2.102590639s) [noise=true , address=185.167.204.205:4035 , piece_id=EO5BO6VXN6HXRZRQN5TAPTNG4CNXQZXFSNYLCQS3DWCQ53XXIYDA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1TT3Cyz1GPrGa9P9jWePFarF4LFaJfyfRbGM1hH5ctGx65JUJp, address:185.167.204.205:4035): protocol: rpc: dial tcp 185.167.204.205:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219237059 (298h57m2.102650678s) [noise=true , address=185.167.204.206:4054 , piece_id=JBEJ4R5DXATRMFFRTD3C3ONJV2H2JA26ZF2HH7EHG5KJ3BYZ7KSA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219293293 (298h57m2.102706912s) [noise=true , address=185.167.204.205:4002 , piece_id=FMBOS5TD46M5HJKAYM67NI6YUFAD3LQXKIVPTP5GJ4MMKDOX3LGA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: rpc: dial tcp 185.167.204.205:4002: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219349725 (298h57m2.102763345s) [noise=true , address=185.167.204.206:4064 , piece_id=7ZSIBWN4TK6GOGXX5EE5MGCB5OYZWUCP6UUJO6W46IDDBH5PJM4A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219382140 (298h57m2.102795759s) [noise=true , address=185.167.204.206:4052 , piece_id=QTUGBOXPYWCVTZBM7WPLYIIQU62KKJZU76FPRRB2Y4LJVNGPTNZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: rpc: dial tcp 185.167.204.206:4052: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220015537 (298h57m2.103429157s) [noise=true , address=185.167.204.206:4065 , piece_id=IHI3OAB4YGQVXPUE6V72Y5CCRJNARF2GXAKJPQAGX6A7VIQWCS5Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: rpc: dial tcp 185.167.204.206:4065: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220073820 (298h57m2.103487439s) [noise=true , address=185.167.204.205:4006 , piece_id=UBVRDRVJ4A3UN6XUNR3CEKWQFM3OKPCYVWDUTGSQUG47BYW32FQQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, address:185.167.204.205:4006): protocol: rpc: dial tcp 185.167.204.205:4006: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220132743 (298h57m2.103546363s) [noise=true , address=185.167.204.205:4011 , piece_id=PX542Q2X6YQCEHSJJCGTQ67VPNHQFUVTGBY2H6A2K2N5LNX6MIOQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220185981 (298h57m2.1035996s) [noise=true , address=185.167.204.205:4024 , piece_id=FVAR6VVKANNWC4EUMBDI2GHMHBIFQZWO7QAIKJXJYQUVMNS5AVHQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:35118->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220252973 (298h57m2.103666593s) [noise=true , address=185.167.204.205:4030 , piece_id=T6XQJHO4KQYI7WBXVDXQ22FMMUWK3EJTCFNS33V4J7NAGVDAAL7A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12w5R2Whxgg4AYNNvTkKmFq4pzahF1uZiVzwgVygc9iZDAXMdSk, address:185.167.204.205:4030): protocol: rpc: dial tcp 185.167.204.205:4030: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.225370789 (298h57m2.108784408s) [noise=true , address=185.167.204.205:4009 , piece_id=OMCAI3O25625Q76QGQ2QH6YND3QFWSCUVBC5M66G63GOWX6HZ5NA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: rpc: dial tcp 185.167.204.205:4009: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jul 5 20:08:02.225430620 (298h57m2.108844238s) [seg_pos={0 0}, upload=239112]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil>
Jul 5 20:08:02.245478781 (298h57m2.128892402s) [upload=239112]: Done uploading segments...
Jul 5 20:08:02.245512127 (298h57m2.128925759s) [upload=239112]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15)
Duration: 403.9386ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
411.697425ms
FAIL (2025-07-05 20:46:51 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 15)
======LOGS======
492 (298h56m2.215210125s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Uploading piece...
Jul 5 20:07:02.431396637 (298h56m2.314810268s) [upload=239112]: Next returned nil segment
Jul 5 20:07:02.431421007 (298h56m2.314834638s) [upload=239112]: Waiting for error group managing segments...
Jul 5 20:07:02.447095606 (298h56m2.330509226s) [noise=true , address=89.149.201.147:4019 , piece_id=MAUEKAJFTZNJMXF57JO2VBOV7L4ZZKILGR65GRDLBSV22K3R2TXA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.448042898 (298h56m2.331456515s) [noise=true , address=89.149.201.147:4024 , piece_id=OT6RRS4XBYINP4QB3RJ7VWPY2AD7GJPAQIW2ATM6ZELXOWA526RQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.449028099 (298h56m2.332441731s) [noise=true , address=89.149.201.147:4005 , piece_id=JQQG4Y45XA3XZMIAKWUPLGEIRBGVNHM5NCWRTULQTVPYXO6FO55Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.450682866 (298h56m2.334096485s) [noise=true , address=81.171.14.70:4034 , piece_id=IFDTTFWJPB636YM4NP6747UFLLZE4KMVLQYO7J4KVY4G6QWSZXSQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.451864269 (298h56m2.335277896s) [noise=true , address=81.171.14.70:4032 , piece_id=O3DKC6N4KXI7IUOVRSJSLP6TW6XDWZNES7BH3KZXAPNUYWC5O2DA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.456410299 (298h56m2.339823915s) [noise=true , address=81.171.14.70:4044 , piece_id=D3LDMEEASIEDNMZWVBYYAVZHRLNQIRGLRDS2LELUCSI52KASMJNQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.457434058 (298h56m2.340847673s) [noise=true , address=81.171.14.70:4027 , piece_id=HSWN54OPPTUAXJ7SNL2QXEEZK2HMSMJSTYWKHL5LBUN2YB4ZB6FQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.461640690 (298h56m2.345054326s) [noise=true , address=89.149.201.147:4023 , piece_id=A663SYQPHVRID3JBQG5BJL4F74AV33U4TYLDGJSXMQIZS5OEXJVQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.470937271 (298h56m2.354350905s) [noise=true , address=89.149.201.147:4011 , piece_id=KJAFCNL5N2D4OUPG3NEVOMWOIHTXG7GZQYXKV2DG2GHZ3GELVARA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.479272848 (298h56m2.362686482s) [noise=true , address=81.171.14.70:4028 , piece_id=VVC3RQ2YDSK7BNDCMLVHD4ZOCOA3LDU25UWUD3DZEEID3KSSNEEQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.480764798 (298h56m2.364178415s) [noise=true , address=81.171.14.70:4036 , piece_id=M4HHHX7L3PHNMJJBRF7KITDTOCWMLXMYY7EAB6UZJQZYXEU6AHZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.481062475 (298h56m2.364476092s) [noise=true , address=89.149.201.147:4013 , piece_id=TCB2SEVENWPWROT6UVTQNFBCZQXY2BNGCJJSL5ZVNDCGM6VQ4PCQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.486941056 (298h56m2.37035467s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.488291026 (298h56m2.371704665s) [noise=true , address=89.149.201.147:4015 , piece_id=NBRDDGC23DXKQNGOFZHBJ25I6QI7TZYUJ5XCENKCJOJO6CE2QFPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.524985461 (298h56m2.40839908s) [noise=true , address=89.149.201.147:4002 , piece_id=2LMWF6FTCFJFTMZQK2SK4KBRDDYVJTSXNKM5A6FK6KOCRPXDYRUA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:08:02.219008955 (298h57m2.102422574s) [noise=true , address=185.167.204.205:4036 , piece_id=6DQYOQ3IEEJEE442KTZ7R3JCLGHJJTSKG4AUZFP5I4G2UOPMLWPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: write tcp 139.59.144.22:51574->185.167.204.205:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219117336 (298h57m2.102530954s) [noise=true , address=185.167.204.205:4013 , piece_id=B3AU5MMLPEFO22IMVEQ3LVEJSA4PFUG6V4GJFE2R3WOMUHH3VGJQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219177020 (298h57m2.102590639s) [noise=true , address=185.167.204.205:4035 , piece_id=EO5BO6VXN6HXRZRQN5TAPTNG4CNXQZXFSNYLCQS3DWCQ53XXIYDA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1TT3Cyz1GPrGa9P9jWePFarF4LFaJfyfRbGM1hH5ctGx65JUJp, address:185.167.204.205:4035): protocol: rpc: dial tcp 185.167.204.205:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219237059 (298h57m2.102650678s) [noise=true , address=185.167.204.206:4054 , piece_id=JBEJ4R5DXATRMFFRTD3C3ONJV2H2JA26ZF2HH7EHG5KJ3BYZ7KSA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219293293 (298h57m2.102706912s) [noise=true , address=185.167.204.205:4002 , piece_id=FMBOS5TD46M5HJKAYM67NI6YUFAD3LQXKIVPTP5GJ4MMKDOX3LGA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: rpc: dial tcp 185.167.204.205:4002: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219349725 (298h57m2.102763345s) [noise=true , address=185.167.204.206:4064 , piece_id=7ZSIBWN4TK6GOGXX5EE5MGCB5OYZWUCP6UUJO6W46IDDBH5PJM4A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219382140 (298h57m2.102795759s) [noise=true , address=185.167.204.206:4052 , piece_id=QTUGBOXPYWCVTZBM7WPLYIIQU62KKJZU76FPRRB2Y4LJVNGPTNZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: rpc: dial tcp 185.167.204.206:4052: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220015537 (298h57m2.103429157s) [noise=true , address=185.167.204.206:4065 , piece_id=IHI3OAB4YGQVXPUE6V72Y5CCRJNARF2GXAKJPQAGX6A7VIQWCS5Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: rpc: dial tcp 185.167.204.206:4065: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220073820 (298h57m2.103487439s) [noise=true , address=185.167.204.205:4006 , piece_id=UBVRDRVJ4A3UN6XUNR3CEKWQFM3OKPCYVWDUTGSQUG47BYW32FQQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, address:185.167.204.205:4006): protocol: rpc: dial tcp 185.167.204.205:4006: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220132743 (298h57m2.103546363s) [noise=true , address=185.167.204.205:4011 , piece_id=PX542Q2X6YQCEHSJJCGTQ67VPNHQFUVTGBY2H6A2K2N5LNX6MIOQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220185981 (298h57m2.1035996s) [noise=true , address=185.167.204.205:4024 , piece_id=FVAR6VVKANNWC4EUMBDI2GHMHBIFQZWO7QAIKJXJYQUVMNS5AVHQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:35118->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220252973 (298h57m2.103666593s) [noise=true , address=185.167.204.205:4030 , piece_id=T6XQJHO4KQYI7WBXVDXQ22FMMUWK3EJTCFNS33V4J7NAGVDAAL7A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12w5R2Whxgg4AYNNvTkKmFq4pzahF1uZiVzwgVygc9iZDAXMdSk, address:185.167.204.205:4030): protocol: rpc: dial tcp 185.167.204.205:4030: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.225370789 (298h57m2.108784408s) [noise=true , address=185.167.204.205:4009 , piece_id=OMCAI3O25625Q76QGQ2QH6YND3QFWSCUVBC5M66G63GOWX6HZ5NA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: rpc: dial tcp 185.167.204.205:4009: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jul 5 20:08:02.225430620 (298h57m2.108844238s) [seg_pos={0 0}, upload=239112]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil>
Jul 5 20:08:02.245478781 (298h57m2.128892402s) [upload=239112]: Done uploading segments...
Jul 5 20:08:02.245512127 (298h57m2.128925759s) [upload=239112]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15)
Duration: 411.7324ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
405.492536ms
FAIL (2025-07-05 20:45:59 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 15)
======LOGS======
492 (298h56m2.215210125s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Uploading piece...
Jul 5 20:07:02.431396637 (298h56m2.314810268s) [upload=239112]: Next returned nil segment
Jul 5 20:07:02.431421007 (298h56m2.314834638s) [upload=239112]: Waiting for error group managing segments...
Jul 5 20:07:02.447095606 (298h56m2.330509226s) [noise=true , address=89.149.201.147:4019 , piece_id=MAUEKAJFTZNJMXF57JO2VBOV7L4ZZKILGR65GRDLBSV22K3R2TXA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.448042898 (298h56m2.331456515s) [noise=true , address=89.149.201.147:4024 , piece_id=OT6RRS4XBYINP4QB3RJ7VWPY2AD7GJPAQIW2ATM6ZELXOWA526RQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.449028099 (298h56m2.332441731s) [noise=true , address=89.149.201.147:4005 , piece_id=JQQG4Y45XA3XZMIAKWUPLGEIRBGVNHM5NCWRTULQTVPYXO6FO55Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.450682866 (298h56m2.334096485s) [noise=true , address=81.171.14.70:4034 , piece_id=IFDTTFWJPB636YM4NP6747UFLLZE4KMVLQYO7J4KVY4G6QWSZXSQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.451864269 (298h56m2.335277896s) [noise=true , address=81.171.14.70:4032 , piece_id=O3DKC6N4KXI7IUOVRSJSLP6TW6XDWZNES7BH3KZXAPNUYWC5O2DA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.456410299 (298h56m2.339823915s) [noise=true , address=81.171.14.70:4044 , piece_id=D3LDMEEASIEDNMZWVBYYAVZHRLNQIRGLRDS2LELUCSI52KASMJNQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.457434058 (298h56m2.340847673s) [noise=true , address=81.171.14.70:4027 , piece_id=HSWN54OPPTUAXJ7SNL2QXEEZK2HMSMJSTYWKHL5LBUN2YB4ZB6FQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.461640690 (298h56m2.345054326s) [noise=true , address=89.149.201.147:4023 , piece_id=A663SYQPHVRID3JBQG5BJL4F74AV33U4TYLDGJSXMQIZS5OEXJVQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.470937271 (298h56m2.354350905s) [noise=true , address=89.149.201.147:4011 , piece_id=KJAFCNL5N2D4OUPG3NEVOMWOIHTXG7GZQYXKV2DG2GHZ3GELVARA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.479272848 (298h56m2.362686482s) [noise=true , address=81.171.14.70:4028 , piece_id=VVC3RQ2YDSK7BNDCMLVHD4ZOCOA3LDU25UWUD3DZEEID3KSSNEEQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.480764798 (298h56m2.364178415s) [noise=true , address=81.171.14.70:4036 , piece_id=M4HHHX7L3PHNMJJBRF7KITDTOCWMLXMYY7EAB6UZJQZYXEU6AHZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.481062475 (298h56m2.364476092s) [noise=true , address=89.149.201.147:4013 , piece_id=TCB2SEVENWPWROT6UVTQNFBCZQXY2BNGCJJSL5ZVNDCGM6VQ4PCQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.486941056 (298h56m2.37035467s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.488291026 (298h56m2.371704665s) [noise=true , address=89.149.201.147:4015 , piece_id=NBRDDGC23DXKQNGOFZHBJ25I6QI7TZYUJ5XCENKCJOJO6CE2QFPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.524985461 (298h56m2.40839908s) [noise=true , address=89.149.201.147:4002 , piece_id=2LMWF6FTCFJFTMZQK2SK4KBRDDYVJTSXNKM5A6FK6KOCRPXDYRUA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:08:02.219008955 (298h57m2.102422574s) [noise=true , address=185.167.204.205:4036 , piece_id=6DQYOQ3IEEJEE442KTZ7R3JCLGHJJTSKG4AUZFP5I4G2UOPMLWPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: write tcp 139.59.144.22:51574->185.167.204.205:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219117336 (298h57m2.102530954s) [noise=true , address=185.167.204.205:4013 , piece_id=B3AU5MMLPEFO22IMVEQ3LVEJSA4PFUG6V4GJFE2R3WOMUHH3VGJQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219177020 (298h57m2.102590639s) [noise=true , address=185.167.204.205:4035 , piece_id=EO5BO6VXN6HXRZRQN5TAPTNG4CNXQZXFSNYLCQS3DWCQ53XXIYDA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1TT3Cyz1GPrGa9P9jWePFarF4LFaJfyfRbGM1hH5ctGx65JUJp, address:185.167.204.205:4035): protocol: rpc: dial tcp 185.167.204.205:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219237059 (298h57m2.102650678s) [noise=true , address=185.167.204.206:4054 , piece_id=JBEJ4R5DXATRMFFRTD3C3ONJV2H2JA26ZF2HH7EHG5KJ3BYZ7KSA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219293293 (298h57m2.102706912s) [noise=true , address=185.167.204.205:4002 , piece_id=FMBOS5TD46M5HJKAYM67NI6YUFAD3LQXKIVPTP5GJ4MMKDOX3LGA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: rpc: dial tcp 185.167.204.205:4002: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219349725 (298h57m2.102763345s) [noise=true , address=185.167.204.206:4064 , piece_id=7ZSIBWN4TK6GOGXX5EE5MGCB5OYZWUCP6UUJO6W46IDDBH5PJM4A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219382140 (298h57m2.102795759s) [noise=true , address=185.167.204.206:4052 , piece_id=QTUGBOXPYWCVTZBM7WPLYIIQU62KKJZU76FPRRB2Y4LJVNGPTNZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: rpc: dial tcp 185.167.204.206:4052: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220015537 (298h57m2.103429157s) [noise=true , address=185.167.204.206:4065 , piece_id=IHI3OAB4YGQVXPUE6V72Y5CCRJNARF2GXAKJPQAGX6A7VIQWCS5Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: rpc: dial tcp 185.167.204.206:4065: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220073820 (298h57m2.103487439s) [noise=true , address=185.167.204.205:4006 , piece_id=UBVRDRVJ4A3UN6XUNR3CEKWQFM3OKPCYVWDUTGSQUG47BYW32FQQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, address:185.167.204.205:4006): protocol: rpc: dial tcp 185.167.204.205:4006: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220132743 (298h57m2.103546363s) [noise=true , address=185.167.204.205:4011 , piece_id=PX542Q2X6YQCEHSJJCGTQ67VPNHQFUVTGBY2H6A2K2N5LNX6MIOQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220185981 (298h57m2.1035996s) [noise=true , address=185.167.204.205:4024 , piece_id=FVAR6VVKANNWC4EUMBDI2GHMHBIFQZWO7QAIKJXJYQUVMNS5AVHQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:35118->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220252973 (298h57m2.103666593s) [noise=true , address=185.167.204.205:4030 , piece_id=T6XQJHO4KQYI7WBXVDXQ22FMMUWK3EJTCFNS33V4J7NAGVDAAL7A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12w5R2Whxgg4AYNNvTkKmFq4pzahF1uZiVzwgVygc9iZDAXMdSk, address:185.167.204.205:4030): protocol: rpc: dial tcp 185.167.204.205:4030: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.225370789 (298h57m2.108784408s) [noise=true , address=185.167.204.205:4009 , piece_id=OMCAI3O25625Q76QGQ2QH6YND3QFWSCUVBC5M66G63GOWX6HZ5NA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: rpc: dial tcp 185.167.204.205:4009: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jul 5 20:08:02.225430620 (298h57m2.108844238s) [seg_pos={0 0}, upload=239112]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil>
Jul 5 20:08:02.245478781 (298h57m2.128892402s) [upload=239112]: Done uploading segments...
Jul 5 20:08:02.245512127 (298h57m2.128925759s) [upload=239112]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15)
Duration: 405.529325ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
522.784243ms
FAIL (2025-07-05 20:44:56 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 15)
======LOGS======
492 (298h56m2.215210125s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Uploading piece...
Jul 5 20:07:02.431396637 (298h56m2.314810268s) [upload=239112]: Next returned nil segment
Jul 5 20:07:02.431421007 (298h56m2.314834638s) [upload=239112]: Waiting for error group managing segments...
Jul 5 20:07:02.447095606 (298h56m2.330509226s) [noise=true , address=89.149.201.147:4019 , piece_id=MAUEKAJFTZNJMXF57JO2VBOV7L4ZZKILGR65GRDLBSV22K3R2TXA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.448042898 (298h56m2.331456515s) [noise=true , address=89.149.201.147:4024 , piece_id=OT6RRS4XBYINP4QB3RJ7VWPY2AD7GJPAQIW2ATM6ZELXOWA526RQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.449028099 (298h56m2.332441731s) [noise=true , address=89.149.201.147:4005 , piece_id=JQQG4Y45XA3XZMIAKWUPLGEIRBGVNHM5NCWRTULQTVPYXO6FO55Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.450682866 (298h56m2.334096485s) [noise=true , address=81.171.14.70:4034 , piece_id=IFDTTFWJPB636YM4NP6747UFLLZE4KMVLQYO7J4KVY4G6QWSZXSQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.451864269 (298h56m2.335277896s) [noise=true , address=81.171.14.70:4032 , piece_id=O3DKC6N4KXI7IUOVRSJSLP6TW6XDWZNES7BH3KZXAPNUYWC5O2DA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.456410299 (298h56m2.339823915s) [noise=true , address=81.171.14.70:4044 , piece_id=D3LDMEEASIEDNMZWVBYYAVZHRLNQIRGLRDS2LELUCSI52KASMJNQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.457434058 (298h56m2.340847673s) [noise=true , address=81.171.14.70:4027 , piece_id=HSWN54OPPTUAXJ7SNL2QXEEZK2HMSMJSTYWKHL5LBUN2YB4ZB6FQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.461640690 (298h56m2.345054326s) [noise=true , address=89.149.201.147:4023 , piece_id=A663SYQPHVRID3JBQG5BJL4F74AV33U4TYLDGJSXMQIZS5OEXJVQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.470937271 (298h56m2.354350905s) [noise=true , address=89.149.201.147:4011 , piece_id=KJAFCNL5N2D4OUPG3NEVOMWOIHTXG7GZQYXKV2DG2GHZ3GELVARA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.479272848 (298h56m2.362686482s) [noise=true , address=81.171.14.70:4028 , piece_id=VVC3RQ2YDSK7BNDCMLVHD4ZOCOA3LDU25UWUD3DZEEID3KSSNEEQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.480764798 (298h56m2.364178415s) [noise=true , address=81.171.14.70:4036 , piece_id=M4HHHX7L3PHNMJJBRF7KITDTOCWMLXMYY7EAB6UZJQZYXEU6AHZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.481062475 (298h56m2.364476092s) [noise=true , address=89.149.201.147:4013 , piece_id=TCB2SEVENWPWROT6UVTQNFBCZQXY2BNGCJJSL5ZVNDCGM6VQ4PCQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.486941056 (298h56m2.37035467s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.488291026 (298h56m2.371704665s) [noise=true , address=89.149.201.147:4015 , piece_id=NBRDDGC23DXKQNGOFZHBJ25I6QI7TZYUJ5XCENKCJOJO6CE2QFPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.524985461 (298h56m2.40839908s) [noise=true , address=89.149.201.147:4002 , piece_id=2LMWF6FTCFJFTMZQK2SK4KBRDDYVJTSXNKM5A6FK6KOCRPXDYRUA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:08:02.219008955 (298h57m2.102422574s) [noise=true , address=185.167.204.205:4036 , piece_id=6DQYOQ3IEEJEE442KTZ7R3JCLGHJJTSKG4AUZFP5I4G2UOPMLWPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: write tcp 139.59.144.22:51574->185.167.204.205:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219117336 (298h57m2.102530954s) [noise=true , address=185.167.204.205:4013 , piece_id=B3AU5MMLPEFO22IMVEQ3LVEJSA4PFUG6V4GJFE2R3WOMUHH3VGJQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219177020 (298h57m2.102590639s) [noise=true , address=185.167.204.205:4035 , piece_id=EO5BO6VXN6HXRZRQN5TAPTNG4CNXQZXFSNYLCQS3DWCQ53XXIYDA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1TT3Cyz1GPrGa9P9jWePFarF4LFaJfyfRbGM1hH5ctGx65JUJp, address:185.167.204.205:4035): protocol: rpc: dial tcp 185.167.204.205:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219237059 (298h57m2.102650678s) [noise=true , address=185.167.204.206:4054 , piece_id=JBEJ4R5DXATRMFFRTD3C3ONJV2H2JA26ZF2HH7EHG5KJ3BYZ7KSA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219293293 (298h57m2.102706912s) [noise=true , address=185.167.204.205:4002 , piece_id=FMBOS5TD46M5HJKAYM67NI6YUFAD3LQXKIVPTP5GJ4MMKDOX3LGA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: rpc: dial tcp 185.167.204.205:4002: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219349725 (298h57m2.102763345s) [noise=true , address=185.167.204.206:4064 , piece_id=7ZSIBWN4TK6GOGXX5EE5MGCB5OYZWUCP6UUJO6W46IDDBH5PJM4A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219382140 (298h57m2.102795759s) [noise=true , address=185.167.204.206:4052 , piece_id=QTUGBOXPYWCVTZBM7WPLYIIQU62KKJZU76FPRRB2Y4LJVNGPTNZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: rpc: dial tcp 185.167.204.206:4052: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220015537 (298h57m2.103429157s) [noise=true , address=185.167.204.206:4065 , piece_id=IHI3OAB4YGQVXPUE6V72Y5CCRJNARF2GXAKJPQAGX6A7VIQWCS5Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: rpc: dial tcp 185.167.204.206:4065: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220073820 (298h57m2.103487439s) [noise=true , address=185.167.204.205:4006 , piece_id=UBVRDRVJ4A3UN6XUNR3CEKWQFM3OKPCYVWDUTGSQUG47BYW32FQQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, address:185.167.204.205:4006): protocol: rpc: dial tcp 185.167.204.205:4006: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220132743 (298h57m2.103546363s) [noise=true , address=185.167.204.205:4011 , piece_id=PX542Q2X6YQCEHSJJCGTQ67VPNHQFUVTGBY2H6A2K2N5LNX6MIOQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220185981 (298h57m2.1035996s) [noise=true , address=185.167.204.205:4024 , piece_id=FVAR6VVKANNWC4EUMBDI2GHMHBIFQZWO7QAIKJXJYQUVMNS5AVHQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:35118->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220252973 (298h57m2.103666593s) [noise=true , address=185.167.204.205:4030 , piece_id=T6XQJHO4KQYI7WBXVDXQ22FMMUWK3EJTCFNS33V4J7NAGVDAAL7A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12w5R2Whxgg4AYNNvTkKmFq4pzahF1uZiVzwgVygc9iZDAXMdSk, address:185.167.204.205:4030): protocol: rpc: dial tcp 185.167.204.205:4030: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.225370789 (298h57m2.108784408s) [noise=true , address=185.167.204.205:4009 , piece_id=OMCAI3O25625Q76QGQ2QH6YND3QFWSCUVBC5M66G63GOWX6HZ5NA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: rpc: dial tcp 185.167.204.205:4009: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jul 5 20:08:02.225430620 (298h57m2.108844238s) [seg_pos={0 0}, upload=239112]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil>
Jul 5 20:08:02.245478781 (298h57m2.128892402s) [upload=239112]: Done uploading segments...
Jul 5 20:08:02.245512127 (298h57m2.128925759s) [upload=239112]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15)
Duration: 522.81361ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
493.435462ms
FAIL (2025-07-05 20:44:25 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 15)
======LOGS======
492 (298h56m2.215210125s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Uploading piece...
Jul 5 20:07:02.431396637 (298h56m2.314810268s) [upload=239112]: Next returned nil segment
Jul 5 20:07:02.431421007 (298h56m2.314834638s) [upload=239112]: Waiting for error group managing segments...
Jul 5 20:07:02.447095606 (298h56m2.330509226s) [noise=true , address=89.149.201.147:4019 , piece_id=MAUEKAJFTZNJMXF57JO2VBOV7L4ZZKILGR65GRDLBSV22K3R2TXA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.448042898 (298h56m2.331456515s) [noise=true , address=89.149.201.147:4024 , piece_id=OT6RRS4XBYINP4QB3RJ7VWPY2AD7GJPAQIW2ATM6ZELXOWA526RQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.449028099 (298h56m2.332441731s) [noise=true , address=89.149.201.147:4005 , piece_id=JQQG4Y45XA3XZMIAKWUPLGEIRBGVNHM5NCWRTULQTVPYXO6FO55Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.450682866 (298h56m2.334096485s) [noise=true , address=81.171.14.70:4034 , piece_id=IFDTTFWJPB636YM4NP6747UFLLZE4KMVLQYO7J4KVY4G6QWSZXSQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.451864269 (298h56m2.335277896s) [noise=true , address=81.171.14.70:4032 , piece_id=O3DKC6N4KXI7IUOVRSJSLP6TW6XDWZNES7BH3KZXAPNUYWC5O2DA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.456410299 (298h56m2.339823915s) [noise=true , address=81.171.14.70:4044 , piece_id=D3LDMEEASIEDNMZWVBYYAVZHRLNQIRGLRDS2LELUCSI52KASMJNQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.457434058 (298h56m2.340847673s) [noise=true , address=81.171.14.70:4027 , piece_id=HSWN54OPPTUAXJ7SNL2QXEEZK2HMSMJSTYWKHL5LBUN2YB4ZB6FQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.461640690 (298h56m2.345054326s) [noise=true , address=89.149.201.147:4023 , piece_id=A663SYQPHVRID3JBQG5BJL4F74AV33U4TYLDGJSXMQIZS5OEXJVQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.470937271 (298h56m2.354350905s) [noise=true , address=89.149.201.147:4011 , piece_id=KJAFCNL5N2D4OUPG3NEVOMWOIHTXG7GZQYXKV2DG2GHZ3GELVARA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.479272848 (298h56m2.362686482s) [noise=true , address=81.171.14.70:4028 , piece_id=VVC3RQ2YDSK7BNDCMLVHD4ZOCOA3LDU25UWUD3DZEEID3KSSNEEQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.480764798 (298h56m2.364178415s) [noise=true , address=81.171.14.70:4036 , piece_id=M4HHHX7L3PHNMJJBRF7KITDTOCWMLXMYY7EAB6UZJQZYXEU6AHZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.481062475 (298h56m2.364476092s) [noise=true , address=89.149.201.147:4013 , piece_id=TCB2SEVENWPWROT6UVTQNFBCZQXY2BNGCJJSL5ZVNDCGM6VQ4PCQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.486941056 (298h56m2.37035467s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.488291026 (298h56m2.371704665s) [noise=true , address=89.149.201.147:4015 , piece_id=NBRDDGC23DXKQNGOFZHBJ25I6QI7TZYUJ5XCENKCJOJO6CE2QFPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.524985461 (298h56m2.40839908s) [noise=true , address=89.149.201.147:4002 , piece_id=2LMWF6FTCFJFTMZQK2SK4KBRDDYVJTSXNKM5A6FK6KOCRPXDYRUA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:08:02.219008955 (298h57m2.102422574s) [noise=true , address=185.167.204.205:4036 , piece_id=6DQYOQ3IEEJEE442KTZ7R3JCLGHJJTSKG4AUZFP5I4G2UOPMLWPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: write tcp 139.59.144.22:51574->185.167.204.205:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219117336 (298h57m2.102530954s) [noise=true , address=185.167.204.205:4013 , piece_id=B3AU5MMLPEFO22IMVEQ3LVEJSA4PFUG6V4GJFE2R3WOMUHH3VGJQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219177020 (298h57m2.102590639s) [noise=true , address=185.167.204.205:4035 , piece_id=EO5BO6VXN6HXRZRQN5TAPTNG4CNXQZXFSNYLCQS3DWCQ53XXIYDA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1TT3Cyz1GPrGa9P9jWePFarF4LFaJfyfRbGM1hH5ctGx65JUJp, address:185.167.204.205:4035): protocol: rpc: dial tcp 185.167.204.205:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219237059 (298h57m2.102650678s) [noise=true , address=185.167.204.206:4054 , piece_id=JBEJ4R5DXATRMFFRTD3C3ONJV2H2JA26ZF2HH7EHG5KJ3BYZ7KSA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219293293 (298h57m2.102706912s) [noise=true , address=185.167.204.205:4002 , piece_id=FMBOS5TD46M5HJKAYM67NI6YUFAD3LQXKIVPTP5GJ4MMKDOX3LGA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: rpc: dial tcp 185.167.204.205:4002: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219349725 (298h57m2.102763345s) [noise=true , address=185.167.204.206:4064 , piece_id=7ZSIBWN4TK6GOGXX5EE5MGCB5OYZWUCP6UUJO6W46IDDBH5PJM4A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219382140 (298h57m2.102795759s) [noise=true , address=185.167.204.206:4052 , piece_id=QTUGBOXPYWCVTZBM7WPLYIIQU62KKJZU76FPRRB2Y4LJVNGPTNZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: rpc: dial tcp 185.167.204.206:4052: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220015537 (298h57m2.103429157s) [noise=true , address=185.167.204.206:4065 , piece_id=IHI3OAB4YGQVXPUE6V72Y5CCRJNARF2GXAKJPQAGX6A7VIQWCS5Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: rpc: dial tcp 185.167.204.206:4065: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220073820 (298h57m2.103487439s) [noise=true , address=185.167.204.205:4006 , piece_id=UBVRDRVJ4A3UN6XUNR3CEKWQFM3OKPCYVWDUTGSQUG47BYW32FQQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, address:185.167.204.205:4006): protocol: rpc: dial tcp 185.167.204.205:4006: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220132743 (298h57m2.103546363s) [noise=true , address=185.167.204.205:4011 , piece_id=PX542Q2X6YQCEHSJJCGTQ67VPNHQFUVTGBY2H6A2K2N5LNX6MIOQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220185981 (298h57m2.1035996s) [noise=true , address=185.167.204.205:4024 , piece_id=FVAR6VVKANNWC4EUMBDI2GHMHBIFQZWO7QAIKJXJYQUVMNS5AVHQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:35118->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220252973 (298h57m2.103666593s) [noise=true , address=185.167.204.205:4030 , piece_id=T6XQJHO4KQYI7WBXVDXQ22FMMUWK3EJTCFNS33V4J7NAGVDAAL7A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12w5R2Whxgg4AYNNvTkKmFq4pzahF1uZiVzwgVygc9iZDAXMdSk, address:185.167.204.205:4030): protocol: rpc: dial tcp 185.167.204.205:4030: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.225370789 (298h57m2.108784408s) [noise=true , address=185.167.204.205:4009 , piece_id=OMCAI3O25625Q76QGQ2QH6YND3QFWSCUVBC5M66G63GOWX6HZ5NA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: rpc: dial tcp 185.167.204.205:4009: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jul 5 20:08:02.225430620 (298h57m2.108844238s) [seg_pos={0 0}, upload=239112]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil>
Jul 5 20:08:02.245478781 (298h57m2.128892402s) [upload=239112]: Done uploading segments...
Jul 5 20:08:02.245512127 (298h57m2.128925759s) [upload=239112]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15)
Duration: 493.469367ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
382.795491ms
FAIL (2025-07-05 20:43:16 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 15)
======LOGS======
492 (298h56m2.215210125s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Uploading piece...
Jul 5 20:07:02.431396637 (298h56m2.314810268s) [upload=239112]: Next returned nil segment
Jul 5 20:07:02.431421007 (298h56m2.314834638s) [upload=239112]: Waiting for error group managing segments...
Jul 5 20:07:02.447095606 (298h56m2.330509226s) [noise=true , address=89.149.201.147:4019 , piece_id=MAUEKAJFTZNJMXF57JO2VBOV7L4ZZKILGR65GRDLBSV22K3R2TXA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.448042898 (298h56m2.331456515s) [noise=true , address=89.149.201.147:4024 , piece_id=OT6RRS4XBYINP4QB3RJ7VWPY2AD7GJPAQIW2ATM6ZELXOWA526RQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.449028099 (298h56m2.332441731s) [noise=true , address=89.149.201.147:4005 , piece_id=JQQG4Y45XA3XZMIAKWUPLGEIRBGVNHM5NCWRTULQTVPYXO6FO55Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.450682866 (298h56m2.334096485s) [noise=true , address=81.171.14.70:4034 , piece_id=IFDTTFWJPB636YM4NP6747UFLLZE4KMVLQYO7J4KVY4G6QWSZXSQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.451864269 (298h56m2.335277896s) [noise=true , address=81.171.14.70:4032 , piece_id=O3DKC6N4KXI7IUOVRSJSLP6TW6XDWZNES7BH3KZXAPNUYWC5O2DA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.456410299 (298h56m2.339823915s) [noise=true , address=81.171.14.70:4044 , piece_id=D3LDMEEASIEDNMZWVBYYAVZHRLNQIRGLRDS2LELUCSI52KASMJNQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.457434058 (298h56m2.340847673s) [noise=true , address=81.171.14.70:4027 , piece_id=HSWN54OPPTUAXJ7SNL2QXEEZK2HMSMJSTYWKHL5LBUN2YB4ZB6FQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.461640690 (298h56m2.345054326s) [noise=true , address=89.149.201.147:4023 , piece_id=A663SYQPHVRID3JBQG5BJL4F74AV33U4TYLDGJSXMQIZS5OEXJVQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.470937271 (298h56m2.354350905s) [noise=true , address=89.149.201.147:4011 , piece_id=KJAFCNL5N2D4OUPG3NEVOMWOIHTXG7GZQYXKV2DG2GHZ3GELVARA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.479272848 (298h56m2.362686482s) [noise=true , address=81.171.14.70:4028 , piece_id=VVC3RQ2YDSK7BNDCMLVHD4ZOCOA3LDU25UWUD3DZEEID3KSSNEEQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.480764798 (298h56m2.364178415s) [noise=true , address=81.171.14.70:4036 , piece_id=M4HHHX7L3PHNMJJBRF7KITDTOCWMLXMYY7EAB6UZJQZYXEU6AHZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.481062475 (298h56m2.364476092s) [noise=true , address=89.149.201.147:4013 , piece_id=TCB2SEVENWPWROT6UVTQNFBCZQXY2BNGCJJSL5ZVNDCGM6VQ4PCQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.486941056 (298h56m2.37035467s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.488291026 (298h56m2.371704665s) [noise=true , address=89.149.201.147:4015 , piece_id=NBRDDGC23DXKQNGOFZHBJ25I6QI7TZYUJ5XCENKCJOJO6CE2QFPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.524985461 (298h56m2.40839908s) [noise=true , address=89.149.201.147:4002 , piece_id=2LMWF6FTCFJFTMZQK2SK4KBRDDYVJTSXNKM5A6FK6KOCRPXDYRUA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:08:02.219008955 (298h57m2.102422574s) [noise=true , address=185.167.204.205:4036 , piece_id=6DQYOQ3IEEJEE442KTZ7R3JCLGHJJTSKG4AUZFP5I4G2UOPMLWPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: write tcp 139.59.144.22:51574->185.167.204.205:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219117336 (298h57m2.102530954s) [noise=true , address=185.167.204.205:4013 , piece_id=B3AU5MMLPEFO22IMVEQ3LVEJSA4PFUG6V4GJFE2R3WOMUHH3VGJQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219177020 (298h57m2.102590639s) [noise=true , address=185.167.204.205:4035 , piece_id=EO5BO6VXN6HXRZRQN5TAPTNG4CNXQZXFSNYLCQS3DWCQ53XXIYDA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1TT3Cyz1GPrGa9P9jWePFarF4LFaJfyfRbGM1hH5ctGx65JUJp, address:185.167.204.205:4035): protocol: rpc: dial tcp 185.167.204.205:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219237059 (298h57m2.102650678s) [noise=true , address=185.167.204.206:4054 , piece_id=JBEJ4R5DXATRMFFRTD3C3ONJV2H2JA26ZF2HH7EHG5KJ3BYZ7KSA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219293293 (298h57m2.102706912s) [noise=true , address=185.167.204.205:4002 , piece_id=FMBOS5TD46M5HJKAYM67NI6YUFAD3LQXKIVPTP5GJ4MMKDOX3LGA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: rpc: dial tcp 185.167.204.205:4002: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219349725 (298h57m2.102763345s) [noise=true , address=185.167.204.206:4064 , piece_id=7ZSIBWN4TK6GOGXX5EE5MGCB5OYZWUCP6UUJO6W46IDDBH5PJM4A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219382140 (298h57m2.102795759s) [noise=true , address=185.167.204.206:4052 , piece_id=QTUGBOXPYWCVTZBM7WPLYIIQU62KKJZU76FPRRB2Y4LJVNGPTNZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: rpc: dial tcp 185.167.204.206:4052: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220015537 (298h57m2.103429157s) [noise=true , address=185.167.204.206:4065 , piece_id=IHI3OAB4YGQVXPUE6V72Y5CCRJNARF2GXAKJPQAGX6A7VIQWCS5Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: rpc: dial tcp 185.167.204.206:4065: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220073820 (298h57m2.103487439s) [noise=true , address=185.167.204.205:4006 , piece_id=UBVRDRVJ4A3UN6XUNR3CEKWQFM3OKPCYVWDUTGSQUG47BYW32FQQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, address:185.167.204.205:4006): protocol: rpc: dial tcp 185.167.204.205:4006: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220132743 (298h57m2.103546363s) [noise=true , address=185.167.204.205:4011 , piece_id=PX542Q2X6YQCEHSJJCGTQ67VPNHQFUVTGBY2H6A2K2N5LNX6MIOQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220185981 (298h57m2.1035996s) [noise=true , address=185.167.204.205:4024 , piece_id=FVAR6VVKANNWC4EUMBDI2GHMHBIFQZWO7QAIKJXJYQUVMNS5AVHQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:35118->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220252973 (298h57m2.103666593s) [noise=true , address=185.167.204.205:4030 , piece_id=T6XQJHO4KQYI7WBXVDXQ22FMMUWK3EJTCFNS33V4J7NAGVDAAL7A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12w5R2Whxgg4AYNNvTkKmFq4pzahF1uZiVzwgVygc9iZDAXMdSk, address:185.167.204.205:4030): protocol: rpc: dial tcp 185.167.204.205:4030: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.225370789 (298h57m2.108784408s) [noise=true , address=185.167.204.205:4009 , piece_id=OMCAI3O25625Q76QGQ2QH6YND3QFWSCUVBC5M66G63GOWX6HZ5NA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: rpc: dial tcp 185.167.204.205:4009: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jul 5 20:08:02.225430620 (298h57m2.108844238s) [seg_pos={0 0}, upload=239112]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil>
Jul 5 20:08:02.245478781 (298h57m2.128892402s) [upload=239112]: Done uploading segments...
Jul 5 20:08:02.245512127 (298h57m2.128925759s) [upload=239112]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15)
Duration: 382.830417ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
433.25299ms
FAIL (2025-07-05 20:42:08 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 15)
======LOGS======
492 (298h56m2.215210125s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Uploading piece...
Jul 5 20:07:02.431396637 (298h56m2.314810268s) [upload=239112]: Next returned nil segment
Jul 5 20:07:02.431421007 (298h56m2.314834638s) [upload=239112]: Waiting for error group managing segments...
Jul 5 20:07:02.447095606 (298h56m2.330509226s) [noise=true , address=89.149.201.147:4019 , piece_id=MAUEKAJFTZNJMXF57JO2VBOV7L4ZZKILGR65GRDLBSV22K3R2TXA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.448042898 (298h56m2.331456515s) [noise=true , address=89.149.201.147:4024 , piece_id=OT6RRS4XBYINP4QB3RJ7VWPY2AD7GJPAQIW2ATM6ZELXOWA526RQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.449028099 (298h56m2.332441731s) [noise=true , address=89.149.201.147:4005 , piece_id=JQQG4Y45XA3XZMIAKWUPLGEIRBGVNHM5NCWRTULQTVPYXO6FO55Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.450682866 (298h56m2.334096485s) [noise=true , address=81.171.14.70:4034 , piece_id=IFDTTFWJPB636YM4NP6747UFLLZE4KMVLQYO7J4KVY4G6QWSZXSQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.451864269 (298h56m2.335277896s) [noise=true , address=81.171.14.70:4032 , piece_id=O3DKC6N4KXI7IUOVRSJSLP6TW6XDWZNES7BH3KZXAPNUYWC5O2DA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.456410299 (298h56m2.339823915s) [noise=true , address=81.171.14.70:4044 , piece_id=D3LDMEEASIEDNMZWVBYYAVZHRLNQIRGLRDS2LELUCSI52KASMJNQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.457434058 (298h56m2.340847673s) [noise=true , address=81.171.14.70:4027 , piece_id=HSWN54OPPTUAXJ7SNL2QXEEZK2HMSMJSTYWKHL5LBUN2YB4ZB6FQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.461640690 (298h56m2.345054326s) [noise=true , address=89.149.201.147:4023 , piece_id=A663SYQPHVRID3JBQG5BJL4F74AV33U4TYLDGJSXMQIZS5OEXJVQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.470937271 (298h56m2.354350905s) [noise=true , address=89.149.201.147:4011 , piece_id=KJAFCNL5N2D4OUPG3NEVOMWOIHTXG7GZQYXKV2DG2GHZ3GELVARA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.479272848 (298h56m2.362686482s) [noise=true , address=81.171.14.70:4028 , piece_id=VVC3RQ2YDSK7BNDCMLVHD4ZOCOA3LDU25UWUD3DZEEID3KSSNEEQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.480764798 (298h56m2.364178415s) [noise=true , address=81.171.14.70:4036 , piece_id=M4HHHX7L3PHNMJJBRF7KITDTOCWMLXMYY7EAB6UZJQZYXEU6AHZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.481062475 (298h56m2.364476092s) [noise=true , address=89.149.201.147:4013 , piece_id=TCB2SEVENWPWROT6UVTQNFBCZQXY2BNGCJJSL5ZVNDCGM6VQ4PCQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.486941056 (298h56m2.37035467s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.488291026 (298h56m2.371704665s) [noise=true , address=89.149.201.147:4015 , piece_id=NBRDDGC23DXKQNGOFZHBJ25I6QI7TZYUJ5XCENKCJOJO6CE2QFPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.524985461 (298h56m2.40839908s) [noise=true , address=89.149.201.147:4002 , piece_id=2LMWF6FTCFJFTMZQK2SK4KBRDDYVJTSXNKM5A6FK6KOCRPXDYRUA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:08:02.219008955 (298h57m2.102422574s) [noise=true , address=185.167.204.205:4036 , piece_id=6DQYOQ3IEEJEE442KTZ7R3JCLGHJJTSKG4AUZFP5I4G2UOPMLWPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: write tcp 139.59.144.22:51574->185.167.204.205:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219117336 (298h57m2.102530954s) [noise=true , address=185.167.204.205:4013 , piece_id=B3AU5MMLPEFO22IMVEQ3LVEJSA4PFUG6V4GJFE2R3WOMUHH3VGJQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219177020 (298h57m2.102590639s) [noise=true , address=185.167.204.205:4035 , piece_id=EO5BO6VXN6HXRZRQN5TAPTNG4CNXQZXFSNYLCQS3DWCQ53XXIYDA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1TT3Cyz1GPrGa9P9jWePFarF4LFaJfyfRbGM1hH5ctGx65JUJp, address:185.167.204.205:4035): protocol: rpc: dial tcp 185.167.204.205:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219237059 (298h57m2.102650678s) [noise=true , address=185.167.204.206:4054 , piece_id=JBEJ4R5DXATRMFFRTD3C3ONJV2H2JA26ZF2HH7EHG5KJ3BYZ7KSA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219293293 (298h57m2.102706912s) [noise=true , address=185.167.204.205:4002 , piece_id=FMBOS5TD46M5HJKAYM67NI6YUFAD3LQXKIVPTP5GJ4MMKDOX3LGA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: rpc: dial tcp 185.167.204.205:4002: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219349725 (298h57m2.102763345s) [noise=true , address=185.167.204.206:4064 , piece_id=7ZSIBWN4TK6GOGXX5EE5MGCB5OYZWUCP6UUJO6W46IDDBH5PJM4A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219382140 (298h57m2.102795759s) [noise=true , address=185.167.204.206:4052 , piece_id=QTUGBOXPYWCVTZBM7WPLYIIQU62KKJZU76FPRRB2Y4LJVNGPTNZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: rpc: dial tcp 185.167.204.206:4052: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220015537 (298h57m2.103429157s) [noise=true , address=185.167.204.206:4065 , piece_id=IHI3OAB4YGQVXPUE6V72Y5CCRJNARF2GXAKJPQAGX6A7VIQWCS5Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: rpc: dial tcp 185.167.204.206:4065: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220073820 (298h57m2.103487439s) [noise=true , address=185.167.204.205:4006 , piece_id=UBVRDRVJ4A3UN6XUNR3CEKWQFM3OKPCYVWDUTGSQUG47BYW32FQQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, address:185.167.204.205:4006): protocol: rpc: dial tcp 185.167.204.205:4006: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220132743 (298h57m2.103546363s) [noise=true , address=185.167.204.205:4011 , piece_id=PX542Q2X6YQCEHSJJCGTQ67VPNHQFUVTGBY2H6A2K2N5LNX6MIOQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220185981 (298h57m2.1035996s) [noise=true , address=185.167.204.205:4024 , piece_id=FVAR6VVKANNWC4EUMBDI2GHMHBIFQZWO7QAIKJXJYQUVMNS5AVHQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:35118->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220252973 (298h57m2.103666593s) [noise=true , address=185.167.204.205:4030 , piece_id=T6XQJHO4KQYI7WBXVDXQ22FMMUWK3EJTCFNS33V4J7NAGVDAAL7A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12w5R2Whxgg4AYNNvTkKmFq4pzahF1uZiVzwgVygc9iZDAXMdSk, address:185.167.204.205:4030): protocol: rpc: dial tcp 185.167.204.205:4030: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.225370789 (298h57m2.108784408s) [noise=true , address=185.167.204.205:4009 , piece_id=OMCAI3O25625Q76QGQ2QH6YND3QFWSCUVBC5M66G63GOWX6HZ5NA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: rpc: dial tcp 185.167.204.205:4009: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jul 5 20:08:02.225430620 (298h57m2.108844238s) [seg_pos={0 0}, upload=239112]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil>
Jul 5 20:08:02.245478781 (298h57m2.128892402s) [upload=239112]: Done uploading segments...
Jul 5 20:08:02.245512127 (298h57m2.128925759s) [upload=239112]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15)
Duration: 433.287876ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
427.306491ms
FAIL (2025-07-05 20:40:55 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 15)
======LOGS======
492 (298h56m2.215210125s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Uploading piece...
Jul 5 20:07:02.431396637 (298h56m2.314810268s) [upload=239112]: Next returned nil segment
Jul 5 20:07:02.431421007 (298h56m2.314834638s) [upload=239112]: Waiting for error group managing segments...
Jul 5 20:07:02.447095606 (298h56m2.330509226s) [noise=true , address=89.149.201.147:4019 , piece_id=MAUEKAJFTZNJMXF57JO2VBOV7L4ZZKILGR65GRDLBSV22K3R2TXA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.448042898 (298h56m2.331456515s) [noise=true , address=89.149.201.147:4024 , piece_id=OT6RRS4XBYINP4QB3RJ7VWPY2AD7GJPAQIW2ATM6ZELXOWA526RQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.449028099 (298h56m2.332441731s) [noise=true , address=89.149.201.147:4005 , piece_id=JQQG4Y45XA3XZMIAKWUPLGEIRBGVNHM5NCWRTULQTVPYXO6FO55Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.450682866 (298h56m2.334096485s) [noise=true , address=81.171.14.70:4034 , piece_id=IFDTTFWJPB636YM4NP6747UFLLZE4KMVLQYO7J4KVY4G6QWSZXSQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.451864269 (298h56m2.335277896s) [noise=true , address=81.171.14.70:4032 , piece_id=O3DKC6N4KXI7IUOVRSJSLP6TW6XDWZNES7BH3KZXAPNUYWC5O2DA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.456410299 (298h56m2.339823915s) [noise=true , address=81.171.14.70:4044 , piece_id=D3LDMEEASIEDNMZWVBYYAVZHRLNQIRGLRDS2LELUCSI52KASMJNQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.457434058 (298h56m2.340847673s) [noise=true , address=81.171.14.70:4027 , piece_id=HSWN54OPPTUAXJ7SNL2QXEEZK2HMSMJSTYWKHL5LBUN2YB4ZB6FQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.461640690 (298h56m2.345054326s) [noise=true , address=89.149.201.147:4023 , piece_id=A663SYQPHVRID3JBQG5BJL4F74AV33U4TYLDGJSXMQIZS5OEXJVQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.470937271 (298h56m2.354350905s) [noise=true , address=89.149.201.147:4011 , piece_id=KJAFCNL5N2D4OUPG3NEVOMWOIHTXG7GZQYXKV2DG2GHZ3GELVARA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.479272848 (298h56m2.362686482s) [noise=true , address=81.171.14.70:4028 , piece_id=VVC3RQ2YDSK7BNDCMLVHD4ZOCOA3LDU25UWUD3DZEEID3KSSNEEQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.480764798 (298h56m2.364178415s) [noise=true , address=81.171.14.70:4036 , piece_id=M4HHHX7L3PHNMJJBRF7KITDTOCWMLXMYY7EAB6UZJQZYXEU6AHZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.481062475 (298h56m2.364476092s) [noise=true , address=89.149.201.147:4013 , piece_id=TCB2SEVENWPWROT6UVTQNFBCZQXY2BNGCJJSL5ZVNDCGM6VQ4PCQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.486941056 (298h56m2.37035467s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.488291026 (298h56m2.371704665s) [noise=true , address=89.149.201.147:4015 , piece_id=NBRDDGC23DXKQNGOFZHBJ25I6QI7TZYUJ5XCENKCJOJO6CE2QFPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.524985461 (298h56m2.40839908s) [noise=true , address=89.149.201.147:4002 , piece_id=2LMWF6FTCFJFTMZQK2SK4KBRDDYVJTSXNKM5A6FK6KOCRPXDYRUA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:08:02.219008955 (298h57m2.102422574s) [noise=true , address=185.167.204.205:4036 , piece_id=6DQYOQ3IEEJEE442KTZ7R3JCLGHJJTSKG4AUZFP5I4G2UOPMLWPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: write tcp 139.59.144.22:51574->185.167.204.205:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219117336 (298h57m2.102530954s) [noise=true , address=185.167.204.205:4013 , piece_id=B3AU5MMLPEFO22IMVEQ3LVEJSA4PFUG6V4GJFE2R3WOMUHH3VGJQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219177020 (298h57m2.102590639s) [noise=true , address=185.167.204.205:4035 , piece_id=EO5BO6VXN6HXRZRQN5TAPTNG4CNXQZXFSNYLCQS3DWCQ53XXIYDA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1TT3Cyz1GPrGa9P9jWePFarF4LFaJfyfRbGM1hH5ctGx65JUJp, address:185.167.204.205:4035): protocol: rpc: dial tcp 185.167.204.205:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219237059 (298h57m2.102650678s) [noise=true , address=185.167.204.206:4054 , piece_id=JBEJ4R5DXATRMFFRTD3C3ONJV2H2JA26ZF2HH7EHG5KJ3BYZ7KSA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219293293 (298h57m2.102706912s) [noise=true , address=185.167.204.205:4002 , piece_id=FMBOS5TD46M5HJKAYM67NI6YUFAD3LQXKIVPTP5GJ4MMKDOX3LGA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: rpc: dial tcp 185.167.204.205:4002: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219349725 (298h57m2.102763345s) [noise=true , address=185.167.204.206:4064 , piece_id=7ZSIBWN4TK6GOGXX5EE5MGCB5OYZWUCP6UUJO6W46IDDBH5PJM4A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219382140 (298h57m2.102795759s) [noise=true , address=185.167.204.206:4052 , piece_id=QTUGBOXPYWCVTZBM7WPLYIIQU62KKJZU76FPRRB2Y4LJVNGPTNZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: rpc: dial tcp 185.167.204.206:4052: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220015537 (298h57m2.103429157s) [noise=true , address=185.167.204.206:4065 , piece_id=IHI3OAB4YGQVXPUE6V72Y5CCRJNARF2GXAKJPQAGX6A7VIQWCS5Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: rpc: dial tcp 185.167.204.206:4065: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220073820 (298h57m2.103487439s) [noise=true , address=185.167.204.205:4006 , piece_id=UBVRDRVJ4A3UN6XUNR3CEKWQFM3OKPCYVWDUTGSQUG47BYW32FQQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, address:185.167.204.205:4006): protocol: rpc: dial tcp 185.167.204.205:4006: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220132743 (298h57m2.103546363s) [noise=true , address=185.167.204.205:4011 , piece_id=PX542Q2X6YQCEHSJJCGTQ67VPNHQFUVTGBY2H6A2K2N5LNX6MIOQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220185981 (298h57m2.1035996s) [noise=true , address=185.167.204.205:4024 , piece_id=FVAR6VVKANNWC4EUMBDI2GHMHBIFQZWO7QAIKJXJYQUVMNS5AVHQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:35118->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220252973 (298h57m2.103666593s) [noise=true , address=185.167.204.205:4030 , piece_id=T6XQJHO4KQYI7WBXVDXQ22FMMUWK3EJTCFNS33V4J7NAGVDAAL7A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12w5R2Whxgg4AYNNvTkKmFq4pzahF1uZiVzwgVygc9iZDAXMdSk, address:185.167.204.205:4030): protocol: rpc: dial tcp 185.167.204.205:4030: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.225370789 (298h57m2.108784408s) [noise=true , address=185.167.204.205:4009 , piece_id=OMCAI3O25625Q76QGQ2QH6YND3QFWSCUVBC5M66G63GOWX6HZ5NA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: rpc: dial tcp 185.167.204.205:4009: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jul 5 20:08:02.225430620 (298h57m2.108844238s) [seg_pos={0 0}, upload=239112]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil>
Jul 5 20:08:02.245478781 (298h57m2.128892402s) [upload=239112]: Done uploading segments...
Jul 5 20:08:02.245512127 (298h57m2.128925759s) [upload=239112]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15)
Duration: 427.354147ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
438.990871ms
FAIL (2025-07-05 20:39:46 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 15)
======LOGS======
492 (298h56m2.215210125s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Uploading piece...
Jul 5 20:07:02.431396637 (298h56m2.314810268s) [upload=239112]: Next returned nil segment
Jul 5 20:07:02.431421007 (298h56m2.314834638s) [upload=239112]: Waiting for error group managing segments...
Jul 5 20:07:02.447095606 (298h56m2.330509226s) [noise=true , address=89.149.201.147:4019 , piece_id=MAUEKAJFTZNJMXF57JO2VBOV7L4ZZKILGR65GRDLBSV22K3R2TXA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.448042898 (298h56m2.331456515s) [noise=true , address=89.149.201.147:4024 , piece_id=OT6RRS4XBYINP4QB3RJ7VWPY2AD7GJPAQIW2ATM6ZELXOWA526RQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.449028099 (298h56m2.332441731s) [noise=true , address=89.149.201.147:4005 , piece_id=JQQG4Y45XA3XZMIAKWUPLGEIRBGVNHM5NCWRTULQTVPYXO6FO55Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.450682866 (298h56m2.334096485s) [noise=true , address=81.171.14.70:4034 , piece_id=IFDTTFWJPB636YM4NP6747UFLLZE4KMVLQYO7J4KVY4G6QWSZXSQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.451864269 (298h56m2.335277896s) [noise=true , address=81.171.14.70:4032 , piece_id=O3DKC6N4KXI7IUOVRSJSLP6TW6XDWZNES7BH3KZXAPNUYWC5O2DA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.456410299 (298h56m2.339823915s) [noise=true , address=81.171.14.70:4044 , piece_id=D3LDMEEASIEDNMZWVBYYAVZHRLNQIRGLRDS2LELUCSI52KASMJNQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.457434058 (298h56m2.340847673s) [noise=true , address=81.171.14.70:4027 , piece_id=HSWN54OPPTUAXJ7SNL2QXEEZK2HMSMJSTYWKHL5LBUN2YB4ZB6FQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.461640690 (298h56m2.345054326s) [noise=true , address=89.149.201.147:4023 , piece_id=A663SYQPHVRID3JBQG5BJL4F74AV33U4TYLDGJSXMQIZS5OEXJVQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.470937271 (298h56m2.354350905s) [noise=true , address=89.149.201.147:4011 , piece_id=KJAFCNL5N2D4OUPG3NEVOMWOIHTXG7GZQYXKV2DG2GHZ3GELVARA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.479272848 (298h56m2.362686482s) [noise=true , address=81.171.14.70:4028 , piece_id=VVC3RQ2YDSK7BNDCMLVHD4ZOCOA3LDU25UWUD3DZEEID3KSSNEEQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.480764798 (298h56m2.364178415s) [noise=true , address=81.171.14.70:4036 , piece_id=M4HHHX7L3PHNMJJBRF7KITDTOCWMLXMYY7EAB6UZJQZYXEU6AHZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.481062475 (298h56m2.364476092s) [noise=true , address=89.149.201.147:4013 , piece_id=TCB2SEVENWPWROT6UVTQNFBCZQXY2BNGCJJSL5ZVNDCGM6VQ4PCQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.486941056 (298h56m2.37035467s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.488291026 (298h56m2.371704665s) [noise=true , address=89.149.201.147:4015 , piece_id=NBRDDGC23DXKQNGOFZHBJ25I6QI7TZYUJ5XCENKCJOJO6CE2QFPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.524985461 (298h56m2.40839908s) [noise=true , address=89.149.201.147:4002 , piece_id=2LMWF6FTCFJFTMZQK2SK4KBRDDYVJTSXNKM5A6FK6KOCRPXDYRUA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:08:02.219008955 (298h57m2.102422574s) [noise=true , address=185.167.204.205:4036 , piece_id=6DQYOQ3IEEJEE442KTZ7R3JCLGHJJTSKG4AUZFP5I4G2UOPMLWPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: write tcp 139.59.144.22:51574->185.167.204.205:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219117336 (298h57m2.102530954s) [noise=true , address=185.167.204.205:4013 , piece_id=B3AU5MMLPEFO22IMVEQ3LVEJSA4PFUG6V4GJFE2R3WOMUHH3VGJQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219177020 (298h57m2.102590639s) [noise=true , address=185.167.204.205:4035 , piece_id=EO5BO6VXN6HXRZRQN5TAPTNG4CNXQZXFSNYLCQS3DWCQ53XXIYDA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1TT3Cyz1GPrGa9P9jWePFarF4LFaJfyfRbGM1hH5ctGx65JUJp, address:185.167.204.205:4035): protocol: rpc: dial tcp 185.167.204.205:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219237059 (298h57m2.102650678s) [noise=true , address=185.167.204.206:4054 , piece_id=JBEJ4R5DXATRMFFRTD3C3ONJV2H2JA26ZF2HH7EHG5KJ3BYZ7KSA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219293293 (298h57m2.102706912s) [noise=true , address=185.167.204.205:4002 , piece_id=FMBOS5TD46M5HJKAYM67NI6YUFAD3LQXKIVPTP5GJ4MMKDOX3LGA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: rpc: dial tcp 185.167.204.205:4002: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219349725 (298h57m2.102763345s) [noise=true , address=185.167.204.206:4064 , piece_id=7ZSIBWN4TK6GOGXX5EE5MGCB5OYZWUCP6UUJO6W46IDDBH5PJM4A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219382140 (298h57m2.102795759s) [noise=true , address=185.167.204.206:4052 , piece_id=QTUGBOXPYWCVTZBM7WPLYIIQU62KKJZU76FPRRB2Y4LJVNGPTNZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: rpc: dial tcp 185.167.204.206:4052: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220015537 (298h57m2.103429157s) [noise=true , address=185.167.204.206:4065 , piece_id=IHI3OAB4YGQVXPUE6V72Y5CCRJNARF2GXAKJPQAGX6A7VIQWCS5Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: rpc: dial tcp 185.167.204.206:4065: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220073820 (298h57m2.103487439s) [noise=true , address=185.167.204.205:4006 , piece_id=UBVRDRVJ4A3UN6XUNR3CEKWQFM3OKPCYVWDUTGSQUG47BYW32FQQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, address:185.167.204.205:4006): protocol: rpc: dial tcp 185.167.204.205:4006: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220132743 (298h57m2.103546363s) [noise=true , address=185.167.204.205:4011 , piece_id=PX542Q2X6YQCEHSJJCGTQ67VPNHQFUVTGBY2H6A2K2N5LNX6MIOQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220185981 (298h57m2.1035996s) [noise=true , address=185.167.204.205:4024 , piece_id=FVAR6VVKANNWC4EUMBDI2GHMHBIFQZWO7QAIKJXJYQUVMNS5AVHQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:35118->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220252973 (298h57m2.103666593s) [noise=true , address=185.167.204.205:4030 , piece_id=T6XQJHO4KQYI7WBXVDXQ22FMMUWK3EJTCFNS33V4J7NAGVDAAL7A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12w5R2Whxgg4AYNNvTkKmFq4pzahF1uZiVzwgVygc9iZDAXMdSk, address:185.167.204.205:4030): protocol: rpc: dial tcp 185.167.204.205:4030: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.225370789 (298h57m2.108784408s) [noise=true , address=185.167.204.205:4009 , piece_id=OMCAI3O25625Q76QGQ2QH6YND3QFWSCUVBC5M66G63GOWX6HZ5NA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: rpc: dial tcp 185.167.204.205:4009: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jul 5 20:08:02.225430620 (298h57m2.108844238s) [seg_pos={0 0}, upload=239112]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil>
Jul 5 20:08:02.245478781 (298h57m2.128892402s) [upload=239112]: Done uploading segments...
Jul 5 20:08:02.245512127 (298h57m2.128925759s) [upload=239112]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15)
Duration: 439.021503ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
477.482203ms
FAIL (2025-07-05 20:38:46 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 15)
======LOGS======
492 (298h56m2.215210125s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Uploading piece...
Jul 5 20:07:02.431396637 (298h56m2.314810268s) [upload=239112]: Next returned nil segment
Jul 5 20:07:02.431421007 (298h56m2.314834638s) [upload=239112]: Waiting for error group managing segments...
Jul 5 20:07:02.447095606 (298h56m2.330509226s) [noise=true , address=89.149.201.147:4019 , piece_id=MAUEKAJFTZNJMXF57JO2VBOV7L4ZZKILGR65GRDLBSV22K3R2TXA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.448042898 (298h56m2.331456515s) [noise=true , address=89.149.201.147:4024 , piece_id=OT6RRS4XBYINP4QB3RJ7VWPY2AD7GJPAQIW2ATM6ZELXOWA526RQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.449028099 (298h56m2.332441731s) [noise=true , address=89.149.201.147:4005 , piece_id=JQQG4Y45XA3XZMIAKWUPLGEIRBGVNHM5NCWRTULQTVPYXO6FO55Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.450682866 (298h56m2.334096485s) [noise=true , address=81.171.14.70:4034 , piece_id=IFDTTFWJPB636YM4NP6747UFLLZE4KMVLQYO7J4KVY4G6QWSZXSQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.451864269 (298h56m2.335277896s) [noise=true , address=81.171.14.70:4032 , piece_id=O3DKC6N4KXI7IUOVRSJSLP6TW6XDWZNES7BH3KZXAPNUYWC5O2DA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.456410299 (298h56m2.339823915s) [noise=true , address=81.171.14.70:4044 , piece_id=D3LDMEEASIEDNMZWVBYYAVZHRLNQIRGLRDS2LELUCSI52KASMJNQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.457434058 (298h56m2.340847673s) [noise=true , address=81.171.14.70:4027 , piece_id=HSWN54OPPTUAXJ7SNL2QXEEZK2HMSMJSTYWKHL5LBUN2YB4ZB6FQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.461640690 (298h56m2.345054326s) [noise=true , address=89.149.201.147:4023 , piece_id=A663SYQPHVRID3JBQG5BJL4F74AV33U4TYLDGJSXMQIZS5OEXJVQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.470937271 (298h56m2.354350905s) [noise=true , address=89.149.201.147:4011 , piece_id=KJAFCNL5N2D4OUPG3NEVOMWOIHTXG7GZQYXKV2DG2GHZ3GELVARA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.479272848 (298h56m2.362686482s) [noise=true , address=81.171.14.70:4028 , piece_id=VVC3RQ2YDSK7BNDCMLVHD4ZOCOA3LDU25UWUD3DZEEID3KSSNEEQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.480764798 (298h56m2.364178415s) [noise=true , address=81.171.14.70:4036 , piece_id=M4HHHX7L3PHNMJJBRF7KITDTOCWMLXMYY7EAB6UZJQZYXEU6AHZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.481062475 (298h56m2.364476092s) [noise=true , address=89.149.201.147:4013 , piece_id=TCB2SEVENWPWROT6UVTQNFBCZQXY2BNGCJJSL5ZVNDCGM6VQ4PCQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.486941056 (298h56m2.37035467s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.488291026 (298h56m2.371704665s) [noise=true , address=89.149.201.147:4015 , piece_id=NBRDDGC23DXKQNGOFZHBJ25I6QI7TZYUJ5XCENKCJOJO6CE2QFPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.524985461 (298h56m2.40839908s) [noise=true , address=89.149.201.147:4002 , piece_id=2LMWF6FTCFJFTMZQK2SK4KBRDDYVJTSXNKM5A6FK6KOCRPXDYRUA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:08:02.219008955 (298h57m2.102422574s) [noise=true , address=185.167.204.205:4036 , piece_id=6DQYOQ3IEEJEE442KTZ7R3JCLGHJJTSKG4AUZFP5I4G2UOPMLWPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: write tcp 139.59.144.22:51574->185.167.204.205:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219117336 (298h57m2.102530954s) [noise=true , address=185.167.204.205:4013 , piece_id=B3AU5MMLPEFO22IMVEQ3LVEJSA4PFUG6V4GJFE2R3WOMUHH3VGJQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219177020 (298h57m2.102590639s) [noise=true , address=185.167.204.205:4035 , piece_id=EO5BO6VXN6HXRZRQN5TAPTNG4CNXQZXFSNYLCQS3DWCQ53XXIYDA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1TT3Cyz1GPrGa9P9jWePFarF4LFaJfyfRbGM1hH5ctGx65JUJp, address:185.167.204.205:4035): protocol: rpc: dial tcp 185.167.204.205:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219237059 (298h57m2.102650678s) [noise=true , address=185.167.204.206:4054 , piece_id=JBEJ4R5DXATRMFFRTD3C3ONJV2H2JA26ZF2HH7EHG5KJ3BYZ7KSA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219293293 (298h57m2.102706912s) [noise=true , address=185.167.204.205:4002 , piece_id=FMBOS5TD46M5HJKAYM67NI6YUFAD3LQXKIVPTP5GJ4MMKDOX3LGA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: rpc: dial tcp 185.167.204.205:4002: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219349725 (298h57m2.102763345s) [noise=true , address=185.167.204.206:4064 , piece_id=7ZSIBWN4TK6GOGXX5EE5MGCB5OYZWUCP6UUJO6W46IDDBH5PJM4A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219382140 (298h57m2.102795759s) [noise=true , address=185.167.204.206:4052 , piece_id=QTUGBOXPYWCVTZBM7WPLYIIQU62KKJZU76FPRRB2Y4LJVNGPTNZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: rpc: dial tcp 185.167.204.206:4052: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220015537 (298h57m2.103429157s) [noise=true , address=185.167.204.206:4065 , piece_id=IHI3OAB4YGQVXPUE6V72Y5CCRJNARF2GXAKJPQAGX6A7VIQWCS5Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: rpc: dial tcp 185.167.204.206:4065: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220073820 (298h57m2.103487439s) [noise=true , address=185.167.204.205:4006 , piece_id=UBVRDRVJ4A3UN6XUNR3CEKWQFM3OKPCYVWDUTGSQUG47BYW32FQQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, address:185.167.204.205:4006): protocol: rpc: dial tcp 185.167.204.205:4006: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220132743 (298h57m2.103546363s) [noise=true , address=185.167.204.205:4011 , piece_id=PX542Q2X6YQCEHSJJCGTQ67VPNHQFUVTGBY2H6A2K2N5LNX6MIOQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220185981 (298h57m2.1035996s) [noise=true , address=185.167.204.205:4024 , piece_id=FVAR6VVKANNWC4EUMBDI2GHMHBIFQZWO7QAIKJXJYQUVMNS5AVHQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:35118->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220252973 (298h57m2.103666593s) [noise=true , address=185.167.204.205:4030 , piece_id=T6XQJHO4KQYI7WBXVDXQ22FMMUWK3EJTCFNS33V4J7NAGVDAAL7A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12w5R2Whxgg4AYNNvTkKmFq4pzahF1uZiVzwgVygc9iZDAXMdSk, address:185.167.204.205:4030): protocol: rpc: dial tcp 185.167.204.205:4030: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.225370789 (298h57m2.108784408s) [noise=true , address=185.167.204.205:4009 , piece_id=OMCAI3O25625Q76QGQ2QH6YND3QFWSCUVBC5M66G63GOWX6HZ5NA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: rpc: dial tcp 185.167.204.205:4009: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jul 5 20:08:02.225430620 (298h57m2.108844238s) [seg_pos={0 0}, upload=239112]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil>
Jul 5 20:08:02.245478781 (298h57m2.128892402s) [upload=239112]: Done uploading segments...
Jul 5 20:08:02.245512127 (298h57m2.128925759s) [upload=239112]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15)
Duration: 477.521022ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
597.387424ms
FAIL (2025-07-05 20:38:13 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 15)
======LOGS======
492 (298h56m2.215210125s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Uploading piece...
Jul 5 20:07:02.431396637 (298h56m2.314810268s) [upload=239112]: Next returned nil segment
Jul 5 20:07:02.431421007 (298h56m2.314834638s) [upload=239112]: Waiting for error group managing segments...
Jul 5 20:07:02.447095606 (298h56m2.330509226s) [noise=true , address=89.149.201.147:4019 , piece_id=MAUEKAJFTZNJMXF57JO2VBOV7L4ZZKILGR65GRDLBSV22K3R2TXA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.448042898 (298h56m2.331456515s) [noise=true , address=89.149.201.147:4024 , piece_id=OT6RRS4XBYINP4QB3RJ7VWPY2AD7GJPAQIW2ATM6ZELXOWA526RQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.449028099 (298h56m2.332441731s) [noise=true , address=89.149.201.147:4005 , piece_id=JQQG4Y45XA3XZMIAKWUPLGEIRBGVNHM5NCWRTULQTVPYXO6FO55Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.450682866 (298h56m2.334096485s) [noise=true , address=81.171.14.70:4034 , piece_id=IFDTTFWJPB636YM4NP6747UFLLZE4KMVLQYO7J4KVY4G6QWSZXSQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.451864269 (298h56m2.335277896s) [noise=true , address=81.171.14.70:4032 , piece_id=O3DKC6N4KXI7IUOVRSJSLP6TW6XDWZNES7BH3KZXAPNUYWC5O2DA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.456410299 (298h56m2.339823915s) [noise=true , address=81.171.14.70:4044 , piece_id=D3LDMEEASIEDNMZWVBYYAVZHRLNQIRGLRDS2LELUCSI52KASMJNQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.457434058 (298h56m2.340847673s) [noise=true , address=81.171.14.70:4027 , piece_id=HSWN54OPPTUAXJ7SNL2QXEEZK2HMSMJSTYWKHL5LBUN2YB4ZB6FQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.461640690 (298h56m2.345054326s) [noise=true , address=89.149.201.147:4023 , piece_id=A663SYQPHVRID3JBQG5BJL4F74AV33U4TYLDGJSXMQIZS5OEXJVQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.470937271 (298h56m2.354350905s) [noise=true , address=89.149.201.147:4011 , piece_id=KJAFCNL5N2D4OUPG3NEVOMWOIHTXG7GZQYXKV2DG2GHZ3GELVARA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.479272848 (298h56m2.362686482s) [noise=true , address=81.171.14.70:4028 , piece_id=VVC3RQ2YDSK7BNDCMLVHD4ZOCOA3LDU25UWUD3DZEEID3KSSNEEQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.480764798 (298h56m2.364178415s) [noise=true , address=81.171.14.70:4036 , piece_id=M4HHHX7L3PHNMJJBRF7KITDTOCWMLXMYY7EAB6UZJQZYXEU6AHZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.481062475 (298h56m2.364476092s) [noise=true , address=89.149.201.147:4013 , piece_id=TCB2SEVENWPWROT6UVTQNFBCZQXY2BNGCJJSL5ZVNDCGM6VQ4PCQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.486941056 (298h56m2.37035467s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.488291026 (298h56m2.371704665s) [noise=true , address=89.149.201.147:4015 , piece_id=NBRDDGC23DXKQNGOFZHBJ25I6QI7TZYUJ5XCENKCJOJO6CE2QFPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.524985461 (298h56m2.40839908s) [noise=true , address=89.149.201.147:4002 , piece_id=2LMWF6FTCFJFTMZQK2SK4KBRDDYVJTSXNKM5A6FK6KOCRPXDYRUA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:08:02.219008955 (298h57m2.102422574s) [noise=true , address=185.167.204.205:4036 , piece_id=6DQYOQ3IEEJEE442KTZ7R3JCLGHJJTSKG4AUZFP5I4G2UOPMLWPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: write tcp 139.59.144.22:51574->185.167.204.205:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219117336 (298h57m2.102530954s) [noise=true , address=185.167.204.205:4013 , piece_id=B3AU5MMLPEFO22IMVEQ3LVEJSA4PFUG6V4GJFE2R3WOMUHH3VGJQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219177020 (298h57m2.102590639s) [noise=true , address=185.167.204.205:4035 , piece_id=EO5BO6VXN6HXRZRQN5TAPTNG4CNXQZXFSNYLCQS3DWCQ53XXIYDA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1TT3Cyz1GPrGa9P9jWePFarF4LFaJfyfRbGM1hH5ctGx65JUJp, address:185.167.204.205:4035): protocol: rpc: dial tcp 185.167.204.205:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219237059 (298h57m2.102650678s) [noise=true , address=185.167.204.206:4054 , piece_id=JBEJ4R5DXATRMFFRTD3C3ONJV2H2JA26ZF2HH7EHG5KJ3BYZ7KSA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219293293 (298h57m2.102706912s) [noise=true , address=185.167.204.205:4002 , piece_id=FMBOS5TD46M5HJKAYM67NI6YUFAD3LQXKIVPTP5GJ4MMKDOX3LGA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: rpc: dial tcp 185.167.204.205:4002: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219349725 (298h57m2.102763345s) [noise=true , address=185.167.204.206:4064 , piece_id=7ZSIBWN4TK6GOGXX5EE5MGCB5OYZWUCP6UUJO6W46IDDBH5PJM4A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219382140 (298h57m2.102795759s) [noise=true , address=185.167.204.206:4052 , piece_id=QTUGBOXPYWCVTZBM7WPLYIIQU62KKJZU76FPRRB2Y4LJVNGPTNZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: rpc: dial tcp 185.167.204.206:4052: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220015537 (298h57m2.103429157s) [noise=true , address=185.167.204.206:4065 , piece_id=IHI3OAB4YGQVXPUE6V72Y5CCRJNARF2GXAKJPQAGX6A7VIQWCS5Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: rpc: dial tcp 185.167.204.206:4065: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220073820 (298h57m2.103487439s) [noise=true , address=185.167.204.205:4006 , piece_id=UBVRDRVJ4A3UN6XUNR3CEKWQFM3OKPCYVWDUTGSQUG47BYW32FQQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, address:185.167.204.205:4006): protocol: rpc: dial tcp 185.167.204.205:4006: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220132743 (298h57m2.103546363s) [noise=true , address=185.167.204.205:4011 , piece_id=PX542Q2X6YQCEHSJJCGTQ67VPNHQFUVTGBY2H6A2K2N5LNX6MIOQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220185981 (298h57m2.1035996s) [noise=true , address=185.167.204.205:4024 , piece_id=FVAR6VVKANNWC4EUMBDI2GHMHBIFQZWO7QAIKJXJYQUVMNS5AVHQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:35118->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220252973 (298h57m2.103666593s) [noise=true , address=185.167.204.205:4030 , piece_id=T6XQJHO4KQYI7WBXVDXQ22FMMUWK3EJTCFNS33V4J7NAGVDAAL7A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12w5R2Whxgg4AYNNvTkKmFq4pzahF1uZiVzwgVygc9iZDAXMdSk, address:185.167.204.205:4030): protocol: rpc: dial tcp 185.167.204.205:4030: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.225370789 (298h57m2.108784408s) [noise=true , address=185.167.204.205:4009 , piece_id=OMCAI3O25625Q76QGQ2QH6YND3QFWSCUVBC5M66G63GOWX6HZ5NA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: rpc: dial tcp 185.167.204.205:4009: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jul 5 20:08:02.225430620 (298h57m2.108844238s) [seg_pos={0 0}, upload=239112]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil>
Jul 5 20:08:02.245478781 (298h57m2.128892402s) [upload=239112]: Done uploading segments...
Jul 5 20:08:02.245512127 (298h57m2.128925759s) [upload=239112]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15)
Duration: 597.437395ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
422.531601ms
FAIL (2025-07-05 20:37:52 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 15)
======LOGS======
492 (298h56m2.215210125s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Uploading piece...
Jul 5 20:07:02.431396637 (298h56m2.314810268s) [upload=239112]: Next returned nil segment
Jul 5 20:07:02.431421007 (298h56m2.314834638s) [upload=239112]: Waiting for error group managing segments...
Jul 5 20:07:02.447095606 (298h56m2.330509226s) [noise=true , address=89.149.201.147:4019 , piece_id=MAUEKAJFTZNJMXF57JO2VBOV7L4ZZKILGR65GRDLBSV22K3R2TXA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.448042898 (298h56m2.331456515s) [noise=true , address=89.149.201.147:4024 , piece_id=OT6RRS4XBYINP4QB3RJ7VWPY2AD7GJPAQIW2ATM6ZELXOWA526RQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.449028099 (298h56m2.332441731s) [noise=true , address=89.149.201.147:4005 , piece_id=JQQG4Y45XA3XZMIAKWUPLGEIRBGVNHM5NCWRTULQTVPYXO6FO55Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.450682866 (298h56m2.334096485s) [noise=true , address=81.171.14.70:4034 , piece_id=IFDTTFWJPB636YM4NP6747UFLLZE4KMVLQYO7J4KVY4G6QWSZXSQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.451864269 (298h56m2.335277896s) [noise=true , address=81.171.14.70:4032 , piece_id=O3DKC6N4KXI7IUOVRSJSLP6TW6XDWZNES7BH3KZXAPNUYWC5O2DA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.456410299 (298h56m2.339823915s) [noise=true , address=81.171.14.70:4044 , piece_id=D3LDMEEASIEDNMZWVBYYAVZHRLNQIRGLRDS2LELUCSI52KASMJNQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.457434058 (298h56m2.340847673s) [noise=true , address=81.171.14.70:4027 , piece_id=HSWN54OPPTUAXJ7SNL2QXEEZK2HMSMJSTYWKHL5LBUN2YB4ZB6FQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.461640690 (298h56m2.345054326s) [noise=true , address=89.149.201.147:4023 , piece_id=A663SYQPHVRID3JBQG5BJL4F74AV33U4TYLDGJSXMQIZS5OEXJVQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.470937271 (298h56m2.354350905s) [noise=true , address=89.149.201.147:4011 , piece_id=KJAFCNL5N2D4OUPG3NEVOMWOIHTXG7GZQYXKV2DG2GHZ3GELVARA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.479272848 (298h56m2.362686482s) [noise=true , address=81.171.14.70:4028 , piece_id=VVC3RQ2YDSK7BNDCMLVHD4ZOCOA3LDU25UWUD3DZEEID3KSSNEEQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.480764798 (298h56m2.364178415s) [noise=true , address=81.171.14.70:4036 , piece_id=M4HHHX7L3PHNMJJBRF7KITDTOCWMLXMYY7EAB6UZJQZYXEU6AHZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.481062475 (298h56m2.364476092s) [noise=true , address=89.149.201.147:4013 , piece_id=TCB2SEVENWPWROT6UVTQNFBCZQXY2BNGCJJSL5ZVNDCGM6VQ4PCQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.486941056 (298h56m2.37035467s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.488291026 (298h56m2.371704665s) [noise=true , address=89.149.201.147:4015 , piece_id=NBRDDGC23DXKQNGOFZHBJ25I6QI7TZYUJ5XCENKCJOJO6CE2QFPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.524985461 (298h56m2.40839908s) [noise=true , address=89.149.201.147:4002 , piece_id=2LMWF6FTCFJFTMZQK2SK4KBRDDYVJTSXNKM5A6FK6KOCRPXDYRUA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:08:02.219008955 (298h57m2.102422574s) [noise=true , address=185.167.204.205:4036 , piece_id=6DQYOQ3IEEJEE442KTZ7R3JCLGHJJTSKG4AUZFP5I4G2UOPMLWPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: write tcp 139.59.144.22:51574->185.167.204.205:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219117336 (298h57m2.102530954s) [noise=true , address=185.167.204.205:4013 , piece_id=B3AU5MMLPEFO22IMVEQ3LVEJSA4PFUG6V4GJFE2R3WOMUHH3VGJQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219177020 (298h57m2.102590639s) [noise=true , address=185.167.204.205:4035 , piece_id=EO5BO6VXN6HXRZRQN5TAPTNG4CNXQZXFSNYLCQS3DWCQ53XXIYDA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1TT3Cyz1GPrGa9P9jWePFarF4LFaJfyfRbGM1hH5ctGx65JUJp, address:185.167.204.205:4035): protocol: rpc: dial tcp 185.167.204.205:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219237059 (298h57m2.102650678s) [noise=true , address=185.167.204.206:4054 , piece_id=JBEJ4R5DXATRMFFRTD3C3ONJV2H2JA26ZF2HH7EHG5KJ3BYZ7KSA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219293293 (298h57m2.102706912s) [noise=true , address=185.167.204.205:4002 , piece_id=FMBOS5TD46M5HJKAYM67NI6YUFAD3LQXKIVPTP5GJ4MMKDOX3LGA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: rpc: dial tcp 185.167.204.205:4002: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219349725 (298h57m2.102763345s) [noise=true , address=185.167.204.206:4064 , piece_id=7ZSIBWN4TK6GOGXX5EE5MGCB5OYZWUCP6UUJO6W46IDDBH5PJM4A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219382140 (298h57m2.102795759s) [noise=true , address=185.167.204.206:4052 , piece_id=QTUGBOXPYWCVTZBM7WPLYIIQU62KKJZU76FPRRB2Y4LJVNGPTNZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: rpc: dial tcp 185.167.204.206:4052: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220015537 (298h57m2.103429157s) [noise=true , address=185.167.204.206:4065 , piece_id=IHI3OAB4YGQVXPUE6V72Y5CCRJNARF2GXAKJPQAGX6A7VIQWCS5Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: rpc: dial tcp 185.167.204.206:4065: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220073820 (298h57m2.103487439s) [noise=true , address=185.167.204.205:4006 , piece_id=UBVRDRVJ4A3UN6XUNR3CEKWQFM3OKPCYVWDUTGSQUG47BYW32FQQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, address:185.167.204.205:4006): protocol: rpc: dial tcp 185.167.204.205:4006: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220132743 (298h57m2.103546363s) [noise=true , address=185.167.204.205:4011 , piece_id=PX542Q2X6YQCEHSJJCGTQ67VPNHQFUVTGBY2H6A2K2N5LNX6MIOQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220185981 (298h57m2.1035996s) [noise=true , address=185.167.204.205:4024 , piece_id=FVAR6VVKANNWC4EUMBDI2GHMHBIFQZWO7QAIKJXJYQUVMNS5AVHQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:35118->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220252973 (298h57m2.103666593s) [noise=true , address=185.167.204.205:4030 , piece_id=T6XQJHO4KQYI7WBXVDXQ22FMMUWK3EJTCFNS33V4J7NAGVDAAL7A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12w5R2Whxgg4AYNNvTkKmFq4pzahF1uZiVzwgVygc9iZDAXMdSk, address:185.167.204.205:4030): protocol: rpc: dial tcp 185.167.204.205:4030: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.225370789 (298h57m2.108784408s) [noise=true , address=185.167.204.205:4009 , piece_id=OMCAI3O25625Q76QGQ2QH6YND3QFWSCUVBC5M66G63GOWX6HZ5NA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: rpc: dial tcp 185.167.204.205:4009: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jul 5 20:08:02.225430620 (298h57m2.108844238s) [seg_pos={0 0}, upload=239112]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil>
Jul 5 20:08:02.245478781 (298h57m2.128892402s) [upload=239112]: Done uploading segments...
Jul 5 20:08:02.245512127 (298h57m2.128925759s) [upload=239112]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15)
Duration: 422.620889ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
525.112695ms
FAIL (2025-07-05 20:37:07 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 15)
======LOGS======
492 (298h56m2.215210125s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Uploading piece...
Jul 5 20:07:02.431396637 (298h56m2.314810268s) [upload=239112]: Next returned nil segment
Jul 5 20:07:02.431421007 (298h56m2.314834638s) [upload=239112]: Waiting for error group managing segments...
Jul 5 20:07:02.447095606 (298h56m2.330509226s) [noise=true , address=89.149.201.147:4019 , piece_id=MAUEKAJFTZNJMXF57JO2VBOV7L4ZZKILGR65GRDLBSV22K3R2TXA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.448042898 (298h56m2.331456515s) [noise=true , address=89.149.201.147:4024 , piece_id=OT6RRS4XBYINP4QB3RJ7VWPY2AD7GJPAQIW2ATM6ZELXOWA526RQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.449028099 (298h56m2.332441731s) [noise=true , address=89.149.201.147:4005 , piece_id=JQQG4Y45XA3XZMIAKWUPLGEIRBGVNHM5NCWRTULQTVPYXO6FO55Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.450682866 (298h56m2.334096485s) [noise=true , address=81.171.14.70:4034 , piece_id=IFDTTFWJPB636YM4NP6747UFLLZE4KMVLQYO7J4KVY4G6QWSZXSQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.451864269 (298h56m2.335277896s) [noise=true , address=81.171.14.70:4032 , piece_id=O3DKC6N4KXI7IUOVRSJSLP6TW6XDWZNES7BH3KZXAPNUYWC5O2DA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.456410299 (298h56m2.339823915s) [noise=true , address=81.171.14.70:4044 , piece_id=D3LDMEEASIEDNMZWVBYYAVZHRLNQIRGLRDS2LELUCSI52KASMJNQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.457434058 (298h56m2.340847673s) [noise=true , address=81.171.14.70:4027 , piece_id=HSWN54OPPTUAXJ7SNL2QXEEZK2HMSMJSTYWKHL5LBUN2YB4ZB6FQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.461640690 (298h56m2.345054326s) [noise=true , address=89.149.201.147:4023 , piece_id=A663SYQPHVRID3JBQG5BJL4F74AV33U4TYLDGJSXMQIZS5OEXJVQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.470937271 (298h56m2.354350905s) [noise=true , address=89.149.201.147:4011 , piece_id=KJAFCNL5N2D4OUPG3NEVOMWOIHTXG7GZQYXKV2DG2GHZ3GELVARA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.479272848 (298h56m2.362686482s) [noise=true , address=81.171.14.70:4028 , piece_id=VVC3RQ2YDSK7BNDCMLVHD4ZOCOA3LDU25UWUD3DZEEID3KSSNEEQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.480764798 (298h56m2.364178415s) [noise=true , address=81.171.14.70:4036 , piece_id=M4HHHX7L3PHNMJJBRF7KITDTOCWMLXMYY7EAB6UZJQZYXEU6AHZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.481062475 (298h56m2.364476092s) [noise=true , address=89.149.201.147:4013 , piece_id=TCB2SEVENWPWROT6UVTQNFBCZQXY2BNGCJJSL5ZVNDCGM6VQ4PCQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.486941056 (298h56m2.37035467s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.488291026 (298h56m2.371704665s) [noise=true , address=89.149.201.147:4015 , piece_id=NBRDDGC23DXKQNGOFZHBJ25I6QI7TZYUJ5XCENKCJOJO6CE2QFPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.524985461 (298h56m2.40839908s) [noise=true , address=89.149.201.147:4002 , piece_id=2LMWF6FTCFJFTMZQK2SK4KBRDDYVJTSXNKM5A6FK6KOCRPXDYRUA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:08:02.219008955 (298h57m2.102422574s) [noise=true , address=185.167.204.205:4036 , piece_id=6DQYOQ3IEEJEE442KTZ7R3JCLGHJJTSKG4AUZFP5I4G2UOPMLWPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: write tcp 139.59.144.22:51574->185.167.204.205:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219117336 (298h57m2.102530954s) [noise=true , address=185.167.204.205:4013 , piece_id=B3AU5MMLPEFO22IMVEQ3LVEJSA4PFUG6V4GJFE2R3WOMUHH3VGJQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219177020 (298h57m2.102590639s) [noise=true , address=185.167.204.205:4035 , piece_id=EO5BO6VXN6HXRZRQN5TAPTNG4CNXQZXFSNYLCQS3DWCQ53XXIYDA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1TT3Cyz1GPrGa9P9jWePFarF4LFaJfyfRbGM1hH5ctGx65JUJp, address:185.167.204.205:4035): protocol: rpc: dial tcp 185.167.204.205:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219237059 (298h57m2.102650678s) [noise=true , address=185.167.204.206:4054 , piece_id=JBEJ4R5DXATRMFFRTD3C3ONJV2H2JA26ZF2HH7EHG5KJ3BYZ7KSA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219293293 (298h57m2.102706912s) [noise=true , address=185.167.204.205:4002 , piece_id=FMBOS5TD46M5HJKAYM67NI6YUFAD3LQXKIVPTP5GJ4MMKDOX3LGA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: rpc: dial tcp 185.167.204.205:4002: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219349725 (298h57m2.102763345s) [noise=true , address=185.167.204.206:4064 , piece_id=7ZSIBWN4TK6GOGXX5EE5MGCB5OYZWUCP6UUJO6W46IDDBH5PJM4A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219382140 (298h57m2.102795759s) [noise=true , address=185.167.204.206:4052 , piece_id=QTUGBOXPYWCVTZBM7WPLYIIQU62KKJZU76FPRRB2Y4LJVNGPTNZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: rpc: dial tcp 185.167.204.206:4052: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220015537 (298h57m2.103429157s) [noise=true , address=185.167.204.206:4065 , piece_id=IHI3OAB4YGQVXPUE6V72Y5CCRJNARF2GXAKJPQAGX6A7VIQWCS5Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: rpc: dial tcp 185.167.204.206:4065: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220073820 (298h57m2.103487439s) [noise=true , address=185.167.204.205:4006 , piece_id=UBVRDRVJ4A3UN6XUNR3CEKWQFM3OKPCYVWDUTGSQUG47BYW32FQQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, address:185.167.204.205:4006): protocol: rpc: dial tcp 185.167.204.205:4006: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220132743 (298h57m2.103546363s) [noise=true , address=185.167.204.205:4011 , piece_id=PX542Q2X6YQCEHSJJCGTQ67VPNHQFUVTGBY2H6A2K2N5LNX6MIOQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220185981 (298h57m2.1035996s) [noise=true , address=185.167.204.205:4024 , piece_id=FVAR6VVKANNWC4EUMBDI2GHMHBIFQZWO7QAIKJXJYQUVMNS5AVHQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:35118->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220252973 (298h57m2.103666593s) [noise=true , address=185.167.204.205:4030 , piece_id=T6XQJHO4KQYI7WBXVDXQ22FMMUWK3EJTCFNS33V4J7NAGVDAAL7A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12w5R2Whxgg4AYNNvTkKmFq4pzahF1uZiVzwgVygc9iZDAXMdSk, address:185.167.204.205:4030): protocol: rpc: dial tcp 185.167.204.205:4030: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.225370789 (298h57m2.108784408s) [noise=true , address=185.167.204.205:4009 , piece_id=OMCAI3O25625Q76QGQ2QH6YND3QFWSCUVBC5M66G63GOWX6HZ5NA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: rpc: dial tcp 185.167.204.205:4009: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jul 5 20:08:02.225430620 (298h57m2.108844238s) [seg_pos={0 0}, upload=239112]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil>
Jul 5 20:08:02.245478781 (298h57m2.128892402s) [upload=239112]: Done uploading segments...
Jul 5 20:08:02.245512127 (298h57m2.128925759s) [upload=239112]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15)
Duration: 542.555595ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
420.355945ms
FAIL (2025-07-05 20:36:46 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 15)
======LOGS======
492 (298h56m2.215210125s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Uploading piece...
Jul 5 20:07:02.431396637 (298h56m2.314810268s) [upload=239112]: Next returned nil segment
Jul 5 20:07:02.431421007 (298h56m2.314834638s) [upload=239112]: Waiting for error group managing segments...
Jul 5 20:07:02.447095606 (298h56m2.330509226s) [noise=true , address=89.149.201.147:4019 , piece_id=MAUEKAJFTZNJMXF57JO2VBOV7L4ZZKILGR65GRDLBSV22K3R2TXA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.448042898 (298h56m2.331456515s) [noise=true , address=89.149.201.147:4024 , piece_id=OT6RRS4XBYINP4QB3RJ7VWPY2AD7GJPAQIW2ATM6ZELXOWA526RQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.449028099 (298h56m2.332441731s) [noise=true , address=89.149.201.147:4005 , piece_id=JQQG4Y45XA3XZMIAKWUPLGEIRBGVNHM5NCWRTULQTVPYXO6FO55Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.450682866 (298h56m2.334096485s) [noise=true , address=81.171.14.70:4034 , piece_id=IFDTTFWJPB636YM4NP6747UFLLZE4KMVLQYO7J4KVY4G6QWSZXSQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.451864269 (298h56m2.335277896s) [noise=true , address=81.171.14.70:4032 , piece_id=O3DKC6N4KXI7IUOVRSJSLP6TW6XDWZNES7BH3KZXAPNUYWC5O2DA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.456410299 (298h56m2.339823915s) [noise=true , address=81.171.14.70:4044 , piece_id=D3LDMEEASIEDNMZWVBYYAVZHRLNQIRGLRDS2LELUCSI52KASMJNQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.457434058 (298h56m2.340847673s) [noise=true , address=81.171.14.70:4027 , piece_id=HSWN54OPPTUAXJ7SNL2QXEEZK2HMSMJSTYWKHL5LBUN2YB4ZB6FQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.461640690 (298h56m2.345054326s) [noise=true , address=89.149.201.147:4023 , piece_id=A663SYQPHVRID3JBQG5BJL4F74AV33U4TYLDGJSXMQIZS5OEXJVQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.470937271 (298h56m2.354350905s) [noise=true , address=89.149.201.147:4011 , piece_id=KJAFCNL5N2D4OUPG3NEVOMWOIHTXG7GZQYXKV2DG2GHZ3GELVARA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.479272848 (298h56m2.362686482s) [noise=true , address=81.171.14.70:4028 , piece_id=VVC3RQ2YDSK7BNDCMLVHD4ZOCOA3LDU25UWUD3DZEEID3KSSNEEQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.480764798 (298h56m2.364178415s) [noise=true , address=81.171.14.70:4036 , piece_id=M4HHHX7L3PHNMJJBRF7KITDTOCWMLXMYY7EAB6UZJQZYXEU6AHZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.481062475 (298h56m2.364476092s) [noise=true , address=89.149.201.147:4013 , piece_id=TCB2SEVENWPWROT6UVTQNFBCZQXY2BNGCJJSL5ZVNDCGM6VQ4PCQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.486941056 (298h56m2.37035467s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.488291026 (298h56m2.371704665s) [noise=true , address=89.149.201.147:4015 , piece_id=NBRDDGC23DXKQNGOFZHBJ25I6QI7TZYUJ5XCENKCJOJO6CE2QFPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.524985461 (298h56m2.40839908s) [noise=true , address=89.149.201.147:4002 , piece_id=2LMWF6FTCFJFTMZQK2SK4KBRDDYVJTSXNKM5A6FK6KOCRPXDYRUA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:08:02.219008955 (298h57m2.102422574s) [noise=true , address=185.167.204.205:4036 , piece_id=6DQYOQ3IEEJEE442KTZ7R3JCLGHJJTSKG4AUZFP5I4G2UOPMLWPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: write tcp 139.59.144.22:51574->185.167.204.205:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219117336 (298h57m2.102530954s) [noise=true , address=185.167.204.205:4013 , piece_id=B3AU5MMLPEFO22IMVEQ3LVEJSA4PFUG6V4GJFE2R3WOMUHH3VGJQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219177020 (298h57m2.102590639s) [noise=true , address=185.167.204.205:4035 , piece_id=EO5BO6VXN6HXRZRQN5TAPTNG4CNXQZXFSNYLCQS3DWCQ53XXIYDA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1TT3Cyz1GPrGa9P9jWePFarF4LFaJfyfRbGM1hH5ctGx65JUJp, address:185.167.204.205:4035): protocol: rpc: dial tcp 185.167.204.205:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219237059 (298h57m2.102650678s) [noise=true , address=185.167.204.206:4054 , piece_id=JBEJ4R5DXATRMFFRTD3C3ONJV2H2JA26ZF2HH7EHG5KJ3BYZ7KSA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219293293 (298h57m2.102706912s) [noise=true , address=185.167.204.205:4002 , piece_id=FMBOS5TD46M5HJKAYM67NI6YUFAD3LQXKIVPTP5GJ4MMKDOX3LGA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: rpc: dial tcp 185.167.204.205:4002: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219349725 (298h57m2.102763345s) [noise=true , address=185.167.204.206:4064 , piece_id=7ZSIBWN4TK6GOGXX5EE5MGCB5OYZWUCP6UUJO6W46IDDBH5PJM4A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219382140 (298h57m2.102795759s) [noise=true , address=185.167.204.206:4052 , piece_id=QTUGBOXPYWCVTZBM7WPLYIIQU62KKJZU76FPRRB2Y4LJVNGPTNZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: rpc: dial tcp 185.167.204.206:4052: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220015537 (298h57m2.103429157s) [noise=true , address=185.167.204.206:4065 , piece_id=IHI3OAB4YGQVXPUE6V72Y5CCRJNARF2GXAKJPQAGX6A7VIQWCS5Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: rpc: dial tcp 185.167.204.206:4065: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220073820 (298h57m2.103487439s) [noise=true , address=185.167.204.205:4006 , piece_id=UBVRDRVJ4A3UN6XUNR3CEKWQFM3OKPCYVWDUTGSQUG47BYW32FQQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, address:185.167.204.205:4006): protocol: rpc: dial tcp 185.167.204.205:4006: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220132743 (298h57m2.103546363s) [noise=true , address=185.167.204.205:4011 , piece_id=PX542Q2X6YQCEHSJJCGTQ67VPNHQFUVTGBY2H6A2K2N5LNX6MIOQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220185981 (298h57m2.1035996s) [noise=true , address=185.167.204.205:4024 , piece_id=FVAR6VVKANNWC4EUMBDI2GHMHBIFQZWO7QAIKJXJYQUVMNS5AVHQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:35118->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220252973 (298h57m2.103666593s) [noise=true , address=185.167.204.205:4030 , piece_id=T6XQJHO4KQYI7WBXVDXQ22FMMUWK3EJTCFNS33V4J7NAGVDAAL7A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12w5R2Whxgg4AYNNvTkKmFq4pzahF1uZiVzwgVygc9iZDAXMdSk, address:185.167.204.205:4030): protocol: rpc: dial tcp 185.167.204.205:4030: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.225370789 (298h57m2.108784408s) [noise=true , address=185.167.204.205:4009 , piece_id=OMCAI3O25625Q76QGQ2QH6YND3QFWSCUVBC5M66G63GOWX6HZ5NA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: rpc: dial tcp 185.167.204.205:4009: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jul 5 20:08:02.225430620 (298h57m2.108844238s) [seg_pos={0 0}, upload=239112]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil>
Jul 5 20:08:02.245478781 (298h57m2.128892402s) [upload=239112]: Done uploading segments...
Jul 5 20:08:02.245512127 (298h57m2.128925759s) [upload=239112]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15)
Duration: 420.46148ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
405.103151ms
FAIL (2025-07-05 20:36:07 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 15)
======LOGS======
492 (298h56m2.215210125s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Uploading piece...
Jul 5 20:07:02.431396637 (298h56m2.314810268s) [upload=239112]: Next returned nil segment
Jul 5 20:07:02.431421007 (298h56m2.314834638s) [upload=239112]: Waiting for error group managing segments...
Jul 5 20:07:02.447095606 (298h56m2.330509226s) [noise=true , address=89.149.201.147:4019 , piece_id=MAUEKAJFTZNJMXF57JO2VBOV7L4ZZKILGR65GRDLBSV22K3R2TXA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.448042898 (298h56m2.331456515s) [noise=true , address=89.149.201.147:4024 , piece_id=OT6RRS4XBYINP4QB3RJ7VWPY2AD7GJPAQIW2ATM6ZELXOWA526RQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.449028099 (298h56m2.332441731s) [noise=true , address=89.149.201.147:4005 , piece_id=JQQG4Y45XA3XZMIAKWUPLGEIRBGVNHM5NCWRTULQTVPYXO6FO55Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.450682866 (298h56m2.334096485s) [noise=true , address=81.171.14.70:4034 , piece_id=IFDTTFWJPB636YM4NP6747UFLLZE4KMVLQYO7J4KVY4G6QWSZXSQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.451864269 (298h56m2.335277896s) [noise=true , address=81.171.14.70:4032 , piece_id=O3DKC6N4KXI7IUOVRSJSLP6TW6XDWZNES7BH3KZXAPNUYWC5O2DA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.456410299 (298h56m2.339823915s) [noise=true , address=81.171.14.70:4044 , piece_id=D3LDMEEASIEDNMZWVBYYAVZHRLNQIRGLRDS2LELUCSI52KASMJNQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.457434058 (298h56m2.340847673s) [noise=true , address=81.171.14.70:4027 , piece_id=HSWN54OPPTUAXJ7SNL2QXEEZK2HMSMJSTYWKHL5LBUN2YB4ZB6FQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.461640690 (298h56m2.345054326s) [noise=true , address=89.149.201.147:4023 , piece_id=A663SYQPHVRID3JBQG5BJL4F74AV33U4TYLDGJSXMQIZS5OEXJVQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.470937271 (298h56m2.354350905s) [noise=true , address=89.149.201.147:4011 , piece_id=KJAFCNL5N2D4OUPG3NEVOMWOIHTXG7GZQYXKV2DG2GHZ3GELVARA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.479272848 (298h56m2.362686482s) [noise=true , address=81.171.14.70:4028 , piece_id=VVC3RQ2YDSK7BNDCMLVHD4ZOCOA3LDU25UWUD3DZEEID3KSSNEEQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.480764798 (298h56m2.364178415s) [noise=true , address=81.171.14.70:4036 , piece_id=M4HHHX7L3PHNMJJBRF7KITDTOCWMLXMYY7EAB6UZJQZYXEU6AHZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.481062475 (298h56m2.364476092s) [noise=true , address=89.149.201.147:4013 , piece_id=TCB2SEVENWPWROT6UVTQNFBCZQXY2BNGCJJSL5ZVNDCGM6VQ4PCQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.486941056 (298h56m2.37035467s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.488291026 (298h56m2.371704665s) [noise=true , address=89.149.201.147:4015 , piece_id=NBRDDGC23DXKQNGOFZHBJ25I6QI7TZYUJ5XCENKCJOJO6CE2QFPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.524985461 (298h56m2.40839908s) [noise=true , address=89.149.201.147:4002 , piece_id=2LMWF6FTCFJFTMZQK2SK4KBRDDYVJTSXNKM5A6FK6KOCRPXDYRUA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:08:02.219008955 (298h57m2.102422574s) [noise=true , address=185.167.204.205:4036 , piece_id=6DQYOQ3IEEJEE442KTZ7R3JCLGHJJTSKG4AUZFP5I4G2UOPMLWPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: write tcp 139.59.144.22:51574->185.167.204.205:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219117336 (298h57m2.102530954s) [noise=true , address=185.167.204.205:4013 , piece_id=B3AU5MMLPEFO22IMVEQ3LVEJSA4PFUG6V4GJFE2R3WOMUHH3VGJQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219177020 (298h57m2.102590639s) [noise=true , address=185.167.204.205:4035 , piece_id=EO5BO6VXN6HXRZRQN5TAPTNG4CNXQZXFSNYLCQS3DWCQ53XXIYDA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1TT3Cyz1GPrGa9P9jWePFarF4LFaJfyfRbGM1hH5ctGx65JUJp, address:185.167.204.205:4035): protocol: rpc: dial tcp 185.167.204.205:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219237059 (298h57m2.102650678s) [noise=true , address=185.167.204.206:4054 , piece_id=JBEJ4R5DXATRMFFRTD3C3ONJV2H2JA26ZF2HH7EHG5KJ3BYZ7KSA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219293293 (298h57m2.102706912s) [noise=true , address=185.167.204.205:4002 , piece_id=FMBOS5TD46M5HJKAYM67NI6YUFAD3LQXKIVPTP5GJ4MMKDOX3LGA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: rpc: dial tcp 185.167.204.205:4002: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219349725 (298h57m2.102763345s) [noise=true , address=185.167.204.206:4064 , piece_id=7ZSIBWN4TK6GOGXX5EE5MGCB5OYZWUCP6UUJO6W46IDDBH5PJM4A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219382140 (298h57m2.102795759s) [noise=true , address=185.167.204.206:4052 , piece_id=QTUGBOXPYWCVTZBM7WPLYIIQU62KKJZU76FPRRB2Y4LJVNGPTNZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: rpc: dial tcp 185.167.204.206:4052: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220015537 (298h57m2.103429157s) [noise=true , address=185.167.204.206:4065 , piece_id=IHI3OAB4YGQVXPUE6V72Y5CCRJNARF2GXAKJPQAGX6A7VIQWCS5Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: rpc: dial tcp 185.167.204.206:4065: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220073820 (298h57m2.103487439s) [noise=true , address=185.167.204.205:4006 , piece_id=UBVRDRVJ4A3UN6XUNR3CEKWQFM3OKPCYVWDUTGSQUG47BYW32FQQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, address:185.167.204.205:4006): protocol: rpc: dial tcp 185.167.204.205:4006: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220132743 (298h57m2.103546363s) [noise=true , address=185.167.204.205:4011 , piece_id=PX542Q2X6YQCEHSJJCGTQ67VPNHQFUVTGBY2H6A2K2N5LNX6MIOQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220185981 (298h57m2.1035996s) [noise=true , address=185.167.204.205:4024 , piece_id=FVAR6VVKANNWC4EUMBDI2GHMHBIFQZWO7QAIKJXJYQUVMNS5AVHQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:35118->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220252973 (298h57m2.103666593s) [noise=true , address=185.167.204.205:4030 , piece_id=T6XQJHO4KQYI7WBXVDXQ22FMMUWK3EJTCFNS33V4J7NAGVDAAL7A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12w5R2Whxgg4AYNNvTkKmFq4pzahF1uZiVzwgVygc9iZDAXMdSk, address:185.167.204.205:4030): protocol: rpc: dial tcp 185.167.204.205:4030: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.225370789 (298h57m2.108784408s) [noise=true , address=185.167.204.205:4009 , piece_id=OMCAI3O25625Q76QGQ2QH6YND3QFWSCUVBC5M66G63GOWX6HZ5NA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: rpc: dial tcp 185.167.204.205:4009: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jul 5 20:08:02.225430620 (298h57m2.108844238s) [seg_pos={0 0}, upload=239112]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil>
Jul 5 20:08:02.245478781 (298h57m2.128892402s) [upload=239112]: Done uploading segments...
Jul 5 20:08:02.245512127 (298h57m2.128925759s) [upload=239112]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15)
Duration: 405.134502ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
409.150802ms
FAIL (2025-07-05 20:35:47 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 15)
======LOGS======
492 (298h56m2.215210125s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Uploading piece...
Jul 5 20:07:02.431396637 (298h56m2.314810268s) [upload=239112]: Next returned nil segment
Jul 5 20:07:02.431421007 (298h56m2.314834638s) [upload=239112]: Waiting for error group managing segments...
Jul 5 20:07:02.447095606 (298h56m2.330509226s) [noise=true , address=89.149.201.147:4019 , piece_id=MAUEKAJFTZNJMXF57JO2VBOV7L4ZZKILGR65GRDLBSV22K3R2TXA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.448042898 (298h56m2.331456515s) [noise=true , address=89.149.201.147:4024 , piece_id=OT6RRS4XBYINP4QB3RJ7VWPY2AD7GJPAQIW2ATM6ZELXOWA526RQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.449028099 (298h56m2.332441731s) [noise=true , address=89.149.201.147:4005 , piece_id=JQQG4Y45XA3XZMIAKWUPLGEIRBGVNHM5NCWRTULQTVPYXO6FO55Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.450682866 (298h56m2.334096485s) [noise=true , address=81.171.14.70:4034 , piece_id=IFDTTFWJPB636YM4NP6747UFLLZE4KMVLQYO7J4KVY4G6QWSZXSQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.451864269 (298h56m2.335277896s) [noise=true , address=81.171.14.70:4032 , piece_id=O3DKC6N4KXI7IUOVRSJSLP6TW6XDWZNES7BH3KZXAPNUYWC5O2DA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.456410299 (298h56m2.339823915s) [noise=true , address=81.171.14.70:4044 , piece_id=D3LDMEEASIEDNMZWVBYYAVZHRLNQIRGLRDS2LELUCSI52KASMJNQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.457434058 (298h56m2.340847673s) [noise=true , address=81.171.14.70:4027 , piece_id=HSWN54OPPTUAXJ7SNL2QXEEZK2HMSMJSTYWKHL5LBUN2YB4ZB6FQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.461640690 (298h56m2.345054326s) [noise=true , address=89.149.201.147:4023 , piece_id=A663SYQPHVRID3JBQG5BJL4F74AV33U4TYLDGJSXMQIZS5OEXJVQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.470937271 (298h56m2.354350905s) [noise=true , address=89.149.201.147:4011 , piece_id=KJAFCNL5N2D4OUPG3NEVOMWOIHTXG7GZQYXKV2DG2GHZ3GELVARA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.479272848 (298h56m2.362686482s) [noise=true , address=81.171.14.70:4028 , piece_id=VVC3RQ2YDSK7BNDCMLVHD4ZOCOA3LDU25UWUD3DZEEID3KSSNEEQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.480764798 (298h56m2.364178415s) [noise=true , address=81.171.14.70:4036 , piece_id=M4HHHX7L3PHNMJJBRF7KITDTOCWMLXMYY7EAB6UZJQZYXEU6AHZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.481062475 (298h56m2.364476092s) [noise=true , address=89.149.201.147:4013 , piece_id=TCB2SEVENWPWROT6UVTQNFBCZQXY2BNGCJJSL5ZVNDCGM6VQ4PCQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.486941056 (298h56m2.37035467s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.488291026 (298h56m2.371704665s) [noise=true , address=89.149.201.147:4015 , piece_id=NBRDDGC23DXKQNGOFZHBJ25I6QI7TZYUJ5XCENKCJOJO6CE2QFPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.524985461 (298h56m2.40839908s) [noise=true , address=89.149.201.147:4002 , piece_id=2LMWF6FTCFJFTMZQK2SK4KBRDDYVJTSXNKM5A6FK6KOCRPXDYRUA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:08:02.219008955 (298h57m2.102422574s) [noise=true , address=185.167.204.205:4036 , piece_id=6DQYOQ3IEEJEE442KTZ7R3JCLGHJJTSKG4AUZFP5I4G2UOPMLWPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: write tcp 139.59.144.22:51574->185.167.204.205:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219117336 (298h57m2.102530954s) [noise=true , address=185.167.204.205:4013 , piece_id=B3AU5MMLPEFO22IMVEQ3LVEJSA4PFUG6V4GJFE2R3WOMUHH3VGJQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219177020 (298h57m2.102590639s) [noise=true , address=185.167.204.205:4035 , piece_id=EO5BO6VXN6HXRZRQN5TAPTNG4CNXQZXFSNYLCQS3DWCQ53XXIYDA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1TT3Cyz1GPrGa9P9jWePFarF4LFaJfyfRbGM1hH5ctGx65JUJp, address:185.167.204.205:4035): protocol: rpc: dial tcp 185.167.204.205:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219237059 (298h57m2.102650678s) [noise=true , address=185.167.204.206:4054 , piece_id=JBEJ4R5DXATRMFFRTD3C3ONJV2H2JA26ZF2HH7EHG5KJ3BYZ7KSA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219293293 (298h57m2.102706912s) [noise=true , address=185.167.204.205:4002 , piece_id=FMBOS5TD46M5HJKAYM67NI6YUFAD3LQXKIVPTP5GJ4MMKDOX3LGA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: rpc: dial tcp 185.167.204.205:4002: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219349725 (298h57m2.102763345s) [noise=true , address=185.167.204.206:4064 , piece_id=7ZSIBWN4TK6GOGXX5EE5MGCB5OYZWUCP6UUJO6W46IDDBH5PJM4A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219382140 (298h57m2.102795759s) [noise=true , address=185.167.204.206:4052 , piece_id=QTUGBOXPYWCVTZBM7WPLYIIQU62KKJZU76FPRRB2Y4LJVNGPTNZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: rpc: dial tcp 185.167.204.206:4052: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220015537 (298h57m2.103429157s) [noise=true , address=185.167.204.206:4065 , piece_id=IHI3OAB4YGQVXPUE6V72Y5CCRJNARF2GXAKJPQAGX6A7VIQWCS5Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: rpc: dial tcp 185.167.204.206:4065: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220073820 (298h57m2.103487439s) [noise=true , address=185.167.204.205:4006 , piece_id=UBVRDRVJ4A3UN6XUNR3CEKWQFM3OKPCYVWDUTGSQUG47BYW32FQQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, address:185.167.204.205:4006): protocol: rpc: dial tcp 185.167.204.205:4006: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220132743 (298h57m2.103546363s) [noise=true , address=185.167.204.205:4011 , piece_id=PX542Q2X6YQCEHSJJCGTQ67VPNHQFUVTGBY2H6A2K2N5LNX6MIOQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220185981 (298h57m2.1035996s) [noise=true , address=185.167.204.205:4024 , piece_id=FVAR6VVKANNWC4EUMBDI2GHMHBIFQZWO7QAIKJXJYQUVMNS5AVHQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:35118->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220252973 (298h57m2.103666593s) [noise=true , address=185.167.204.205:4030 , piece_id=T6XQJHO4KQYI7WBXVDXQ22FMMUWK3EJTCFNS33V4J7NAGVDAAL7A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12w5R2Whxgg4AYNNvTkKmFq4pzahF1uZiVzwgVygc9iZDAXMdSk, address:185.167.204.205:4030): protocol: rpc: dial tcp 185.167.204.205:4030: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.225370789 (298h57m2.108784408s) [noise=true , address=185.167.204.205:4009 , piece_id=OMCAI3O25625Q76QGQ2QH6YND3QFWSCUVBC5M66G63GOWX6HZ5NA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: rpc: dial tcp 185.167.204.205:4009: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jul 5 20:08:02.225430620 (298h57m2.108844238s) [seg_pos={0 0}, upload=239112]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil>
Jul 5 20:08:02.245478781 (298h57m2.128892402s) [upload=239112]: Done uploading segments...
Jul 5 20:08:02.245512127 (298h57m2.128925759s) [upload=239112]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15)
Duration: 409.192161ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
402.039049ms
FAIL (2025-07-05 20:34:35 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 15)
======LOGS======
492 (298h56m2.215210125s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Uploading piece...
Jul 5 20:07:02.431396637 (298h56m2.314810268s) [upload=239112]: Next returned nil segment
Jul 5 20:07:02.431421007 (298h56m2.314834638s) [upload=239112]: Waiting for error group managing segments...
Jul 5 20:07:02.447095606 (298h56m2.330509226s) [noise=true , address=89.149.201.147:4019 , piece_id=MAUEKAJFTZNJMXF57JO2VBOV7L4ZZKILGR65GRDLBSV22K3R2TXA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.448042898 (298h56m2.331456515s) [noise=true , address=89.149.201.147:4024 , piece_id=OT6RRS4XBYINP4QB3RJ7VWPY2AD7GJPAQIW2ATM6ZELXOWA526RQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.449028099 (298h56m2.332441731s) [noise=true , address=89.149.201.147:4005 , piece_id=JQQG4Y45XA3XZMIAKWUPLGEIRBGVNHM5NCWRTULQTVPYXO6FO55Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.450682866 (298h56m2.334096485s) [noise=true , address=81.171.14.70:4034 , piece_id=IFDTTFWJPB636YM4NP6747UFLLZE4KMVLQYO7J4KVY4G6QWSZXSQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.451864269 (298h56m2.335277896s) [noise=true , address=81.171.14.70:4032 , piece_id=O3DKC6N4KXI7IUOVRSJSLP6TW6XDWZNES7BH3KZXAPNUYWC5O2DA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.456410299 (298h56m2.339823915s) [noise=true , address=81.171.14.70:4044 , piece_id=D3LDMEEASIEDNMZWVBYYAVZHRLNQIRGLRDS2LELUCSI52KASMJNQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.457434058 (298h56m2.340847673s) [noise=true , address=81.171.14.70:4027 , piece_id=HSWN54OPPTUAXJ7SNL2QXEEZK2HMSMJSTYWKHL5LBUN2YB4ZB6FQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.461640690 (298h56m2.345054326s) [noise=true , address=89.149.201.147:4023 , piece_id=A663SYQPHVRID3JBQG5BJL4F74AV33U4TYLDGJSXMQIZS5OEXJVQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.470937271 (298h56m2.354350905s) [noise=true , address=89.149.201.147:4011 , piece_id=KJAFCNL5N2D4OUPG3NEVOMWOIHTXG7GZQYXKV2DG2GHZ3GELVARA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.479272848 (298h56m2.362686482s) [noise=true , address=81.171.14.70:4028 , piece_id=VVC3RQ2YDSK7BNDCMLVHD4ZOCOA3LDU25UWUD3DZEEID3KSSNEEQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.480764798 (298h56m2.364178415s) [noise=true , address=81.171.14.70:4036 , piece_id=M4HHHX7L3PHNMJJBRF7KITDTOCWMLXMYY7EAB6UZJQZYXEU6AHZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.481062475 (298h56m2.364476092s) [noise=true , address=89.149.201.147:4013 , piece_id=TCB2SEVENWPWROT6UVTQNFBCZQXY2BNGCJJSL5ZVNDCGM6VQ4PCQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.486941056 (298h56m2.37035467s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.488291026 (298h56m2.371704665s) [noise=true , address=89.149.201.147:4015 , piece_id=NBRDDGC23DXKQNGOFZHBJ25I6QI7TZYUJ5XCENKCJOJO6CE2QFPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.524985461 (298h56m2.40839908s) [noise=true , address=89.149.201.147:4002 , piece_id=2LMWF6FTCFJFTMZQK2SK4KBRDDYVJTSXNKM5A6FK6KOCRPXDYRUA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:08:02.219008955 (298h57m2.102422574s) [noise=true , address=185.167.204.205:4036 , piece_id=6DQYOQ3IEEJEE442KTZ7R3JCLGHJJTSKG4AUZFP5I4G2UOPMLWPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: write tcp 139.59.144.22:51574->185.167.204.205:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219117336 (298h57m2.102530954s) [noise=true , address=185.167.204.205:4013 , piece_id=B3AU5MMLPEFO22IMVEQ3LVEJSA4PFUG6V4GJFE2R3WOMUHH3VGJQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219177020 (298h57m2.102590639s) [noise=true , address=185.167.204.205:4035 , piece_id=EO5BO6VXN6HXRZRQN5TAPTNG4CNXQZXFSNYLCQS3DWCQ53XXIYDA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1TT3Cyz1GPrGa9P9jWePFarF4LFaJfyfRbGM1hH5ctGx65JUJp, address:185.167.204.205:4035): protocol: rpc: dial tcp 185.167.204.205:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219237059 (298h57m2.102650678s) [noise=true , address=185.167.204.206:4054 , piece_id=JBEJ4R5DXATRMFFRTD3C3ONJV2H2JA26ZF2HH7EHG5KJ3BYZ7KSA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219293293 (298h57m2.102706912s) [noise=true , address=185.167.204.205:4002 , piece_id=FMBOS5TD46M5HJKAYM67NI6YUFAD3LQXKIVPTP5GJ4MMKDOX3LGA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: rpc: dial tcp 185.167.204.205:4002: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219349725 (298h57m2.102763345s) [noise=true , address=185.167.204.206:4064 , piece_id=7ZSIBWN4TK6GOGXX5EE5MGCB5OYZWUCP6UUJO6W46IDDBH5PJM4A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219382140 (298h57m2.102795759s) [noise=true , address=185.167.204.206:4052 , piece_id=QTUGBOXPYWCVTZBM7WPLYIIQU62KKJZU76FPRRB2Y4LJVNGPTNZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: rpc: dial tcp 185.167.204.206:4052: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220015537 (298h57m2.103429157s) [noise=true , address=185.167.204.206:4065 , piece_id=IHI3OAB4YGQVXPUE6V72Y5CCRJNARF2GXAKJPQAGX6A7VIQWCS5Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: rpc: dial tcp 185.167.204.206:4065: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220073820 (298h57m2.103487439s) [noise=true , address=185.167.204.205:4006 , piece_id=UBVRDRVJ4A3UN6XUNR3CEKWQFM3OKPCYVWDUTGSQUG47BYW32FQQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, address:185.167.204.205:4006): protocol: rpc: dial tcp 185.167.204.205:4006: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220132743 (298h57m2.103546363s) [noise=true , address=185.167.204.205:4011 , piece_id=PX542Q2X6YQCEHSJJCGTQ67VPNHQFUVTGBY2H6A2K2N5LNX6MIOQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220185981 (298h57m2.1035996s) [noise=true , address=185.167.204.205:4024 , piece_id=FVAR6VVKANNWC4EUMBDI2GHMHBIFQZWO7QAIKJXJYQUVMNS5AVHQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:35118->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220252973 (298h57m2.103666593s) [noise=true , address=185.167.204.205:4030 , piece_id=T6XQJHO4KQYI7WBXVDXQ22FMMUWK3EJTCFNS33V4J7NAGVDAAL7A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12w5R2Whxgg4AYNNvTkKmFq4pzahF1uZiVzwgVygc9iZDAXMdSk, address:185.167.204.205:4030): protocol: rpc: dial tcp 185.167.204.205:4030: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.225370789 (298h57m2.108784408s) [noise=true , address=185.167.204.205:4009 , piece_id=OMCAI3O25625Q76QGQ2QH6YND3QFWSCUVBC5M66G63GOWX6HZ5NA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: rpc: dial tcp 185.167.204.205:4009: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jul 5 20:08:02.225430620 (298h57m2.108844238s) [seg_pos={0 0}, upload=239112]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil>
Jul 5 20:08:02.245478781 (298h57m2.128892402s) [upload=239112]: Done uploading segments...
Jul 5 20:08:02.245512127 (298h57m2.128925759s) [upload=239112]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15)
Duration: 402.074141ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
374.917391ms
FAIL (2025-07-05 20:33:23 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 15)
======LOGS======
492 (298h56m2.215210125s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Uploading piece...
Jul 5 20:07:02.431396637 (298h56m2.314810268s) [upload=239112]: Next returned nil segment
Jul 5 20:07:02.431421007 (298h56m2.314834638s) [upload=239112]: Waiting for error group managing segments...
Jul 5 20:07:02.447095606 (298h56m2.330509226s) [noise=true , address=89.149.201.147:4019 , piece_id=MAUEKAJFTZNJMXF57JO2VBOV7L4ZZKILGR65GRDLBSV22K3R2TXA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.448042898 (298h56m2.331456515s) [noise=true , address=89.149.201.147:4024 , piece_id=OT6RRS4XBYINP4QB3RJ7VWPY2AD7GJPAQIW2ATM6ZELXOWA526RQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.449028099 (298h56m2.332441731s) [noise=true , address=89.149.201.147:4005 , piece_id=JQQG4Y45XA3XZMIAKWUPLGEIRBGVNHM5NCWRTULQTVPYXO6FO55Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.450682866 (298h56m2.334096485s) [noise=true , address=81.171.14.70:4034 , piece_id=IFDTTFWJPB636YM4NP6747UFLLZE4KMVLQYO7J4KVY4G6QWSZXSQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.451864269 (298h56m2.335277896s) [noise=true , address=81.171.14.70:4032 , piece_id=O3DKC6N4KXI7IUOVRSJSLP6TW6XDWZNES7BH3KZXAPNUYWC5O2DA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.456410299 (298h56m2.339823915s) [noise=true , address=81.171.14.70:4044 , piece_id=D3LDMEEASIEDNMZWVBYYAVZHRLNQIRGLRDS2LELUCSI52KASMJNQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.457434058 (298h56m2.340847673s) [noise=true , address=81.171.14.70:4027 , piece_id=HSWN54OPPTUAXJ7SNL2QXEEZK2HMSMJSTYWKHL5LBUN2YB4ZB6FQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.461640690 (298h56m2.345054326s) [noise=true , address=89.149.201.147:4023 , piece_id=A663SYQPHVRID3JBQG5BJL4F74AV33U4TYLDGJSXMQIZS5OEXJVQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.470937271 (298h56m2.354350905s) [noise=true , address=89.149.201.147:4011 , piece_id=KJAFCNL5N2D4OUPG3NEVOMWOIHTXG7GZQYXKV2DG2GHZ3GELVARA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.479272848 (298h56m2.362686482s) [noise=true , address=81.171.14.70:4028 , piece_id=VVC3RQ2YDSK7BNDCMLVHD4ZOCOA3LDU25UWUD3DZEEID3KSSNEEQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.480764798 (298h56m2.364178415s) [noise=true , address=81.171.14.70:4036 , piece_id=M4HHHX7L3PHNMJJBRF7KITDTOCWMLXMYY7EAB6UZJQZYXEU6AHZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.481062475 (298h56m2.364476092s) [noise=true , address=89.149.201.147:4013 , piece_id=TCB2SEVENWPWROT6UVTQNFBCZQXY2BNGCJJSL5ZVNDCGM6VQ4PCQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.486941056 (298h56m2.37035467s) [noise=true , address=89.149.201.147:4008 , piece_id=VHDOIVNIDASIUA7YC2OR6GCNWA7MSYOZZBGLJDKI4RBMNCBALF2Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.488291026 (298h56m2.371704665s) [noise=true , address=89.149.201.147:4015 , piece_id=NBRDDGC23DXKQNGOFZHBJ25I6QI7TZYUJ5XCENKCJOJO6CE2QFPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:07:02.524985461 (298h56m2.40839908s) [noise=true , address=89.149.201.147:4002 , piece_id=2LMWF6FTCFJFTMZQK2SK4KBRDDYVJTSXNKM5A6FK6KOCRPXDYRUA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: <nil>
Jul 5 20:08:02.219008955 (298h57m2.102422574s) [noise=true , address=185.167.204.205:4036 , piece_id=6DQYOQ3IEEJEE442KTZ7R3JCLGHJJTSKG4AUZFP5I4G2UOPMLWPQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Mngc2aRWoo1ZQGktFfA4DauhKyEFcbRk6dg7nYa1jZUg2srMV, address:185.167.204.205:4036): protocol: write tcp 139.59.144.22:51574->185.167.204.205:4036: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219117336 (298h57m2.102530954s) [noise=true , address=185.167.204.205:4013 , piece_id=B3AU5MMLPEFO22IMVEQ3LVEJSA4PFUG6V4GJFE2R3WOMUHH3VGJQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219177020 (298h57m2.102590639s) [noise=true , address=185.167.204.205:4035 , piece_id=EO5BO6VXN6HXRZRQN5TAPTNG4CNXQZXFSNYLCQS3DWCQ53XXIYDA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1TT3Cyz1GPrGa9P9jWePFarF4LFaJfyfRbGM1hH5ctGx65JUJp, address:185.167.204.205:4035): protocol: rpc: dial tcp 185.167.204.205:4035: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219237059 (298h57m2.102650678s) [noise=true , address=185.167.204.206:4054 , piece_id=JBEJ4R5DXATRMFFRTD3C3ONJV2H2JA26ZF2HH7EHG5KJ3BYZ7KSA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12ExKH4MVQ3r3VHXmBuTWSGAsqp9DyxxsojedEu96rtn4Jwk17u, address:185.167.204.206:4054): protocol: rpc: dial tcp 185.167.204.206:4054: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219293293 (298h57m2.102706912s) [noise=true , address=185.167.204.205:4002 , piece_id=FMBOS5TD46M5HJKAYM67NI6YUFAD3LQXKIVPTP5GJ4MMKDOX3LGA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:122KLY1enErmKthxbRteifu9eqBKwRCwyvmFdM1yErYQnXQpxQ3, address:185.167.204.205:4002): protocol: rpc: dial tcp 185.167.204.205:4002: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219349725 (298h57m2.102763345s) [noise=true , address=185.167.204.206:4064 , piece_id=7ZSIBWN4TK6GOGXX5EE5MGCB5OYZWUCP6UUJO6W46IDDBH5PJM4A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1ZB3emcQntFxpr7zBiE98eesnjoTnNKinw3FPtGU2TgznGakeb, address:185.167.204.206:4064): protocol: rpc: dial tcp 185.167.204.206:4064: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.219382140 (298h57m2.102795759s) [noise=true , address=185.167.204.206:4052 , piece_id=QTUGBOXPYWCVTZBM7WPLYIIQU62KKJZU76FPRRB2Y4LJVNGPTNZQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: rpc: dial tcp 185.167.204.206:4052: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220015537 (298h57m2.103429157s) [noise=true , address=185.167.204.206:4065 , piece_id=IHI3OAB4YGQVXPUE6V72Y5CCRJNARF2GXAKJPQAGX6A7VIQWCS5Q, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12oPo26KZGZr7o7M18KZiX5PMAAMwHK8FPT59y1hSLhkB6z3Lcj, address:185.167.204.206:4065): protocol: rpc: dial tcp 185.167.204.206:4065: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220073820 (298h57m2.103487439s) [noise=true , address=185.167.204.205:4006 , piece_id=UBVRDRVJ4A3UN6XUNR3CEKWQFM3OKPCYVWDUTGSQUG47BYW32FQQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12mQUrzCLU4imW5BNBpkSWnRtUftKav85Xi2RsEBacP31AXJ7R8, address:185.167.204.205:4006): protocol: rpc: dial tcp 185.167.204.205:4006: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220132743 (298h57m2.103546363s) [noise=true , address=185.167.204.205:4011 , piece_id=PX542Q2X6YQCEHSJJCGTQ67VPNHQFUVTGBY2H6A2K2N5LNX6MIOQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: rpc: dial tcp 185.167.204.205:4011: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220185981 (298h57m2.1035996s) [noise=true , address=185.167.204.205:4024 , piece_id=FVAR6VVKANNWC4EUMBDI2GHMHBIFQZWO7QAIKJXJYQUVMNS5AVHQ, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12Wa3aDy81HhCKQiRo9BeZGYZqcVJWbLpN4TxdZaMHuitPSTxLV, address:185.167.204.205:4024): protocol: write tcp 139.59.144.22:35118->185.167.204.205:4024: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.220252973 (298h57m2.103666593s) [noise=true , address=185.167.204.205:4030 , piece_id=T6XQJHO4KQYI7WBXVDXQ22FMMUWK3EJTCFNS33V4J7NAGVDAAL7A, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:12w5R2Whxgg4AYNNvTkKmFq4pzahF1uZiVzwgVygc9iZDAXMdSk, address:185.167.204.205:4030): protocol: rpc: dial tcp 185.167.204.205:4030: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 20:08:02.225370789 (298h57m2.108784408s) [noise=true , address=185.167.204.205:4009 , piece_id=OMCAI3O25625Q76QGQ2QH6YND3QFWSCUVBC5M66G63GOWX6HZ5NA, seg_pos={0 0}, upload=239112]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: rpc: dial tcp 185.167.204.205:4009: i/o timeout; conn closed: op; piecestore: piecestore close: context deadline exceeded
Jul 5 20:08:02.225430620 (298h57m2.108844238s) [seg_pos={0 0}, upload=239112]: Done waiting for segment. successful: 15 optimal: 26 errs: <nil>
Jul 5 20:08:02.245478781 (298h57m2.128892402s) [upload=239112]: Done uploading segments...
Jul 5 20:08:02.245512127 (298h57m2.128925759s) [upload=239112]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 15)
Duration: 374.953676ms
core
uplink
eu-select-1
eu1-placement-15
|