Orbiter History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 482.623332ms FAIL (2025-07-05 21:33:29 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 19) ======LOGS====== s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments... Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil> Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments... Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19) Duration: 482.726224ms core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................X.........X............................] duration: 2.89411924s FAIL (2025-07-05 21:33:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.894158712s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 540.998756ms FAIL (2025-07-05 21:33:02 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 19) ======LOGS====== s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments... Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil> Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments... Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19) Duration: 541.985653ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 477.221505ms FAIL (2025-07-05 21:32:31 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 19) ======LOGS====== s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments... Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil> Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments... Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19) Duration: 477.324215ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 508.90652ms FAIL (2025-07-05 21:32:14 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 19) ======LOGS====== s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments... Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil> Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments... Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19) Duration: 508.954018ms core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................X.........X...........................] duration: 2.78251138s FAIL (2025-07-05 21:32:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.782565682s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 397.420554ms FAIL (2025-07-05 21:31:13 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 19) ======LOGS====== s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments... Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil> Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments... Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19) Duration: 397.464042ms core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................X.........X..........................] duration: 2.80683486s FAIL (2025-07-05 21:31:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.806866447s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................X.........X.........................] duration: 2.966240378s FAIL (2025-07-05 21:30:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.966323127s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 499.958595ms FAIL (2025-07-05 21:30:45 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 19) ======LOGS====== s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments... Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil> Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments... Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19) Duration: 499.99404ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 503.128557ms FAIL (2025-07-05 21:30:11 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 19) ======LOGS====== s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments... Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil> Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments... Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19) Duration: 503.166598ms core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................X.........X........................] duration: 2.8624682s FAIL (2025-07-05 21:29:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.862493286s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 456.797735ms FAIL (2025-07-05 21:29:19 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 19) ======LOGS====== s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments... Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil> Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments... Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19) Duration: 456.840942ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 464.799741ms FAIL (2025-07-05 21:28:50 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 19) ======LOGS====== s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments... Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil> Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments... Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19) Duration: 464.926337ms core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................X.........X.......................] duration: 2.722316246s FAIL (2025-07-05 21:28:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.722354213s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 407.34802ms FAIL (2025-07-05 21:27:46 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 19) ======LOGS====== s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments... Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil> Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments... Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19) Duration: 407.378984ms core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........................X.........X......................] duration: 2.957481753s FAIL (2025-07-05 21:27:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.95761471s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [............................X.........X.....................] duration: 2.725742576s FAIL (2025-07-05 21:27:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.725770903s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 368.108823ms FAIL (2025-07-05 21:26:59 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 19) ======LOGS====== s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments... Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil> Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments... Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19) Duration: 368.150923ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 417.834419ms FAIL (2025-07-05 21:26:43 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 19) ======LOGS====== s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments... Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil> Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments... Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19) Duration: 417.875002ms core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............................X.........X....................] duration: 3.064674712s FAIL (2025-07-05 21:26:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.064712912s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 430.133793ms FAIL (2025-07-05 21:26:11 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 19) ======LOGS====== s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments... Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil> Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments... Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19) Duration: 430.2312ms core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............................X.........X...................] duration: 2.494967473s FAIL (2025-07-05 21:25:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.494994403s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 475.339805ms FAIL (2025-07-05 21:25:07 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 19) ======LOGS====== s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments... Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil> Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments... Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19) Duration: 475.376977ms core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............................X.........X..................] duration: 3.010161313s FAIL (2025-07-05 21:24:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.010189091s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 513.731211ms FAIL (2025-07-05 21:24:09 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 19) ======LOGS====== s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments... Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil> Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments... Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19) Duration: 513.766496ms core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [................................X.........X.................] duration: 2.857610675s FAIL (2025-07-05 21:23:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.857647389s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................................X.........X................] duration: 2.70036642s FAIL (2025-07-05 21:23:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.700396035s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 427.471513ms FAIL (2025-07-05 21:23:01 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 19) ======LOGS====== s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments... Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil> Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments... Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19) Duration: 427.520043ms core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................................X.........X...............] duration: 2.774844655s FAIL (2025-07-05 21:22:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.775147939s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 444.613674ms FAIL (2025-07-05 21:22:39 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 19) ======LOGS====== s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments... Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil> Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments... Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19) Duration: 444.707089ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 369.13745ms FAIL (2025-07-05 21:22:15 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 19) ======LOGS====== s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments... Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil> Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments... Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19) Duration: 369.171907ms core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................................X.........X..............] duration: 3.031881934s FAIL (2025-07-05 21:22:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.031979343s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 428.915395ms FAIL (2025-07-05 21:21:43 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 19) ======LOGS====== s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments... Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil> Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments... Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19) Duration: 428.951001ms core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................................X.........X.............] duration: 2.584752002s FAIL (2025-07-05 21:21:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.584804264s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................................X.........X............] duration: 2.806032724s FAIL (2025-07-05 21:20:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.806088109s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 447.81828ms FAIL (2025-07-05 21:20:36 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 19) ======LOGS====== s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments... Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil> Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments... Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19) Duration: 447.918465ms core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................................X.........X...........] duration: 2.755415862s FAIL (2025-07-05 21:20:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.755445493s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 411.459165ms FAIL (2025-07-05 21:19:58 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 19) ======LOGS====== s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments... Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil> Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments... Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19) Duration: 411.490567ms core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......................................X.........X..........] duration: 2.750452773s FAIL (2025-07-05 21:19:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.750480156s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 457.6758ms FAIL (2025-07-05 21:18:54 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 19) ======LOGS====== s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments... Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil> Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments... Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19) Duration: 457.716201ms core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........................................X.........X.........] duration: 2.828902903s FAIL (2025-07-05 21:18:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.829216753s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................................X.........X........] duration: 2.857345592s FAIL (2025-07-05 21:18:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.857382077s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 495.710694ms FAIL (2025-07-05 21:18:19 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 19) ======LOGS====== s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments... Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil> Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments... Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19) Duration: 495.786721ms core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 1m0.027437859s FAIL (2025-07-05 21:18:05 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 19) ======LOGS====== s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece... Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments... Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil> Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil> Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments... Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19) Duration: 1m0.027472253s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................................X.........X.......] duration: 2.801894771s FAIL (2025-07-05 21:17:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.801926232s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........................................X.........X......] duration: 2.801992545s FAIL (2025-07-05 21:17:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.802021777s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [............................................X.........X.....] duration: 3.124432083s FAIL (2025-07-05 21:16:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.124460542s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............................................X.........X....] duration: 2.696188881s FAIL (2025-07-05 21:15:06 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.696271586s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............................................X.........X...] duration: 2.853037621s FAIL (2025-07-05 21:14:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.853064028s edge gateway us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)