Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....X..........................................X...........] duration:
4.830975145s
FAIL (2025-07-05 21:51:20 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 4.831027665s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
393.660586ms
FAIL (2025-07-05 21:51:12 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 393.698514ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [......X..........................................X..........] duration:
2.85055783s
FAIL (2025-07-05 21:50:32 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.85058256s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
527.802161ms
FAIL (2025-07-05 21:50:00 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 527.834683ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X..........................................X.........] duration:
2.672611265s
FAIL (2025-07-05 21:50:00 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.672701825s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
480.491445ms
FAIL (2025-07-05 21:49:12 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 480.522235ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [........X..........................................X........] duration:
2.894536295s
FAIL (2025-07-05 21:48:48 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.894588154s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
406.370501ms
FAIL (2025-07-05 21:48:37 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 406.402668ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........X..........................................X.......] duration:
3.402580808s
FAIL (2025-07-05 21:48:03 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.402614019s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
435.947753ms
FAIL (2025-07-05 21:47:51 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 435.984482ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [X.........X..........................................X......] duration:
2.66144997s
FAIL (2025-07-05 21:47:31 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.661481854s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
424.305213ms
FAIL (2025-07-05 21:46:53 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 424.339934ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X.........X..........................................X.....] duration:
2.731372346s
FAIL (2025-07-05 21:46:49 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.731397626s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X.........X..........................................X....] duration:
2.571692698s
FAIL (2025-07-05 21:46:26 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.571715619s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X.........X..........................................X...] duration:
2.534731509s
FAIL (2025-07-05 21:46:09 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.534761869s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
487.794282ms
FAIL (2025-07-05 21:45:49 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 487.852029ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X.........X..........................................X..] duration:
3.326186596s
FAIL (2025-07-05 21:45:41 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.326214468s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
449.9606ms
FAIL (2025-07-05 21:45:32 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 450.05386ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X.........X..........................................X.] duration:
3.448003554s
FAIL (2025-07-05 21:45:25 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.448020393s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X.........X..........................................X] duration:
30.000575991s
FAIL (2025-07-05 21:45:22 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.000596946s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
539.038502ms
FAIL (2025-07-05 21:44:46 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 539.184855ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
459.359178ms
FAIL (2025-07-05 21:44:07 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 459.398159ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X.........X..........................................] duration:
2.789960983s
FAIL (2025-07-05 21:44:03 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.789987855s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
571.441213ms
FAIL (2025-07-05 21:43:41 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 571.473709ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [........X.........X.........................................] duration:
2.77242271s
FAIL (2025-07-05 21:43:30 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.772535891s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
443.625871ms
FAIL (2025-07-05 21:43:00 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 443.653074ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
465.801252ms
FAIL (2025-07-05 21:42:30 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 465.841806ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........X.........X........................................] duration:
2.674510632s
FAIL (2025-07-05 21:42:19 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.674541081s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
486.470291ms
FAIL (2025-07-05 21:41:38 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 486.523019ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........X.........X.......................................] duration:
2.532291112s
FAIL (2025-07-05 21:41:24 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.532338s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
429.327054ms
FAIL (2025-07-05 21:40:47 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 429.365177ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........X.........X......................................] duration:
2.750285548s
FAIL (2025-07-05 21:40:47 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.750309005s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
839.587661ms
FAIL (2025-07-05 21:40:04 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 839.623775ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
426.865888ms
FAIL (2025-07-05 21:39:45 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 426.912837ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [............X.........X.....................................] duration:
2.806096764s
FAIL (2025-07-05 21:39:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.806123426s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
436.106545ms
FAIL (2025-07-05 21:39:19 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 436.136893ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............X.........X....................................] duration:
2.637889431s
FAIL (2025-07-05 21:38:50 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.637921833s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............X.........X...................................] duration:
2.674357876s
FAIL (2025-07-05 21:38:19 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.674385293s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
442.572419ms
FAIL (2025-07-05 21:38:18 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 442.604074ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
587.831933ms
FAIL (2025-07-05 21:37:54 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 587.864598ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............X.........X..................................] duration:
3.124507662s
FAIL (2025-07-05 21:37:07 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.124715429s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
439.318682ms
FAIL (2025-07-05 21:36:45 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 439.454153ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [................X.........X.................................] duration:
2.713648755s
FAIL (2025-07-05 21:36:30 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.713678401s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
515.234422ms
FAIL (2025-07-05 21:36:02 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 515.271999ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................X.........X................................] duration:
2.705766487s
FAIL (2025-07-05 21:35:58 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.705791752s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
447.504973ms
FAIL (2025-07-05 21:35:29 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 447.541038ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................X.........X...............................] duration:
2.664564432s
FAIL (2025-07-05 21:34:43 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.664597423s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
393.631002ms
FAIL (2025-07-05 21:34:39 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 26 but got 19)
======LOGS======
s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800295809 (300h6m5.683709438s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.800878180 (300h6m5.684291814s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801263731 (300h6m5.684677366s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.801661655 (300h6m5.685075285s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.802073860 (300h6m5.685487495s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Uploading piece...
Jul 5 21:17:05.883510914 (300h6m5.766924529s) [upload=240049]: Next returned nil segment
Jul 5 21:17:05.883532574 (300h6m5.766946203s) [upload=240049]: Waiting for error group managing segments...
Jul 5 21:17:05.900489546 (300h6m5.783903162s) [noise=true , address=81.171.14.70:4048 , piece_id=WADCPHT4TUY2QONQB2DZLMR65LU2F3I4BZJEOWELLPRHMJELT5VQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.905527892 (300h6m5.788941507s) [noise=true , address=89.149.201.147:4002 , piece_id=XTTZTF7YPTUBUDIZT7QAZOVKWSVGBLELLJRQYK2HQ5JQ5YRBUK4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.912704077 (300h6m5.796117692s) [noise=true , address=89.149.201.147:4021 , piece_id=LE5J27H2XIPCYHL7E3S47L2XFWABY5E66HT7BPTAQADZRCMSAM7A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913263954 (300h6m5.796677569s) [noise=true , address=89.149.201.147:4004 , piece_id=GDOYV6QVTQ7FVTG6CL3ZAVX6UWZIJ5DHURBH7SKU2XDUUQRLKGXA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.913755893 (300h6m5.797169507s) [noise=true , address=89.149.201.147:4001 , piece_id=DEXAMQY24225BWHPSZFX4QXWQ4PMPUZYFFPGWEQ5OLQWXNLSB3QQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914538291 (300h6m5.797951909s) [noise=true , address=81.171.14.70:4025 , piece_id=2MGR3IKTKFAJZYK73DMKF47C2A47QDQNFF5QWGQ3JEDF5PYQVQVQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.914702825 (300h6m5.798116743s) [noise=true , address=89.149.201.147:4008 , piece_id=RORR6GJJ2543KS7IQGVIMVXLAPFV55RS65Q5AGJADWUARGHH5ZAQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919398380 (300h6m5.802812019s) [noise=true , address=89.149.201.147:4011 , piece_id=PCC22TF3TEHOCOCKHQC4Y7BVZT4GITSS6LHDDPELXG6MTEZ2HHCQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.919658347 (300h6m5.803071975s) [noise=true , address=81.171.14.70:4031 , piece_id=K6DVDLLLNMPD25BDREGSV7WQS7AUBDC45UGHUR634CDIAV7DXECA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933009386 (300h6m5.816423002s) [noise=true , address=89.149.201.147:4019 , piece_id=4CGEQT65A63CITMQABD2LSPUULDRZA7LYGOMY3OHKL23WEJJRDKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933291496 (300h6m5.816705125s) [noise=true , address=89.149.201.147:4012 , piece_id=5SS3YLJBLFQTAPZLUKJ2EP7ZSU7STK6QQJIL44KSCNL3LO2KSYEA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933639773 (300h6m5.817053407s) [noise=true , address=89.149.201.147:4009 , piece_id=B2QV34WYXDHGJERGDWCY4L4K3ATDFNROJMMH43XGXKFNMOC4SUNA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.933889789 (300h6m5.817303407s) [noise=true , address=89.149.201.147:4023 , piece_id=66STE2MDQ5QR7IFZUS3QUEYG7AUOUCIH4ATI7OXITU44DA4EZSTQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.941305573 (300h6m5.82471921s) [noise=true , address=89.149.201.147:4010 , piece_id=DAKVEEMRAUHGLKOFXVKRKEPH7D27OTUC7BX5ULC23AJ5JFY5WACQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.944624584 (300h6m5.82803822s) [noise=true , address=81.171.14.70:4037 , piece_id=OK366YVTFXYOQLJQV3QHOALPAU6N5S55VMNVDUYCGRCZT3DIGVKQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.952772441 (300h6m5.836186058s) [noise=true , address=81.171.14.70:4044 , piece_id=YOPF3KCHKAAHTHFYKKO23H52FGZAJPRBFYUPZUV2GC7VFP37W2JQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.954935406 (300h6m5.838349022s) [noise=true , address=81.171.14.70:4039 , piece_id=4VFIT33T3NDBEVGTVLES3MYSFUH4RT5XFL34KHRZLPAZWUCVW3VA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.959148257 (300h6m5.84256187s) [noise=true , address=81.171.14.70:4042 , piece_id=FIRPUCMBTIARUKGMAROFEYX53T65V2CZ3C3GDKO45WDGM32KT7WQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:17:05.964457480 (300h6m5.847871095s) [noise=true , address=81.171.14.70:4043 , piece_id=6U3YZJX3RL7SG5YUKJ5WQS7EQZEY6V5AMDP3SM5FVZYQSML2UI3A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: <nil>
Jul 5 21:18:05.739169213 (300h7m5.62258283s) [noise=true , address=185.167.204.206:4055 , piece_id=TFXUYY23KTV7H52OVD5VNP2US756XKEGGWZCFB4LCWYRY6IXK3JA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12CYRieezm1mjtGchWdPrB2mNaHVRvTS85umjB6cQyYKnvisXSB, address:185.167.204.206:4055): protocol: rpc: dial tcp 185.167.204.206:4055: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739241415 (300h7m5.622655046s) [noise=true , address=185.167.204.205:4020 , piece_id=EYXBP5K7D6YVP6DLL7XLKONWN7AJY5R5H2FTFKHE4KX5YRZJK6SQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12hUxMR4vpUXuoAToGJcWvzaXsU4BcV5BFicueEaYBgyVLPQDoU, address:185.167.204.205:4020): protocol: rpc: dial tcp 185.167.204.205:4020: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739267169 (300h7m5.622680797s) [noise=true , address=185.167.204.206:4043 , piece_id=MKMD2N33YRUGGVN4QLHPTZCRTDCFLTTDQ43UFNVBXTCSL7YBMCOQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1EtbRMgkYPVZWSW6hTfGghxDoetX26Fm1Rw97n49jR1oMYt1kb, address:185.167.204.206:4043): protocol: rpc: dial tcp 185.167.204.206:4043: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739310304 (300h7m5.622723935s) [noise=true , address=185.167.204.206:4068 , piece_id=VTAWERZEKDZKSKBBAMKYHBYFYGLZEEX4E5SOVJ3DSGO73GV6AQ4A, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1sqDsiZKL7g4FbDyc9Ew2ojD1tTLzj4B19ma8hrCvWoTCy4j4D, address:185.167.204.206:4068): protocol: rpc: dial tcp 185.167.204.206:4068: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739351913 (300h7m5.62276553s) [noise=true , address=185.167.204.205:4004 , piece_id=HWGET7CMPTVK5JAGWXVBX3NNYGANRIQV2KLRTV5JORZPHRCPVL4Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ZQ9gXppcqJGQ66ZAu1rm7QHdkJHaLcE3dXtBFiHC68Kffm8Hm, address:185.167.204.205:4004): protocol: rpc: dial tcp 185.167.204.205:4004: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739408628 (300h7m5.622822256s) [noise=true , address=185.167.204.205:4034 , piece_id=2LXQOVR2L2NAOFNVYSTJMCEJF7MJMND22IMZOFSY2ICI5MCBIWRA, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1pRmbsqHeJVQz9zeLEtzcfb7gYRNHFDXHRmqNeApdPkcNX7Wur, address:185.167.204.205:4034): protocol: rpc: dial tcp 185.167.204.205:4034: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739421895 (300h7m5.622835512s) [noise=true , address=185.167.204.206:4062 , piece_id=FCPSCUWWQFFFF4PSMER4NVE2LEQ7U2XYT6YBFU6KBMMYP45UK75Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12BL6XLqsoUGm2FxrTgYTxLZakt2u2CAhZJG82oJ31eaE4vTtMr, address:185.167.204.206:4062): protocol: rpc: dial tcp 185.167.204.206:4062: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739488821 (300h7m5.622902439s) [noise=true , address=185.167.204.205:4028 , piece_id=XO527SZ73WLTBJBFSBBKIOO5KJOWF4IVYKVV6K2HXBCKP26HH74Q, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:1HZoGwBuBh9Kg7gkvH9pfrjtxQurwxdnF7pWfycGuLHrHTSq61, address:185.167.204.205:4028): protocol: rpc: dial tcp 185.167.204.205:4028: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739496399 (300h7m5.622910023s) [noise=true , address=185.167.204.205:4014 , piece_id=ZRHLLUA22O64P4IFKBXKNTWX7W7QOKG5QJCGBMH3NZDFWX2NETBQ, seg_pos={0 0}, upload=240049]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: write tcp 139.59.144.22:51316->185.167.204.205:4014: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Jul 5 21:18:05.739537417 (300h7m5.622951118s) [seg_pos={0 0}, upload=240049]: Done waiting for segment. successful: 19 optimal: 26 errs: <nil>
Jul 5 21:18:05.763515995 (300h7m5.646929623s) [upload=240049]: Done uploading segments...
Jul 5 21:18:05.763569314 (300h7m5.646982945s) [upload=240049]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 19)
Duration: 393.662196ms
core
uplink
eu-select-1
eu1-placement-15
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................X.........X..............................] duration:
3.079244788s
FAIL (2025-07-05 21:34:23 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.079274094s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................X.........X.............................] duration:
2.79658337s
FAIL (2025-07-05 21:33:48 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.796604317s
edge
gateway
us-select-1
|