Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
2.635095789s trace:
https://jaeger.dev.storj.io/trace/449848d9d77db041
FAIL (2025-11-05 18:51:25 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.635132832s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
2.429871203s trace:
https://jaeger.dev.storj.io/trace/1aa3995c171d9952
FAIL (2025-11-05 18:51:17 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Nov 5 18:48:09.999186003 (151h7m12.700778465s) [upload=132923]: Starting upload
Nov 5 18:48:09.999281260 (151h7m12.700873714s) [upload=132923]: Done starting upload
Nov 5 18:48:09.999383134 (151h7m12.700975582s) [upload=132923]: Uploading segments...
Nov 5 18:48:09.999683966 (151h7m12.70127642s) [upload=132923]: Got next segment. Inline: false
Nov 5 18:48:09.999762227 (151h7m12.701354683s) [upload=132923]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Nov 5 18:48:09.999769575 (151h7m12.701362038s) [upload=132923]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Nov 5 18:48:10.112806705 (151h7m12.814399164s) [seg_pos={0 0}, upload=132923]: Begin upload segment...
Nov 5 18:48:10.112889335 (151h7m12.814481795s) [seg_pos={0 0}, upload=132923]: Done begin upload segment.
Nov 5 18:48:10.112922761 (151h7m12.814515222s) [noise=true , address=45.91.116.4:4937 , piece_id=EFXDKND5P3Q3R6CWQIKEAWHQ24ZAKKSPQOEXN3KSHWGGNMQ2H3CA, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.113066946 (151h7m12.814659561s) [noise=true , address=145.79.227.14:4839 , piece_id=E75VU4JLVX7SVHAD5A27GABTQFEYPQSWZIRTN4NTOQZX5NT2KYFQ, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.113814365 (151h7m12.815406833s) [noise=true , address=145.79.227.23:4546 , piece_id=HK5DZGS3IGHSOPWJI7TKATUZ6XXVFQEEDQRB2XUWUZNM4CYIOIGA, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.114349115 (151h7m12.815941576s) [noise=true , address=145.79.227.16:4909 , piece_id=3YMLW6PPZBOHV7DVWB7C5NOPZYB37X7AMQ5J2EPG4L674XABL3LQ, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.116003644 (151h7m12.81759611s) [noise=true , address=145.79.227.9:4367 , piece_id=WERF4EVSV4DYC2GXEVR47E2V6MUXFLCRDV47LGVA2THQNJLE5IZQ, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.116800891 (151h7m12.818393353s) [noise=true , address=45.91.116.11:4117 , piece_id=SDMDKSZCQE4HEBQYMRCDTWLUW7U6Y6H5IJJTO4SZCQKN2IFFFDAA, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.117660535 (151h7m12.819252994s) [noise=true , address=145.79.227.24:4581 , piece_id=UIQMKMO7TZZRUAFFYWEVS6TUPLQNORE2DJBEBTI5S3SDLWXOWIMA, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.118368793 (151h7m12.819961251s) [noise=true , address=45.91.116.4:4939 , piece_id=BNFP47OHWEF76D3BBAOZRGQHS74AT2QSB6UA4IKE4YNTZMFCKGRQ, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.119407601 (151h7m12.821000062s) [noise=true , address=145.79.227.11:4731 , piece_id=GLYF3OHQZRRTOC2IXMHOQBQW5V2IWCU5ZCDMFHFGHLQH2AHYPZSA, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.120766581 (151h7m12.822359041s) [noise=true , address=45.91.116.8:4047 , piece_id=QBYFIHSBXSK6NK72XPLDIQG27HJXYOP5MOYBGUNU6BBMKUEW4DMQ, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.121702233 (151h7m12.823294694s) [noise=true , address=145.79.227.8:4329 , piece_id=P3AOPZKE7NOK7U7TC3BLCAO7APL7EHFCKCQR2PRK5RSEI7MVCUYQ, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.122942618 (151h7m12.824535079s) [noise=true , address=145.79.227.18:4005 , piece_id=4BCPHT4HGQHINMRZUC4XHNAMHPSX22AIY4WLMKGTY6FEC7VX72RQ, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.126037335 (151h7m12.827629795s) [noise=true , address=145.79.227.26:4654 , piece_id=WDGR5HANBRWGHACVYWO3N6SLJPXIGXZRJBBQNRDGRRF6SJMX7XOA, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.128535670 (151h7m12.830128134s) [noise=true , address=145.79.227.21:4473 , piece_id=IZJRCFTU5JDDJAZHDZSINQXEN6X3VIICT4ANT23VXIOSXB2GTKSA, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.131356455 (151h7m12.832948911s) [noise=true , address=145.79.227.30:4761 , piece_id=7FYWLDB7ADJ6L7DIDK7NLRW6ALRIQ3STJQ54UZJ2UZTVNY4YFSWQ, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.133585503 (151h7m12.835177963s) [noise=true , address=77.90.31.10:4518 , piece_id=L4RSU5BAFV2Y4NTV23XLQBUHZTHEFX3IJNOCGCTGP2T447MDZ5EQ, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.728939564 (151h7m13.430532034s) [upload=132923]: Next returned nil segment
Nov 5 18:48:10.728957940 (151h7m13.430550399s) [upload=132923]: Waiting for error group managing segments...
Nov 5 18:48:10.866448476 (151h7m13.568040927s) [noise=true , address=145.79.227.11:4731 , piece_id=GLYF3OHQZRRTOC2IXMHOQBQW5V2IWCU5ZCDMFHFGHLQH2AHYPZSA, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:10.868817227 (151h7m13.57040968s) [noise=true , address=145.79.227.24:4581 , piece_id=UIQMKMO7TZZRUAFFYWEVS6TUPLQNORE2DJBEBTI5S3SDLWXOWIMA, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:10.875245787 (151h7m13.576838251s) [noise=true , address=145.79.227.23:4546 , piece_id=HK5DZGS3IGHSOPWJI7TKATUZ6XXVFQEEDQRB2XUWUZNM4CYIOIGA, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:10.876021062 (151h7m13.577613514s) [noise=true , address=145.79.227.14:4839 , piece_id=E75VU4JLVX7SVHAD5A27GABTQFEYPQSWZIRTN4NTOQZX5NT2KYFQ, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:10.876710147 (151h7m13.57830261s) [noise=true , address=145.79.227.21:4473 , piece_id=IZJRCFTU5JDDJAZHDZSINQXEN6X3VIICT4ANT23VXIOSXB2GTKSA, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:10.877717167 (151h7m13.579309622s) [noise=true , address=145.79.227.8:4329 , piece_id=P3AOPZKE7NOK7U7TC3BLCAO7APL7EHFCKCQR2PRK5RSEI7MVCUYQ, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:10.878446355 (151h7m13.580038813s) [noise=true , address=145.79.227.26:4654 , piece_id=WDGR5HANBRWGHACVYWO3N6SLJPXIGXZRJBBQNRDGRRF6SJMX7XOA, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:10.882107581 (151h7m13.583700035s) [noise=true , address=145.79.227.18:4005 , piece_id=4BCPHT4HGQHINMRZUC4XHNAMHPSX22AIY4WLMKGTY6FEC7VX72RQ, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:10.930825699 (151h7m13.632418161s) [noise=true , address=145.79.227.30:4761 , piece_id=7FYWLDB7ADJ6L7DIDK7NLRW6ALRIQ3STJQ54UZJ2UZTVNY4YFSWQ, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:10.931615073 (151h7m13.63320753s) [noise=true , address=145.79.227.9:4367 , piece_id=WERF4EVSV4DYC2GXEVR47E2V6MUXFLCRDV47LGVA2THQNJLE5IZQ, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:11.374956578 (151h7m14.076549032s) [noise=true , address=145.79.227.16:4909 , piece_id=3YMLW6PPZBOHV7DVWB7C5NOPZYB37X7AMQ5J2EPG4L674XABL3LQ, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:39.710620733 (151h7m42.412213192s) [noise=true , address=45.91.116.4:4937 , piece_id=EFXDKND5P3Q3R6CWQIKEAWHQ24ZAKKSPQOEXN3KSHWGGNMQ2H3CA, seg_pos={0 0}, upload=132923]: Done uploading piece. err: ecclient: upload failed (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq, address:45.91.116.4:4937): protocol: write tcp 139.59.144.22:35734->45.91.116.4:4937: use of closed network connection; write tcp 139.59.144.22:35734->45.91.116.4:4937: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35734->45.91.116.4:4937: use of closed network connection
Nov 5 18:48:39.710807457 (151h7m42.412399911s) [noise=true , address=45.91.116.11:4117 , piece_id=SDMDKSZCQE4HEBQYMRCDTWLUW7U6Y6H5IJJTO4SZCQKN2IFFFDAA, seg_pos={0 0}, upload=132923]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: write tcp 139.59.144.22:44798->45.91.116.11:4117: use of closed network connection; write tcp 139.59.144.22:44798->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44798->45.91.116.11:4117: use of closed network connection
Nov 5 18:48:39.710941231 (151h7m42.412533691s) [noise=true , address=45.91.116.8:4047 , piece_id=QBYFIHSBXSK6NK72XPLDIQG27HJXYOP5MOYBGUNU6BBMKUEW4DMQ, seg_pos={0 0}, upload=132923]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: write tcp 139.59.144.22:57340->45.91.116.8:4047: use of closed network connection; write tcp 139.59.144.22:57340->45.91.116.8:4047: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57340->45.91.116.8:4047: use of closed network connection
Nov 5 18:48:39.710963431 (151h7m42.412555889s) [noise=true , address=77.90.31.10:4518 , piece_id=L4RSU5BAFV2Y4NTV23XLQBUHZTHEFX3IJNOCGCTGP2T447MDZ5EQ, seg_pos={0 0}, upload=132923]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 139.59.144.22:42418->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 18:48:39.711166802 (151h7m42.412759261s) [noise=true , address=45.91.116.4:4939 , piece_id=BNFP47OHWEF76D3BBAOZRGQHS74AT2QSB6UA4IKE4YNTZMFCKGRQ, seg_pos={0 0}, upload=132923]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: read tcp 139.59.144.22:36572->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 18:48:39.711215042 (151h7m42.412807482s) [seg_pos={0 0}, upload=132923]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Nov 5 18:48:39.819221226 (151h7m42.520813674s) [upload=132923]: Done uploading segments...
Nov 5 18:48:39.819255108 (151h7m42.520847559s) [upload=132923]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 2.429899546s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [........................................................X...] duration:
1.765224288s trace:
https://jaeger.dev.storj.io/trace/72a639688f7f6d0b
FAIL (2025-11-05 18:51:14 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.765292545s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.784120578s trace:
https://jaeger.dev.storj.io/trace/449848d9d77db041
FAIL (2025-11-05 18:50:42 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.784155205s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
2.400686093s trace:
https://jaeger.dev.storj.io/trace/1aa3995c171d9952
FAIL (2025-11-05 18:50:35 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Nov 5 18:48:09.999186003 (151h7m12.700778465s) [upload=132923]: Starting upload
Nov 5 18:48:09.999281260 (151h7m12.700873714s) [upload=132923]: Done starting upload
Nov 5 18:48:09.999383134 (151h7m12.700975582s) [upload=132923]: Uploading segments...
Nov 5 18:48:09.999683966 (151h7m12.70127642s) [upload=132923]: Got next segment. Inline: false
Nov 5 18:48:09.999762227 (151h7m12.701354683s) [upload=132923]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Nov 5 18:48:09.999769575 (151h7m12.701362038s) [upload=132923]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Nov 5 18:48:10.112806705 (151h7m12.814399164s) [seg_pos={0 0}, upload=132923]: Begin upload segment...
Nov 5 18:48:10.112889335 (151h7m12.814481795s) [seg_pos={0 0}, upload=132923]: Done begin upload segment.
Nov 5 18:48:10.112922761 (151h7m12.814515222s) [noise=true , address=45.91.116.4:4937 , piece_id=EFXDKND5P3Q3R6CWQIKEAWHQ24ZAKKSPQOEXN3KSHWGGNMQ2H3CA, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.113066946 (151h7m12.814659561s) [noise=true , address=145.79.227.14:4839 , piece_id=E75VU4JLVX7SVHAD5A27GABTQFEYPQSWZIRTN4NTOQZX5NT2KYFQ, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.113814365 (151h7m12.815406833s) [noise=true , address=145.79.227.23:4546 , piece_id=HK5DZGS3IGHSOPWJI7TKATUZ6XXVFQEEDQRB2XUWUZNM4CYIOIGA, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.114349115 (151h7m12.815941576s) [noise=true , address=145.79.227.16:4909 , piece_id=3YMLW6PPZBOHV7DVWB7C5NOPZYB37X7AMQ5J2EPG4L674XABL3LQ, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.116003644 (151h7m12.81759611s) [noise=true , address=145.79.227.9:4367 , piece_id=WERF4EVSV4DYC2GXEVR47E2V6MUXFLCRDV47LGVA2THQNJLE5IZQ, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.116800891 (151h7m12.818393353s) [noise=true , address=45.91.116.11:4117 , piece_id=SDMDKSZCQE4HEBQYMRCDTWLUW7U6Y6H5IJJTO4SZCQKN2IFFFDAA, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.117660535 (151h7m12.819252994s) [noise=true , address=145.79.227.24:4581 , piece_id=UIQMKMO7TZZRUAFFYWEVS6TUPLQNORE2DJBEBTI5S3SDLWXOWIMA, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.118368793 (151h7m12.819961251s) [noise=true , address=45.91.116.4:4939 , piece_id=BNFP47OHWEF76D3BBAOZRGQHS74AT2QSB6UA4IKE4YNTZMFCKGRQ, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.119407601 (151h7m12.821000062s) [noise=true , address=145.79.227.11:4731 , piece_id=GLYF3OHQZRRTOC2IXMHOQBQW5V2IWCU5ZCDMFHFGHLQH2AHYPZSA, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.120766581 (151h7m12.822359041s) [noise=true , address=45.91.116.8:4047 , piece_id=QBYFIHSBXSK6NK72XPLDIQG27HJXYOP5MOYBGUNU6BBMKUEW4DMQ, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.121702233 (151h7m12.823294694s) [noise=true , address=145.79.227.8:4329 , piece_id=P3AOPZKE7NOK7U7TC3BLCAO7APL7EHFCKCQR2PRK5RSEI7MVCUYQ, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.122942618 (151h7m12.824535079s) [noise=true , address=145.79.227.18:4005 , piece_id=4BCPHT4HGQHINMRZUC4XHNAMHPSX22AIY4WLMKGTY6FEC7VX72RQ, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.126037335 (151h7m12.827629795s) [noise=true , address=145.79.227.26:4654 , piece_id=WDGR5HANBRWGHACVYWO3N6SLJPXIGXZRJBBQNRDGRRF6SJMX7XOA, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.128535670 (151h7m12.830128134s) [noise=true , address=145.79.227.21:4473 , piece_id=IZJRCFTU5JDDJAZHDZSINQXEN6X3VIICT4ANT23VXIOSXB2GTKSA, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.131356455 (151h7m12.832948911s) [noise=true , address=145.79.227.30:4761 , piece_id=7FYWLDB7ADJ6L7DIDK7NLRW6ALRIQ3STJQ54UZJ2UZTVNY4YFSWQ, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.133585503 (151h7m12.835177963s) [noise=true , address=77.90.31.10:4518 , piece_id=L4RSU5BAFV2Y4NTV23XLQBUHZTHEFX3IJNOCGCTGP2T447MDZ5EQ, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.728939564 (151h7m13.430532034s) [upload=132923]: Next returned nil segment
Nov 5 18:48:10.728957940 (151h7m13.430550399s) [upload=132923]: Waiting for error group managing segments...
Nov 5 18:48:10.866448476 (151h7m13.568040927s) [noise=true , address=145.79.227.11:4731 , piece_id=GLYF3OHQZRRTOC2IXMHOQBQW5V2IWCU5ZCDMFHFGHLQH2AHYPZSA, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:10.868817227 (151h7m13.57040968s) [noise=true , address=145.79.227.24:4581 , piece_id=UIQMKMO7TZZRUAFFYWEVS6TUPLQNORE2DJBEBTI5S3SDLWXOWIMA, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:10.875245787 (151h7m13.576838251s) [noise=true , address=145.79.227.23:4546 , piece_id=HK5DZGS3IGHSOPWJI7TKATUZ6XXVFQEEDQRB2XUWUZNM4CYIOIGA, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:10.876021062 (151h7m13.577613514s) [noise=true , address=145.79.227.14:4839 , piece_id=E75VU4JLVX7SVHAD5A27GABTQFEYPQSWZIRTN4NTOQZX5NT2KYFQ, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:10.876710147 (151h7m13.57830261s) [noise=true , address=145.79.227.21:4473 , piece_id=IZJRCFTU5JDDJAZHDZSINQXEN6X3VIICT4ANT23VXIOSXB2GTKSA, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:10.877717167 (151h7m13.579309622s) [noise=true , address=145.79.227.8:4329 , piece_id=P3AOPZKE7NOK7U7TC3BLCAO7APL7EHFCKCQR2PRK5RSEI7MVCUYQ, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:10.878446355 (151h7m13.580038813s) [noise=true , address=145.79.227.26:4654 , piece_id=WDGR5HANBRWGHACVYWO3N6SLJPXIGXZRJBBQNRDGRRF6SJMX7XOA, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:10.882107581 (151h7m13.583700035s) [noise=true , address=145.79.227.18:4005 , piece_id=4BCPHT4HGQHINMRZUC4XHNAMHPSX22AIY4WLMKGTY6FEC7VX72RQ, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:10.930825699 (151h7m13.632418161s) [noise=true , address=145.79.227.30:4761 , piece_id=7FYWLDB7ADJ6L7DIDK7NLRW6ALRIQ3STJQ54UZJ2UZTVNY4YFSWQ, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:10.931615073 (151h7m13.63320753s) [noise=true , address=145.79.227.9:4367 , piece_id=WERF4EVSV4DYC2GXEVR47E2V6MUXFLCRDV47LGVA2THQNJLE5IZQ, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:11.374956578 (151h7m14.076549032s) [noise=true , address=145.79.227.16:4909 , piece_id=3YMLW6PPZBOHV7DVWB7C5NOPZYB37X7AMQ5J2EPG4L674XABL3LQ, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:39.710620733 (151h7m42.412213192s) [noise=true , address=45.91.116.4:4937 , piece_id=EFXDKND5P3Q3R6CWQIKEAWHQ24ZAKKSPQOEXN3KSHWGGNMQ2H3CA, seg_pos={0 0}, upload=132923]: Done uploading piece. err: ecclient: upload failed (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq, address:45.91.116.4:4937): protocol: write tcp 139.59.144.22:35734->45.91.116.4:4937: use of closed network connection; write tcp 139.59.144.22:35734->45.91.116.4:4937: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35734->45.91.116.4:4937: use of closed network connection
Nov 5 18:48:39.710807457 (151h7m42.412399911s) [noise=true , address=45.91.116.11:4117 , piece_id=SDMDKSZCQE4HEBQYMRCDTWLUW7U6Y6H5IJJTO4SZCQKN2IFFFDAA, seg_pos={0 0}, upload=132923]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: write tcp 139.59.144.22:44798->45.91.116.11:4117: use of closed network connection; write tcp 139.59.144.22:44798->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44798->45.91.116.11:4117: use of closed network connection
Nov 5 18:48:39.710941231 (151h7m42.412533691s) [noise=true , address=45.91.116.8:4047 , piece_id=QBYFIHSBXSK6NK72XPLDIQG27HJXYOP5MOYBGUNU6BBMKUEW4DMQ, seg_pos={0 0}, upload=132923]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: write tcp 139.59.144.22:57340->45.91.116.8:4047: use of closed network connection; write tcp 139.59.144.22:57340->45.91.116.8:4047: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57340->45.91.116.8:4047: use of closed network connection
Nov 5 18:48:39.710963431 (151h7m42.412555889s) [noise=true , address=77.90.31.10:4518 , piece_id=L4RSU5BAFV2Y4NTV23XLQBUHZTHEFX3IJNOCGCTGP2T447MDZ5EQ, seg_pos={0 0}, upload=132923]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 139.59.144.22:42418->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 18:48:39.711166802 (151h7m42.412759261s) [noise=true , address=45.91.116.4:4939 , piece_id=BNFP47OHWEF76D3BBAOZRGQHS74AT2QSB6UA4IKE4YNTZMFCKGRQ, seg_pos={0 0}, upload=132923]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: read tcp 139.59.144.22:36572->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 18:48:39.711215042 (151h7m42.412807482s) [seg_pos={0 0}, upload=132923]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Nov 5 18:48:39.819221226 (151h7m42.520813674s) [upload=132923]: Done uploading segments...
Nov 5 18:48:39.819255108 (151h7m42.520847559s) [upload=132923]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 2.400723962s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.450310341s trace:
https://jaeger.dev.storj.io/trace/1aa3995c171d9952
FAIL (2025-11-05 18:50:06 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Nov 5 18:48:09.999186003 (151h7m12.700778465s) [upload=132923]: Starting upload
Nov 5 18:48:09.999281260 (151h7m12.700873714s) [upload=132923]: Done starting upload
Nov 5 18:48:09.999383134 (151h7m12.700975582s) [upload=132923]: Uploading segments...
Nov 5 18:48:09.999683966 (151h7m12.70127642s) [upload=132923]: Got next segment. Inline: false
Nov 5 18:48:09.999762227 (151h7m12.701354683s) [upload=132923]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Nov 5 18:48:09.999769575 (151h7m12.701362038s) [upload=132923]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Nov 5 18:48:10.112806705 (151h7m12.814399164s) [seg_pos={0 0}, upload=132923]: Begin upload segment...
Nov 5 18:48:10.112889335 (151h7m12.814481795s) [seg_pos={0 0}, upload=132923]: Done begin upload segment.
Nov 5 18:48:10.112922761 (151h7m12.814515222s) [noise=true , address=45.91.116.4:4937 , piece_id=EFXDKND5P3Q3R6CWQIKEAWHQ24ZAKKSPQOEXN3KSHWGGNMQ2H3CA, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.113066946 (151h7m12.814659561s) [noise=true , address=145.79.227.14:4839 , piece_id=E75VU4JLVX7SVHAD5A27GABTQFEYPQSWZIRTN4NTOQZX5NT2KYFQ, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.113814365 (151h7m12.815406833s) [noise=true , address=145.79.227.23:4546 , piece_id=HK5DZGS3IGHSOPWJI7TKATUZ6XXVFQEEDQRB2XUWUZNM4CYIOIGA, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.114349115 (151h7m12.815941576s) [noise=true , address=145.79.227.16:4909 , piece_id=3YMLW6PPZBOHV7DVWB7C5NOPZYB37X7AMQ5J2EPG4L674XABL3LQ, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.116003644 (151h7m12.81759611s) [noise=true , address=145.79.227.9:4367 , piece_id=WERF4EVSV4DYC2GXEVR47E2V6MUXFLCRDV47LGVA2THQNJLE5IZQ, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.116800891 (151h7m12.818393353s) [noise=true , address=45.91.116.11:4117 , piece_id=SDMDKSZCQE4HEBQYMRCDTWLUW7U6Y6H5IJJTO4SZCQKN2IFFFDAA, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.117660535 (151h7m12.819252994s) [noise=true , address=145.79.227.24:4581 , piece_id=UIQMKMO7TZZRUAFFYWEVS6TUPLQNORE2DJBEBTI5S3SDLWXOWIMA, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.118368793 (151h7m12.819961251s) [noise=true , address=45.91.116.4:4939 , piece_id=BNFP47OHWEF76D3BBAOZRGQHS74AT2QSB6UA4IKE4YNTZMFCKGRQ, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.119407601 (151h7m12.821000062s) [noise=true , address=145.79.227.11:4731 , piece_id=GLYF3OHQZRRTOC2IXMHOQBQW5V2IWCU5ZCDMFHFGHLQH2AHYPZSA, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.120766581 (151h7m12.822359041s) [noise=true , address=45.91.116.8:4047 , piece_id=QBYFIHSBXSK6NK72XPLDIQG27HJXYOP5MOYBGUNU6BBMKUEW4DMQ, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.121702233 (151h7m12.823294694s) [noise=true , address=145.79.227.8:4329 , piece_id=P3AOPZKE7NOK7U7TC3BLCAO7APL7EHFCKCQR2PRK5RSEI7MVCUYQ, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.122942618 (151h7m12.824535079s) [noise=true , address=145.79.227.18:4005 , piece_id=4BCPHT4HGQHINMRZUC4XHNAMHPSX22AIY4WLMKGTY6FEC7VX72RQ, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.126037335 (151h7m12.827629795s) [noise=true , address=145.79.227.26:4654 , piece_id=WDGR5HANBRWGHACVYWO3N6SLJPXIGXZRJBBQNRDGRRF6SJMX7XOA, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.128535670 (151h7m12.830128134s) [noise=true , address=145.79.227.21:4473 , piece_id=IZJRCFTU5JDDJAZHDZSINQXEN6X3VIICT4ANT23VXIOSXB2GTKSA, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.131356455 (151h7m12.832948911s) [noise=true , address=145.79.227.30:4761 , piece_id=7FYWLDB7ADJ6L7DIDK7NLRW6ALRIQ3STJQ54UZJ2UZTVNY4YFSWQ, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.133585503 (151h7m12.835177963s) [noise=true , address=77.90.31.10:4518 , piece_id=L4RSU5BAFV2Y4NTV23XLQBUHZTHEFX3IJNOCGCTGP2T447MDZ5EQ, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.728939564 (151h7m13.430532034s) [upload=132923]: Next returned nil segment
Nov 5 18:48:10.728957940 (151h7m13.430550399s) [upload=132923]: Waiting for error group managing segments...
Nov 5 18:48:10.866448476 (151h7m13.568040927s) [noise=true , address=145.79.227.11:4731 , piece_id=GLYF3OHQZRRTOC2IXMHOQBQW5V2IWCU5ZCDMFHFGHLQH2AHYPZSA, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:10.868817227 (151h7m13.57040968s) [noise=true , address=145.79.227.24:4581 , piece_id=UIQMKMO7TZZRUAFFYWEVS6TUPLQNORE2DJBEBTI5S3SDLWXOWIMA, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:10.875245787 (151h7m13.576838251s) [noise=true , address=145.79.227.23:4546 , piece_id=HK5DZGS3IGHSOPWJI7TKATUZ6XXVFQEEDQRB2XUWUZNM4CYIOIGA, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:10.876021062 (151h7m13.577613514s) [noise=true , address=145.79.227.14:4839 , piece_id=E75VU4JLVX7SVHAD5A27GABTQFEYPQSWZIRTN4NTOQZX5NT2KYFQ, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:10.876710147 (151h7m13.57830261s) [noise=true , address=145.79.227.21:4473 , piece_id=IZJRCFTU5JDDJAZHDZSINQXEN6X3VIICT4ANT23VXIOSXB2GTKSA, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:10.877717167 (151h7m13.579309622s) [noise=true , address=145.79.227.8:4329 , piece_id=P3AOPZKE7NOK7U7TC3BLCAO7APL7EHFCKCQR2PRK5RSEI7MVCUYQ, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:10.878446355 (151h7m13.580038813s) [noise=true , address=145.79.227.26:4654 , piece_id=WDGR5HANBRWGHACVYWO3N6SLJPXIGXZRJBBQNRDGRRF6SJMX7XOA, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:10.882107581 (151h7m13.583700035s) [noise=true , address=145.79.227.18:4005 , piece_id=4BCPHT4HGQHINMRZUC4XHNAMHPSX22AIY4WLMKGTY6FEC7VX72RQ, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:10.930825699 (151h7m13.632418161s) [noise=true , address=145.79.227.30:4761 , piece_id=7FYWLDB7ADJ6L7DIDK7NLRW6ALRIQ3STJQ54UZJ2UZTVNY4YFSWQ, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:10.931615073 (151h7m13.63320753s) [noise=true , address=145.79.227.9:4367 , piece_id=WERF4EVSV4DYC2GXEVR47E2V6MUXFLCRDV47LGVA2THQNJLE5IZQ, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:11.374956578 (151h7m14.076549032s) [noise=true , address=145.79.227.16:4909 , piece_id=3YMLW6PPZBOHV7DVWB7C5NOPZYB37X7AMQ5J2EPG4L674XABL3LQ, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:39.710620733 (151h7m42.412213192s) [noise=true , address=45.91.116.4:4937 , piece_id=EFXDKND5P3Q3R6CWQIKEAWHQ24ZAKKSPQOEXN3KSHWGGNMQ2H3CA, seg_pos={0 0}, upload=132923]: Done uploading piece. err: ecclient: upload failed (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq, address:45.91.116.4:4937): protocol: write tcp 139.59.144.22:35734->45.91.116.4:4937: use of closed network connection; write tcp 139.59.144.22:35734->45.91.116.4:4937: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35734->45.91.116.4:4937: use of closed network connection
Nov 5 18:48:39.710807457 (151h7m42.412399911s) [noise=true , address=45.91.116.11:4117 , piece_id=SDMDKSZCQE4HEBQYMRCDTWLUW7U6Y6H5IJJTO4SZCQKN2IFFFDAA, seg_pos={0 0}, upload=132923]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: write tcp 139.59.144.22:44798->45.91.116.11:4117: use of closed network connection; write tcp 139.59.144.22:44798->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44798->45.91.116.11:4117: use of closed network connection
Nov 5 18:48:39.710941231 (151h7m42.412533691s) [noise=true , address=45.91.116.8:4047 , piece_id=QBYFIHSBXSK6NK72XPLDIQG27HJXYOP5MOYBGUNU6BBMKUEW4DMQ, seg_pos={0 0}, upload=132923]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: write tcp 139.59.144.22:57340->45.91.116.8:4047: use of closed network connection; write tcp 139.59.144.22:57340->45.91.116.8:4047: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57340->45.91.116.8:4047: use of closed network connection
Nov 5 18:48:39.710963431 (151h7m42.412555889s) [noise=true , address=77.90.31.10:4518 , piece_id=L4RSU5BAFV2Y4NTV23XLQBUHZTHEFX3IJNOCGCTGP2T447MDZ5EQ, seg_pos={0 0}, upload=132923]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 139.59.144.22:42418->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 18:48:39.711166802 (151h7m42.412759261s) [noise=true , address=45.91.116.4:4939 , piece_id=BNFP47OHWEF76D3BBAOZRGQHS74AT2QSB6UA4IKE4YNTZMFCKGRQ, seg_pos={0 0}, upload=132923]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: read tcp 139.59.144.22:36572->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 18:48:39.711215042 (151h7m42.412807482s) [seg_pos={0 0}, upload=132923]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Nov 5 18:48:39.819221226 (151h7m42.520813674s) [upload=132923]: Done uploading segments...
Nov 5 18:48:39.819255108 (151h7m42.520847559s) [upload=132923]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 2.450342711s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.........................................................X..] duration:
1.659282918s trace:
https://jaeger.dev.storj.io/trace/72a639688f7f6d0b
FAIL (2025-11-05 18:50:04 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.659314987s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..........................................................X.] duration:
2.194600213s trace:
https://jaeger.dev.storj.io/trace/72a639688f7f6d0b
FAIL (2025-11-05 18:49:44 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.194629518s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
2.832124143s trace:
https://jaeger.dev.storj.io/trace/449848d9d77db041
FAIL (2025-11-05 18:49:29 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.832154742s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
2.62961525s trace:
https://jaeger.dev.storj.io/trace/1aa3995c171d9952
FAIL (2025-11-05 18:49:18 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Nov 5 18:48:09.999186003 (151h7m12.700778465s) [upload=132923]: Starting upload
Nov 5 18:48:09.999281260 (151h7m12.700873714s) [upload=132923]: Done starting upload
Nov 5 18:48:09.999383134 (151h7m12.700975582s) [upload=132923]: Uploading segments...
Nov 5 18:48:09.999683966 (151h7m12.70127642s) [upload=132923]: Got next segment. Inline: false
Nov 5 18:48:09.999762227 (151h7m12.701354683s) [upload=132923]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Nov 5 18:48:09.999769575 (151h7m12.701362038s) [upload=132923]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Nov 5 18:48:10.112806705 (151h7m12.814399164s) [seg_pos={0 0}, upload=132923]: Begin upload segment...
Nov 5 18:48:10.112889335 (151h7m12.814481795s) [seg_pos={0 0}, upload=132923]: Done begin upload segment.
Nov 5 18:48:10.112922761 (151h7m12.814515222s) [noise=true , address=45.91.116.4:4937 , piece_id=EFXDKND5P3Q3R6CWQIKEAWHQ24ZAKKSPQOEXN3KSHWGGNMQ2H3CA, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.113066946 (151h7m12.814659561s) [noise=true , address=145.79.227.14:4839 , piece_id=E75VU4JLVX7SVHAD5A27GABTQFEYPQSWZIRTN4NTOQZX5NT2KYFQ, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.113814365 (151h7m12.815406833s) [noise=true , address=145.79.227.23:4546 , piece_id=HK5DZGS3IGHSOPWJI7TKATUZ6XXVFQEEDQRB2XUWUZNM4CYIOIGA, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.114349115 (151h7m12.815941576s) [noise=true , address=145.79.227.16:4909 , piece_id=3YMLW6PPZBOHV7DVWB7C5NOPZYB37X7AMQ5J2EPG4L674XABL3LQ, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.116003644 (151h7m12.81759611s) [noise=true , address=145.79.227.9:4367 , piece_id=WERF4EVSV4DYC2GXEVR47E2V6MUXFLCRDV47LGVA2THQNJLE5IZQ, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.116800891 (151h7m12.818393353s) [noise=true , address=45.91.116.11:4117 , piece_id=SDMDKSZCQE4HEBQYMRCDTWLUW7U6Y6H5IJJTO4SZCQKN2IFFFDAA, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.117660535 (151h7m12.819252994s) [noise=true , address=145.79.227.24:4581 , piece_id=UIQMKMO7TZZRUAFFYWEVS6TUPLQNORE2DJBEBTI5S3SDLWXOWIMA, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.118368793 (151h7m12.819961251s) [noise=true , address=45.91.116.4:4939 , piece_id=BNFP47OHWEF76D3BBAOZRGQHS74AT2QSB6UA4IKE4YNTZMFCKGRQ, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.119407601 (151h7m12.821000062s) [noise=true , address=145.79.227.11:4731 , piece_id=GLYF3OHQZRRTOC2IXMHOQBQW5V2IWCU5ZCDMFHFGHLQH2AHYPZSA, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.120766581 (151h7m12.822359041s) [noise=true , address=45.91.116.8:4047 , piece_id=QBYFIHSBXSK6NK72XPLDIQG27HJXYOP5MOYBGUNU6BBMKUEW4DMQ, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.121702233 (151h7m12.823294694s) [noise=true , address=145.79.227.8:4329 , piece_id=P3AOPZKE7NOK7U7TC3BLCAO7APL7EHFCKCQR2PRK5RSEI7MVCUYQ, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.122942618 (151h7m12.824535079s) [noise=true , address=145.79.227.18:4005 , piece_id=4BCPHT4HGQHINMRZUC4XHNAMHPSX22AIY4WLMKGTY6FEC7VX72RQ, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.126037335 (151h7m12.827629795s) [noise=true , address=145.79.227.26:4654 , piece_id=WDGR5HANBRWGHACVYWO3N6SLJPXIGXZRJBBQNRDGRRF6SJMX7XOA, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.128535670 (151h7m12.830128134s) [noise=true , address=145.79.227.21:4473 , piece_id=IZJRCFTU5JDDJAZHDZSINQXEN6X3VIICT4ANT23VXIOSXB2GTKSA, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.131356455 (151h7m12.832948911s) [noise=true , address=145.79.227.30:4761 , piece_id=7FYWLDB7ADJ6L7DIDK7NLRW6ALRIQ3STJQ54UZJ2UZTVNY4YFSWQ, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.133585503 (151h7m12.835177963s) [noise=true , address=77.90.31.10:4518 , piece_id=L4RSU5BAFV2Y4NTV23XLQBUHZTHEFX3IJNOCGCTGP2T447MDZ5EQ, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.728939564 (151h7m13.430532034s) [upload=132923]: Next returned nil segment
Nov 5 18:48:10.728957940 (151h7m13.430550399s) [upload=132923]: Waiting for error group managing segments...
Nov 5 18:48:10.866448476 (151h7m13.568040927s) [noise=true , address=145.79.227.11:4731 , piece_id=GLYF3OHQZRRTOC2IXMHOQBQW5V2IWCU5ZCDMFHFGHLQH2AHYPZSA, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:10.868817227 (151h7m13.57040968s) [noise=true , address=145.79.227.24:4581 , piece_id=UIQMKMO7TZZRUAFFYWEVS6TUPLQNORE2DJBEBTI5S3SDLWXOWIMA, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:10.875245787 (151h7m13.576838251s) [noise=true , address=145.79.227.23:4546 , piece_id=HK5DZGS3IGHSOPWJI7TKATUZ6XXVFQEEDQRB2XUWUZNM4CYIOIGA, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:10.876021062 (151h7m13.577613514s) [noise=true , address=145.79.227.14:4839 , piece_id=E75VU4JLVX7SVHAD5A27GABTQFEYPQSWZIRTN4NTOQZX5NT2KYFQ, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:10.876710147 (151h7m13.57830261s) [noise=true , address=145.79.227.21:4473 , piece_id=IZJRCFTU5JDDJAZHDZSINQXEN6X3VIICT4ANT23VXIOSXB2GTKSA, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:10.877717167 (151h7m13.579309622s) [noise=true , address=145.79.227.8:4329 , piece_id=P3AOPZKE7NOK7U7TC3BLCAO7APL7EHFCKCQR2PRK5RSEI7MVCUYQ, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:10.878446355 (151h7m13.580038813s) [noise=true , address=145.79.227.26:4654 , piece_id=WDGR5HANBRWGHACVYWO3N6SLJPXIGXZRJBBQNRDGRRF6SJMX7XOA, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:10.882107581 (151h7m13.583700035s) [noise=true , address=145.79.227.18:4005 , piece_id=4BCPHT4HGQHINMRZUC4XHNAMHPSX22AIY4WLMKGTY6FEC7VX72RQ, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:10.930825699 (151h7m13.632418161s) [noise=true , address=145.79.227.30:4761 , piece_id=7FYWLDB7ADJ6L7DIDK7NLRW6ALRIQ3STJQ54UZJ2UZTVNY4YFSWQ, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:10.931615073 (151h7m13.63320753s) [noise=true , address=145.79.227.9:4367 , piece_id=WERF4EVSV4DYC2GXEVR47E2V6MUXFLCRDV47LGVA2THQNJLE5IZQ, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:11.374956578 (151h7m14.076549032s) [noise=true , address=145.79.227.16:4909 , piece_id=3YMLW6PPZBOHV7DVWB7C5NOPZYB37X7AMQ5J2EPG4L674XABL3LQ, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:39.710620733 (151h7m42.412213192s) [noise=true , address=45.91.116.4:4937 , piece_id=EFXDKND5P3Q3R6CWQIKEAWHQ24ZAKKSPQOEXN3KSHWGGNMQ2H3CA, seg_pos={0 0}, upload=132923]: Done uploading piece. err: ecclient: upload failed (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq, address:45.91.116.4:4937): protocol: write tcp 139.59.144.22:35734->45.91.116.4:4937: use of closed network connection; write tcp 139.59.144.22:35734->45.91.116.4:4937: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35734->45.91.116.4:4937: use of closed network connection
Nov 5 18:48:39.710807457 (151h7m42.412399911s) [noise=true , address=45.91.116.11:4117 , piece_id=SDMDKSZCQE4HEBQYMRCDTWLUW7U6Y6H5IJJTO4SZCQKN2IFFFDAA, seg_pos={0 0}, upload=132923]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: write tcp 139.59.144.22:44798->45.91.116.11:4117: use of closed network connection; write tcp 139.59.144.22:44798->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44798->45.91.116.11:4117: use of closed network connection
Nov 5 18:48:39.710941231 (151h7m42.412533691s) [noise=true , address=45.91.116.8:4047 , piece_id=QBYFIHSBXSK6NK72XPLDIQG27HJXYOP5MOYBGUNU6BBMKUEW4DMQ, seg_pos={0 0}, upload=132923]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: write tcp 139.59.144.22:57340->45.91.116.8:4047: use of closed network connection; write tcp 139.59.144.22:57340->45.91.116.8:4047: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57340->45.91.116.8:4047: use of closed network connection
Nov 5 18:48:39.710963431 (151h7m42.412555889s) [noise=true , address=77.90.31.10:4518 , piece_id=L4RSU5BAFV2Y4NTV23XLQBUHZTHEFX3IJNOCGCTGP2T447MDZ5EQ, seg_pos={0 0}, upload=132923]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 139.59.144.22:42418->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 18:48:39.711166802 (151h7m42.412759261s) [noise=true , address=45.91.116.4:4939 , piece_id=BNFP47OHWEF76D3BBAOZRGQHS74AT2QSB6UA4IKE4YNTZMFCKGRQ, seg_pos={0 0}, upload=132923]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: read tcp 139.59.144.22:36572->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 18:48:39.711215042 (151h7m42.412807482s) [seg_pos={0 0}, upload=132923]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Nov 5 18:48:39.819221226 (151h7m42.520813674s) [upload=132923]: Done uploading segments...
Nov 5 18:48:39.819255108 (151h7m42.520847559s) [upload=132923]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 2.62964123s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.000770224s trace:
https://jaeger.dev.storj.io/trace/449848d9d77db041
FAIL (2025-11-05 18:48:54 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.000864308s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...........................................................X] duration:
5.00102665s trace:
https://jaeger.dev.storj.io/trace/72a639688f7f6d0b
FAIL (2025-11-05 18:48:53 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001046071s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.11056141s trace:
https://jaeger.dev.storj.io/trace/1aa3995c171d9952
FAIL (2025-11-05 18:48:39 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Nov 5 18:48:09.999186003 (151h7m12.700778465s) [upload=132923]: Starting upload
Nov 5 18:48:09.999281260 (151h7m12.700873714s) [upload=132923]: Done starting upload
Nov 5 18:48:09.999383134 (151h7m12.700975582s) [upload=132923]: Uploading segments...
Nov 5 18:48:09.999683966 (151h7m12.70127642s) [upload=132923]: Got next segment. Inline: false
Nov 5 18:48:09.999762227 (151h7m12.701354683s) [upload=132923]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Nov 5 18:48:09.999769575 (151h7m12.701362038s) [upload=132923]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Nov 5 18:48:10.112806705 (151h7m12.814399164s) [seg_pos={0 0}, upload=132923]: Begin upload segment...
Nov 5 18:48:10.112889335 (151h7m12.814481795s) [seg_pos={0 0}, upload=132923]: Done begin upload segment.
Nov 5 18:48:10.112922761 (151h7m12.814515222s) [noise=true , address=45.91.116.4:4937 , piece_id=EFXDKND5P3Q3R6CWQIKEAWHQ24ZAKKSPQOEXN3KSHWGGNMQ2H3CA, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.113066946 (151h7m12.814659561s) [noise=true , address=145.79.227.14:4839 , piece_id=E75VU4JLVX7SVHAD5A27GABTQFEYPQSWZIRTN4NTOQZX5NT2KYFQ, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.113814365 (151h7m12.815406833s) [noise=true , address=145.79.227.23:4546 , piece_id=HK5DZGS3IGHSOPWJI7TKATUZ6XXVFQEEDQRB2XUWUZNM4CYIOIGA, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.114349115 (151h7m12.815941576s) [noise=true , address=145.79.227.16:4909 , piece_id=3YMLW6PPZBOHV7DVWB7C5NOPZYB37X7AMQ5J2EPG4L674XABL3LQ, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.116003644 (151h7m12.81759611s) [noise=true , address=145.79.227.9:4367 , piece_id=WERF4EVSV4DYC2GXEVR47E2V6MUXFLCRDV47LGVA2THQNJLE5IZQ, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.116800891 (151h7m12.818393353s) [noise=true , address=45.91.116.11:4117 , piece_id=SDMDKSZCQE4HEBQYMRCDTWLUW7U6Y6H5IJJTO4SZCQKN2IFFFDAA, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.117660535 (151h7m12.819252994s) [noise=true , address=145.79.227.24:4581 , piece_id=UIQMKMO7TZZRUAFFYWEVS6TUPLQNORE2DJBEBTI5S3SDLWXOWIMA, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.118368793 (151h7m12.819961251s) [noise=true , address=45.91.116.4:4939 , piece_id=BNFP47OHWEF76D3BBAOZRGQHS74AT2QSB6UA4IKE4YNTZMFCKGRQ, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.119407601 (151h7m12.821000062s) [noise=true , address=145.79.227.11:4731 , piece_id=GLYF3OHQZRRTOC2IXMHOQBQW5V2IWCU5ZCDMFHFGHLQH2AHYPZSA, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.120766581 (151h7m12.822359041s) [noise=true , address=45.91.116.8:4047 , piece_id=QBYFIHSBXSK6NK72XPLDIQG27HJXYOP5MOYBGUNU6BBMKUEW4DMQ, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.121702233 (151h7m12.823294694s) [noise=true , address=145.79.227.8:4329 , piece_id=P3AOPZKE7NOK7U7TC3BLCAO7APL7EHFCKCQR2PRK5RSEI7MVCUYQ, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.122942618 (151h7m12.824535079s) [noise=true , address=145.79.227.18:4005 , piece_id=4BCPHT4HGQHINMRZUC4XHNAMHPSX22AIY4WLMKGTY6FEC7VX72RQ, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.126037335 (151h7m12.827629795s) [noise=true , address=145.79.227.26:4654 , piece_id=WDGR5HANBRWGHACVYWO3N6SLJPXIGXZRJBBQNRDGRRF6SJMX7XOA, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.128535670 (151h7m12.830128134s) [noise=true , address=145.79.227.21:4473 , piece_id=IZJRCFTU5JDDJAZHDZSINQXEN6X3VIICT4ANT23VXIOSXB2GTKSA, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.131356455 (151h7m12.832948911s) [noise=true , address=145.79.227.30:4761 , piece_id=7FYWLDB7ADJ6L7DIDK7NLRW6ALRIQ3STJQ54UZJ2UZTVNY4YFSWQ, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.133585503 (151h7m12.835177963s) [noise=true , address=77.90.31.10:4518 , piece_id=L4RSU5BAFV2Y4NTV23XLQBUHZTHEFX3IJNOCGCTGP2T447MDZ5EQ, seg_pos={0 0}, upload=132923]: Uploading piece...
Nov 5 18:48:10.728939564 (151h7m13.430532034s) [upload=132923]: Next returned nil segment
Nov 5 18:48:10.728957940 (151h7m13.430550399s) [upload=132923]: Waiting for error group managing segments...
Nov 5 18:48:10.866448476 (151h7m13.568040927s) [noise=true , address=145.79.227.11:4731 , piece_id=GLYF3OHQZRRTOC2IXMHOQBQW5V2IWCU5ZCDMFHFGHLQH2AHYPZSA, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:10.868817227 (151h7m13.57040968s) [noise=true , address=145.79.227.24:4581 , piece_id=UIQMKMO7TZZRUAFFYWEVS6TUPLQNORE2DJBEBTI5S3SDLWXOWIMA, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:10.875245787 (151h7m13.576838251s) [noise=true , address=145.79.227.23:4546 , piece_id=HK5DZGS3IGHSOPWJI7TKATUZ6XXVFQEEDQRB2XUWUZNM4CYIOIGA, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:10.876021062 (151h7m13.577613514s) [noise=true , address=145.79.227.14:4839 , piece_id=E75VU4JLVX7SVHAD5A27GABTQFEYPQSWZIRTN4NTOQZX5NT2KYFQ, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:10.876710147 (151h7m13.57830261s) [noise=true , address=145.79.227.21:4473 , piece_id=IZJRCFTU5JDDJAZHDZSINQXEN6X3VIICT4ANT23VXIOSXB2GTKSA, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:10.877717167 (151h7m13.579309622s) [noise=true , address=145.79.227.8:4329 , piece_id=P3AOPZKE7NOK7U7TC3BLCAO7APL7EHFCKCQR2PRK5RSEI7MVCUYQ, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:10.878446355 (151h7m13.580038813s) [noise=true , address=145.79.227.26:4654 , piece_id=WDGR5HANBRWGHACVYWO3N6SLJPXIGXZRJBBQNRDGRRF6SJMX7XOA, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:10.882107581 (151h7m13.583700035s) [noise=true , address=145.79.227.18:4005 , piece_id=4BCPHT4HGQHINMRZUC4XHNAMHPSX22AIY4WLMKGTY6FEC7VX72RQ, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:10.930825699 (151h7m13.632418161s) [noise=true , address=145.79.227.30:4761 , piece_id=7FYWLDB7ADJ6L7DIDK7NLRW6ALRIQ3STJQ54UZJ2UZTVNY4YFSWQ, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:10.931615073 (151h7m13.63320753s) [noise=true , address=145.79.227.9:4367 , piece_id=WERF4EVSV4DYC2GXEVR47E2V6MUXFLCRDV47LGVA2THQNJLE5IZQ, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:11.374956578 (151h7m14.076549032s) [noise=true , address=145.79.227.16:4909 , piece_id=3YMLW6PPZBOHV7DVWB7C5NOPZYB37X7AMQ5J2EPG4L674XABL3LQ, seg_pos={0 0}, upload=132923]: Done uploading piece. err: <nil>
Nov 5 18:48:39.710620733 (151h7m42.412213192s) [noise=true , address=45.91.116.4:4937 , piece_id=EFXDKND5P3Q3R6CWQIKEAWHQ24ZAKKSPQOEXN3KSHWGGNMQ2H3CA, seg_pos={0 0}, upload=132923]: Done uploading piece. err: ecclient: upload failed (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq, address:45.91.116.4:4937): protocol: write tcp 139.59.144.22:35734->45.91.116.4:4937: use of closed network connection; write tcp 139.59.144.22:35734->45.91.116.4:4937: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35734->45.91.116.4:4937: use of closed network connection
Nov 5 18:48:39.710807457 (151h7m42.412399911s) [noise=true , address=45.91.116.11:4117 , piece_id=SDMDKSZCQE4HEBQYMRCDTWLUW7U6Y6H5IJJTO4SZCQKN2IFFFDAA, seg_pos={0 0}, upload=132923]: Done uploading piece. err: ecclient: upload failed (node:167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, address:45.91.116.11:4117): protocol: write tcp 139.59.144.22:44798->45.91.116.11:4117: use of closed network connection; write tcp 139.59.144.22:44798->45.91.116.11:4117: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:44798->45.91.116.11:4117: use of closed network connection
Nov 5 18:48:39.710941231 (151h7m42.412533691s) [noise=true , address=45.91.116.8:4047 , piece_id=QBYFIHSBXSK6NK72XPLDIQG27HJXYOP5MOYBGUNU6BBMKUEW4DMQ, seg_pos={0 0}, upload=132923]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: write tcp 139.59.144.22:57340->45.91.116.8:4047: use of closed network connection; write tcp 139.59.144.22:57340->45.91.116.8:4047: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57340->45.91.116.8:4047: use of closed network connection
Nov 5 18:48:39.710963431 (151h7m42.412555889s) [noise=true , address=77.90.31.10:4518 , piece_id=L4RSU5BAFV2Y4NTV23XLQBUHZTHEFX3IJNOCGCTGP2T447MDZ5EQ, seg_pos={0 0}, upload=132923]: Done uploading piece. err: ecclient: upload failed (node:1mvEBa8qdXMR14Gcz96iRQUKyscWCUDnFXh98NQJC3ndoWkkq3, address:77.90.31.10:4518): protocol: read tcp 139.59.144.22:42418->77.90.31.10:4518: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 18:48:39.711166802 (151h7m42.412759261s) [noise=true , address=45.91.116.4:4939 , piece_id=BNFP47OHWEF76D3BBAOZRGQHS74AT2QSB6UA4IKE4YNTZMFCKGRQ, seg_pos={0 0}, upload=132923]: Done uploading piece. err: ecclient: upload failed (node:12K4acSz27pP9v6DZSvETPuUfzFFiR2k7U3awntw2eHNytnPiuX, address:45.91.116.4:4939): protocol: read tcp 139.59.144.22:36572->45.91.116.4:4939: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 5 18:48:39.711215042 (151h7m42.412807482s) [seg_pos={0 0}, upload=132923]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Nov 5 18:48:39.819221226 (151h7m42.520813674s) [upload=132923]: Done uploading segments...
Nov 5 18:48:39.819255108 (151h7m42.520847559s) [upload=132923]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 30.110586601s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [X...........................................................] duration:
18.984045ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/54cd425adc782f13
FAIL (2025-11-05 12:26:33 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 19.017971ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.X..........................................................] duration:
19.742048ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/54cd425adc782f13
FAIL (2025-11-05 12:25:26 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 19.769223ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [..X.........................................................] duration:
21.597809ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/54cd425adc782f13
FAIL (2025-11-05 12:24:45 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 21.62424ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [...X........................................................] duration:
19.832824ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/54cd425adc782f13
FAIL (2025-11-05 12:23:38 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 19.859479ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [....X.......................................................] duration:
21.679787ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/54cd425adc782f13
FAIL (2025-11-05 12:23:06 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 21.705882ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.....X......................................................] duration:
23.620428ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/54cd425adc782f13
FAIL (2025-11-05 12:22:08 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 23.649515ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [......X.....................................................] duration:
23.371444ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/54cd425adc782f13
FAIL (2025-11-05 12:21:19 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 23.397348ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.......X....................................................] duration:
18.511787ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/54cd425adc782f13
FAIL (2025-11-05 12:20:56 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 18.538091ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [........X...................................................] duration:
24.817907ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/54cd425adc782f13
FAIL (2025-11-05 12:20:29 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 24.908721ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.........X..................................................] duration:
18.380194ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/54cd425adc782f13
FAIL (2025-11-05 12:19:37 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 18.407734ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [..........X.................................................] duration:
20.060804ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/54cd425adc782f13
FAIL (2025-11-05 12:18:47 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 20.090304ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [...........X................................................] duration:
20.042341ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/54cd425adc782f13
FAIL (2025-11-05 12:17:48 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 20.068952ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [............X...............................................] duration:
20.748132ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/54cd425adc782f13
FAIL (2025-11-05 12:17:13 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 20.778209ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.............X..............................................] duration:
21.169894ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/54cd425adc782f13
FAIL (2025-11-05 12:16:41 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 21.270577ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [..............X.............................................] duration:
21.169368ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/54cd425adc782f13
FAIL (2025-11-05 12:16:26 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 21.198718ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [...............X............................................] duration:
18.82882ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/54cd425adc782f13
FAIL (2025-11-05 12:15:38 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 18.858294ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [................X...........................................] duration:
23.400546ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/54cd425adc782f13
FAIL (2025-11-05 12:15:05 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 23.424894ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.................X..........................................] duration:
21.856758ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/54cd425adc782f13
FAIL (2025-11-05 12:14:36 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 21.885035ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [..................X.........................................] duration:
41.882294ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/54cd425adc782f13
FAIL (2025-11-05 12:14:17 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 41.922087ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [...................X........................................] duration:
15.978071ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/54cd425adc782f13
FAIL (2025-11-05 12:13:59 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 16.003298ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [....................X.......................................] duration:
18.156381ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/54cd425adc782f13
FAIL (2025-11-05 12:12:58 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 18.187048ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.....................X......................................] duration:
20.6542ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/54cd425adc782f13
FAIL (2025-11-05 12:12:24 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 20.698619ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [......................X.....................................] duration:
26.290708ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/54cd425adc782f13
FAIL (2025-11-05 12:11:11 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 26.322915ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.......................X....................................] duration:
17.373213ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/54cd425adc782f13
FAIL (2025-11-05 12:10:41 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 17.401129ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [........................X...................................] duration:
19.503452ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/54cd425adc782f13
FAIL (2025-11-05 12:09:38 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 19.535837ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.........................X..................................] duration:
18.568583ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/54cd425adc782f13
FAIL (2025-11-05 12:09:14 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 18.600432ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [..........................X.................................] duration:
59.395801ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/54cd425adc782f13
FAIL (2025-11-05 12:08:05 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 59.422072ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [...........................X................................] duration:
22.099982ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/54cd425adc782f13
FAIL (2025-11-05 12:06:59 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 22.132099ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [............................X...............................] duration:
33.762032ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/54cd425adc782f13
FAIL (2025-11-05 12:06:02 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 33.786072ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.............................X..............................] duration:
17.991688ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/54cd425adc782f13
FAIL (2025-11-05 12:05:45 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 18.017088ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [..............................X.............................] duration:
46.919972ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/54cd425adc782f13
FAIL (2025-11-05 12:05:12 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 46.938625ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [...............................X............................] duration:
20.597547ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/54cd425adc782f13
FAIL (2025-11-05 12:04:47 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 20.624648ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [................................X...........................] duration:
18.372099ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/54cd425adc782f13
FAIL (2025-11-05 12:04:10 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 18.39813ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [.................................X..........................] duration:
28.85737ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/54cd425adc782f13
FAIL (2025-11-05 12:03:03 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 28.950028ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [..................................X.........................] duration:
18.545705ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/54cd425adc782f13
FAIL (2025-11-05 12:02:24 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 18.581335ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [...................................X........................] duration:
24.542897ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/54cd425adc782f13
FAIL (2025-11-05 12:02:08 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 24.573171ms
edge
linksharing
bgp
eu1
|
checkers.HTTP{"GET" "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt", ExpectedContent: "Hello, world!"} failure (antiblip window 6/60): (http.eu1.linksharing)antiblip:
1 out of 60 is failed (threshold=6) [....................................X.......................] duration:
26.015447ms remote:
"tcp:185.244.226.3:443" target:
https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt trace:
https://jaeger.dev.storj.io/trace/54cd425adc782f13
FAIL (2025-11-05 12:01:17 UTC)
orbiter warning: Get "https://link.storjshare.io/raw/jwhnbh22a7huxgm5mpnu45kaahuq/uptime-checks/hello-world.txt": context deadline exceeded
Duration: 26.046925ms
edge
linksharing
bgp
eu1
|