Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
3 out of 60 is failed (threshold=6) [.......................................................X..XX] duration:
5.001414066s trace:
https://jaeger.dev.storj.io/trace/16315206915c2d69
FAIL (2025-11-22 12:31:06 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.0014339s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................................................X...X] duration:
30.001335589s trace:
https://jaeger.dev.storj.io/trace/7f6b1b7d67f39874
FAIL (2025-11-22 12:30:58 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.001357619s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
2 out of 60 is failed (threshold=6) [........................................................X..X] duration:
5.001122789s trace:
https://jaeger.dev.storj.io/trace/6e3e1ea26f5b2ecf
FAIL (2025-11-22 12:30:38 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001165929s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.246020807s trace:
https://jaeger.dev.storj.io/trace/51125b0f567b79ac
FAIL (2025-11-22 12:30:17 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Nov 22 12:28:01.919416928 (266h43m47.278075583s) [upload=235200]: Starting upload
Nov 22 12:28:01.919480818 (266h43m47.278139473s) [upload=235200]: Done starting upload
Nov 22 12:28:01.919615272 (266h43m47.278273952s) [upload=235200]: Uploading segments...
Nov 22 12:28:01.920129622 (266h43m47.278788286s) [upload=235200]: Got next segment. Inline: false
Nov 22 12:28:01.920467007 (266h43m47.279125669s) [upload=235200]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Nov 22 12:28:01.920490083 (266h43m47.279148738s) [upload=235200]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Nov 22 12:28:02.030268044 (266h43m47.388926702s) [seg_pos={0 0}, upload=235200]: Begin upload segment...
Nov 22 12:28:02.030369022 (266h43m47.389027683s) [noise=true , address=145.79.227.20:4439 , piece_id=A3QCT2DI7K5ZLH76TCSZNKM5AWBQS4XOQKOWBCKW276IDPYPAB4Q, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.034078188 (266h43m47.392736845s) [seg_pos={0 0}, upload=235200]: Done begin upload segment.
Nov 22 12:28:02.034174332 (266h43m47.392833s) [noise=true , address=145.79.227.11:4730 , piece_id=VPOJUOE426WFMOCZQHMDTVUPRXNZJJJE3BBR5PGEKLXZGO2DB6EQ, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.034951433 (266h43m47.393610102s) [noise=true , address=45.91.116.12:4225 , piece_id=TH274VOPTSMGHPZYXRZ6LYRALHQIEEODGN2YLPLZ2NJSY2A5EGXQ, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.036810303 (266h43m47.395468971s) [noise=true , address=77.90.31.13:4628 , piece_id=N7U7DJ63UWL463WOIKQ4B33BQX3PAANH7DEXXQ6JRBK23VMNOG5A, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.039091569 (266h43m47.39775026s) [noise=true , address=145.79.227.21:4475 , piece_id=D3JAG7JOALQZCFKSRQYNRVSQFU6X47LC64Y65BHTE4BN7E7YEQYQ, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.039359308 (266h43m47.398017977s) [noise=true , address=145.79.227.6:4258 , piece_id=EN47NLQULZMBOPCZUPKBEA5KIIYNOU6DH4P3FFGJNO3NJXA5XJYA, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.041951754 (266h43m47.400610415s) [noise=true , address=145.79.227.14:4837 , piece_id=SG67SGG3RYZGRXADNVM352ONMONYJABAOL5NXECDFYD7KYHIQZNA, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.043248768 (266h43m47.401907433s) [noise=true , address=145.79.227.25:4619 , piece_id=OBEW4APNLTAIQZ4NVJW65IFP3QJU2WWC2TGW27XFVWV7BFVQE6WQ, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.044121915 (266h43m47.402780583s) [noise=true , address=145.79.227.12:4767 , piece_id=74PSXYTWYLWMUBGSMD6TU6ECYWZGTWLUOBAZFZZNW3ZIAKO3Q4NQ, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.045770844 (266h43m47.404429565s) [noise=true , address=145.79.227.26:4653 , piece_id=5NHURGUQI64KD2W7XOZ3MQ5XSC4LKOWH2FMB6PLZGS5AJ4PIIVWQ, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.047043815 (266h43m47.405702483s) [noise=true , address=145.79.227.22:4510 , piece_id=UKZITHRBUE6XSTNZ75QPA6CXM47J5VA4JTVVLN2YEPP57GZEFUHQ, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.049880744 (266h43m47.408539411s) [noise=true , address=77.90.31.21:4877 , piece_id=EAZBORRL2KEJUPA4UBPA6WTYJ3DDKEWOJBRCGV4DUSZLXMC2MGSQ, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.051296178 (266h43m47.409954842s) [noise=true , address=145.79.227.17:4969 , piece_id=PDDQSVNS5SVL53IETHJT3ISNM4YMZKMFDIPA6CKGAF7AAX2R7SPA, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.057653012 (266h43m47.41631168s) [noise=true , address=45.91.116.9:4263 , piece_id=VAKRYSB2XYX3NCJHDZSU74MSERC5476BAGT6EWRXMJAEMIKMUVHQ, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.059231071 (266h43m47.41788974s) [noise=true , address=45.91.116.8:4047 , piece_id=PJTK7WLEKPQIXYPZBU3WBTO5DGXCVFKLFR2VEZKAT4FGM7G7BBGA, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.062711176 (266h43m47.421369844s) [noise=true , address=145.79.227.10:4403 , piece_id=YF45JGLWYZ7NEGLJRR2ZFS7YV5VQIUKD7XSJLKLVQY3YJCJ2KZIA, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.659147463 (266h43m48.017806127s) [upload=235200]: Next returned nil segment
Nov 22 12:28:02.659177752 (266h43m48.017836418s) [upload=235200]: Waiting for error group managing segments...
Nov 22 12:28:02.802314837 (266h43m48.160973504s) [noise=true , address=145.79.227.14:4837 , piece_id=SG67SGG3RYZGRXADNVM352ONMONYJABAOL5NXECDFYD7KYHIQZNA, seg_pos={0 0}, upload=235200]: Done uploading piece. err: <nil>
Nov 22 12:28:02.812545911 (266h43m48.171204567s) [noise=true , address=145.79.227.12:4767 , piece_id=74PSXYTWYLWMUBGSMD6TU6ECYWZGTWLUOBAZFZZNW3ZIAKO3Q4NQ, seg_pos={0 0}, upload=235200]: Done uploading piece. err: <nil>
Nov 22 12:28:02.812946565 (266h43m48.171605222s) [noise=true , address=145.79.227.11:4730 , piece_id=VPOJUOE426WFMOCZQHMDTVUPRXNZJJJE3BBR5PGEKLXZGO2DB6EQ, seg_pos={0 0}, upload=235200]: Done uploading piece. err: <nil>
Nov 22 12:28:02.813428679 (266h43m48.172087335s) [noise=true , address=145.79.227.10:4403 , piece_id=YF45JGLWYZ7NEGLJRR2ZFS7YV5VQIUKD7XSJLKLVQY3YJCJ2KZIA, seg_pos={0 0}, upload=235200]: Done uploading piece. err: <nil>
Nov 22 12:28:02.813854689 (266h43m48.172513344s) [noise=true , address=145.79.227.22:4510 , piece_id=UKZITHRBUE6XSTNZ75QPA6CXM47J5VA4JTVVLN2YEPP57GZEFUHQ, seg_pos={0 0}, upload=235200]: Done uploading piece. err: <nil>
Nov 22 12:28:02.814320318 (266h43m48.172978975s) [noise=true , address=145.79.227.20:4439 , piece_id=A3QCT2DI7K5ZLH76TCSZNKM5AWBQS4XOQKOWBCKW276IDPYPAB4Q, seg_pos={0 0}, upload=235200]: Done uploading piece. err: <nil>
Nov 22 12:28:02.814717265 (266h43m48.173375919s) [noise=true , address=145.79.227.6:4258 , piece_id=EN47NLQULZMBOPCZUPKBEA5KIIYNOU6DH4P3FFGJNO3NJXA5XJYA, seg_pos={0 0}, upload=235200]: Done uploading piece. err: <nil>
Nov 22 12:28:02.815557597 (266h43m48.174216256s) [noise=true , address=145.79.227.25:4619 , piece_id=OBEW4APNLTAIQZ4NVJW65IFP3QJU2WWC2TGW27XFVWV7BFVQE6WQ, seg_pos={0 0}, upload=235200]: Done uploading piece. err: <nil>
Nov 22 12:28:02.816139191 (266h43m48.174797847s) [noise=true , address=145.79.227.26:4653 , piece_id=5NHURGUQI64KD2W7XOZ3MQ5XSC4LKOWH2FMB6PLZGS5AJ4PIIVWQ, seg_pos={0 0}, upload=235200]: Done uploading piece. err: <nil>
Nov 22 12:28:02.818536673 (266h43m48.177195346s) [noise=true , address=145.79.227.17:4969 , piece_id=PDDQSVNS5SVL53IETHJT3ISNM4YMZKMFDIPA6CKGAF7AAX2R7SPA, seg_pos={0 0}, upload=235200]: Done uploading piece. err: <nil>
Nov 22 12:28:02.823862626 (266h43m48.182521287s) [noise=true , address=145.79.227.21:4475 , piece_id=D3JAG7JOALQZCFKSRQYNRVSQFU6X47LC64Y65BHTE4BN7E7YEQYQ, seg_pos={0 0}, upload=235200]: Done uploading piece. err: <nil>
Nov 22 12:28:31.647513820 (266h44m17.006172483s) [noise=true , address=77.90.31.21:4877 , piece_id=EAZBORRL2KEJUPA4UBPA6WTYJ3DDKEWOJBRCGV4DUSZLXMC2MGSQ, seg_pos={0 0}, upload=235200]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:45714->77.90.31.21:4877: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 22 12:28:31.647682296 (266h44m17.006340952s) [noise=true , address=45.91.116.12:4225 , piece_id=TH274VOPTSMGHPZYXRZ6LYRALHQIEEODGN2YLPLZ2NJSY2A5EGXQ, seg_pos={0 0}, upload=235200]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: context deadline exceeded; context deadline exceeded
Nov 22 12:28:31.647783194 (266h44m17.00644184s) [noise=true , address=45.91.116.9:4263 , piece_id=VAKRYSB2XYX3NCJHDZSU74MSERC5476BAGT6EWRXMJAEMIKMUVHQ, seg_pos={0 0}, upload=235200]: Done uploading piece. err: ecclient: upload failed (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF, address:45.91.116.9:4263): protocol: write tcp 139.59.144.22:54566->45.91.116.9:4263: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 22 12:28:31.647933048 (266h44m17.006591707s) [noise=true , address=77.90.31.13:4628 , piece_id=N7U7DJ63UWL463WOIKQ4B33BQX3PAANH7DEXXQ6JRBK23VMNOG5A, seg_pos={0 0}, upload=235200]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: rpc: dial tcp 77.90.31.13:4628: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 22 12:28:31.648006034 (266h44m17.006664691s) [noise=true , address=45.91.116.8:4047 , piece_id=PJTK7WLEKPQIXYPZBU3WBTO5DGXCVFKLFR2VEZKAT4FGM7G7BBGA, seg_pos={0 0}, upload=235200]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: read tcp 139.59.144.22:49642->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 22 12:28:31.648034473 (266h44m17.006693117s) [seg_pos={0 0}, upload=235200]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Nov 22 12:28:31.747529469 (266h44m17.106188126s) [upload=235200]: Done uploading segments...
Nov 22 12:28:31.747571263 (266h44m17.106229924s) [upload=235200]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 2.246045966s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
2.625023082s trace:
https://jaeger.dev.storj.io/trace/17892cac9b103a92
FAIL (2025-11-22 12:29:58 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.625051566s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.........................................................X..] duration:
2.057261793s trace:
https://jaeger.dev.storj.io/trace/74063d5209f81b22
FAIL (2025-11-22 12:29:42 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.05728624s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.572232764s trace:
https://jaeger.dev.storj.io/trace/17892cac9b103a92
FAIL (2025-11-22 12:29:23 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.572262574s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..........................................................X.] duration:
1.587648402s trace:
https://jaeger.dev.storj.io/trace/74063d5209f81b22
FAIL (2025-11-22 12:29:22 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.587693666s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
2.304799645s trace:
https://jaeger.dev.storj.io/trace/51125b0f567b79ac
FAIL (2025-11-22 12:29:07 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Nov 22 12:28:01.919416928 (266h43m47.278075583s) [upload=235200]: Starting upload
Nov 22 12:28:01.919480818 (266h43m47.278139473s) [upload=235200]: Done starting upload
Nov 22 12:28:01.919615272 (266h43m47.278273952s) [upload=235200]: Uploading segments...
Nov 22 12:28:01.920129622 (266h43m47.278788286s) [upload=235200]: Got next segment. Inline: false
Nov 22 12:28:01.920467007 (266h43m47.279125669s) [upload=235200]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Nov 22 12:28:01.920490083 (266h43m47.279148738s) [upload=235200]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Nov 22 12:28:02.030268044 (266h43m47.388926702s) [seg_pos={0 0}, upload=235200]: Begin upload segment...
Nov 22 12:28:02.030369022 (266h43m47.389027683s) [noise=true , address=145.79.227.20:4439 , piece_id=A3QCT2DI7K5ZLH76TCSZNKM5AWBQS4XOQKOWBCKW276IDPYPAB4Q, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.034078188 (266h43m47.392736845s) [seg_pos={0 0}, upload=235200]: Done begin upload segment.
Nov 22 12:28:02.034174332 (266h43m47.392833s) [noise=true , address=145.79.227.11:4730 , piece_id=VPOJUOE426WFMOCZQHMDTVUPRXNZJJJE3BBR5PGEKLXZGO2DB6EQ, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.034951433 (266h43m47.393610102s) [noise=true , address=45.91.116.12:4225 , piece_id=TH274VOPTSMGHPZYXRZ6LYRALHQIEEODGN2YLPLZ2NJSY2A5EGXQ, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.036810303 (266h43m47.395468971s) [noise=true , address=77.90.31.13:4628 , piece_id=N7U7DJ63UWL463WOIKQ4B33BQX3PAANH7DEXXQ6JRBK23VMNOG5A, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.039091569 (266h43m47.39775026s) [noise=true , address=145.79.227.21:4475 , piece_id=D3JAG7JOALQZCFKSRQYNRVSQFU6X47LC64Y65BHTE4BN7E7YEQYQ, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.039359308 (266h43m47.398017977s) [noise=true , address=145.79.227.6:4258 , piece_id=EN47NLQULZMBOPCZUPKBEA5KIIYNOU6DH4P3FFGJNO3NJXA5XJYA, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.041951754 (266h43m47.400610415s) [noise=true , address=145.79.227.14:4837 , piece_id=SG67SGG3RYZGRXADNVM352ONMONYJABAOL5NXECDFYD7KYHIQZNA, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.043248768 (266h43m47.401907433s) [noise=true , address=145.79.227.25:4619 , piece_id=OBEW4APNLTAIQZ4NVJW65IFP3QJU2WWC2TGW27XFVWV7BFVQE6WQ, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.044121915 (266h43m47.402780583s) [noise=true , address=145.79.227.12:4767 , piece_id=74PSXYTWYLWMUBGSMD6TU6ECYWZGTWLUOBAZFZZNW3ZIAKO3Q4NQ, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.045770844 (266h43m47.404429565s) [noise=true , address=145.79.227.26:4653 , piece_id=5NHURGUQI64KD2W7XOZ3MQ5XSC4LKOWH2FMB6PLZGS5AJ4PIIVWQ, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.047043815 (266h43m47.405702483s) [noise=true , address=145.79.227.22:4510 , piece_id=UKZITHRBUE6XSTNZ75QPA6CXM47J5VA4JTVVLN2YEPP57GZEFUHQ, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.049880744 (266h43m47.408539411s) [noise=true , address=77.90.31.21:4877 , piece_id=EAZBORRL2KEJUPA4UBPA6WTYJ3DDKEWOJBRCGV4DUSZLXMC2MGSQ, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.051296178 (266h43m47.409954842s) [noise=true , address=145.79.227.17:4969 , piece_id=PDDQSVNS5SVL53IETHJT3ISNM4YMZKMFDIPA6CKGAF7AAX2R7SPA, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.057653012 (266h43m47.41631168s) [noise=true , address=45.91.116.9:4263 , piece_id=VAKRYSB2XYX3NCJHDZSU74MSERC5476BAGT6EWRXMJAEMIKMUVHQ, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.059231071 (266h43m47.41788974s) [noise=true , address=45.91.116.8:4047 , piece_id=PJTK7WLEKPQIXYPZBU3WBTO5DGXCVFKLFR2VEZKAT4FGM7G7BBGA, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.062711176 (266h43m47.421369844s) [noise=true , address=145.79.227.10:4403 , piece_id=YF45JGLWYZ7NEGLJRR2ZFS7YV5VQIUKD7XSJLKLVQY3YJCJ2KZIA, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.659147463 (266h43m48.017806127s) [upload=235200]: Next returned nil segment
Nov 22 12:28:02.659177752 (266h43m48.017836418s) [upload=235200]: Waiting for error group managing segments...
Nov 22 12:28:02.802314837 (266h43m48.160973504s) [noise=true , address=145.79.227.14:4837 , piece_id=SG67SGG3RYZGRXADNVM352ONMONYJABAOL5NXECDFYD7KYHIQZNA, seg_pos={0 0}, upload=235200]: Done uploading piece. err: <nil>
Nov 22 12:28:02.812545911 (266h43m48.171204567s) [noise=true , address=145.79.227.12:4767 , piece_id=74PSXYTWYLWMUBGSMD6TU6ECYWZGTWLUOBAZFZZNW3ZIAKO3Q4NQ, seg_pos={0 0}, upload=235200]: Done uploading piece. err: <nil>
Nov 22 12:28:02.812946565 (266h43m48.171605222s) [noise=true , address=145.79.227.11:4730 , piece_id=VPOJUOE426WFMOCZQHMDTVUPRXNZJJJE3BBR5PGEKLXZGO2DB6EQ, seg_pos={0 0}, upload=235200]: Done uploading piece. err: <nil>
Nov 22 12:28:02.813428679 (266h43m48.172087335s) [noise=true , address=145.79.227.10:4403 , piece_id=YF45JGLWYZ7NEGLJRR2ZFS7YV5VQIUKD7XSJLKLVQY3YJCJ2KZIA, seg_pos={0 0}, upload=235200]: Done uploading piece. err: <nil>
Nov 22 12:28:02.813854689 (266h43m48.172513344s) [noise=true , address=145.79.227.22:4510 , piece_id=UKZITHRBUE6XSTNZ75QPA6CXM47J5VA4JTVVLN2YEPP57GZEFUHQ, seg_pos={0 0}, upload=235200]: Done uploading piece. err: <nil>
Nov 22 12:28:02.814320318 (266h43m48.172978975s) [noise=true , address=145.79.227.20:4439 , piece_id=A3QCT2DI7K5ZLH76TCSZNKM5AWBQS4XOQKOWBCKW276IDPYPAB4Q, seg_pos={0 0}, upload=235200]: Done uploading piece. err: <nil>
Nov 22 12:28:02.814717265 (266h43m48.173375919s) [noise=true , address=145.79.227.6:4258 , piece_id=EN47NLQULZMBOPCZUPKBEA5KIIYNOU6DH4P3FFGJNO3NJXA5XJYA, seg_pos={0 0}, upload=235200]: Done uploading piece. err: <nil>
Nov 22 12:28:02.815557597 (266h43m48.174216256s) [noise=true , address=145.79.227.25:4619 , piece_id=OBEW4APNLTAIQZ4NVJW65IFP3QJU2WWC2TGW27XFVWV7BFVQE6WQ, seg_pos={0 0}, upload=235200]: Done uploading piece. err: <nil>
Nov 22 12:28:02.816139191 (266h43m48.174797847s) [noise=true , address=145.79.227.26:4653 , piece_id=5NHURGUQI64KD2W7XOZ3MQ5XSC4LKOWH2FMB6PLZGS5AJ4PIIVWQ, seg_pos={0 0}, upload=235200]: Done uploading piece. err: <nil>
Nov 22 12:28:02.818536673 (266h43m48.177195346s) [noise=true , address=145.79.227.17:4969 , piece_id=PDDQSVNS5SVL53IETHJT3ISNM4YMZKMFDIPA6CKGAF7AAX2R7SPA, seg_pos={0 0}, upload=235200]: Done uploading piece. err: <nil>
Nov 22 12:28:02.823862626 (266h43m48.182521287s) [noise=true , address=145.79.227.21:4475 , piece_id=D3JAG7JOALQZCFKSRQYNRVSQFU6X47LC64Y65BHTE4BN7E7YEQYQ, seg_pos={0 0}, upload=235200]: Done uploading piece. err: <nil>
Nov 22 12:28:31.647513820 (266h44m17.006172483s) [noise=true , address=77.90.31.21:4877 , piece_id=EAZBORRL2KEJUPA4UBPA6WTYJ3DDKEWOJBRCGV4DUSZLXMC2MGSQ, seg_pos={0 0}, upload=235200]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:45714->77.90.31.21:4877: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 22 12:28:31.647682296 (266h44m17.006340952s) [noise=true , address=45.91.116.12:4225 , piece_id=TH274VOPTSMGHPZYXRZ6LYRALHQIEEODGN2YLPLZ2NJSY2A5EGXQ, seg_pos={0 0}, upload=235200]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: context deadline exceeded; context deadline exceeded
Nov 22 12:28:31.647783194 (266h44m17.00644184s) [noise=true , address=45.91.116.9:4263 , piece_id=VAKRYSB2XYX3NCJHDZSU74MSERC5476BAGT6EWRXMJAEMIKMUVHQ, seg_pos={0 0}, upload=235200]: Done uploading piece. err: ecclient: upload failed (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF, address:45.91.116.9:4263): protocol: write tcp 139.59.144.22:54566->45.91.116.9:4263: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 22 12:28:31.647933048 (266h44m17.006591707s) [noise=true , address=77.90.31.13:4628 , piece_id=N7U7DJ63UWL463WOIKQ4B33BQX3PAANH7DEXXQ6JRBK23VMNOG5A, seg_pos={0 0}, upload=235200]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: rpc: dial tcp 77.90.31.13:4628: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 22 12:28:31.648006034 (266h44m17.006664691s) [noise=true , address=45.91.116.8:4047 , piece_id=PJTK7WLEKPQIXYPZBU3WBTO5DGXCVFKLFR2VEZKAT4FGM7G7BBGA, seg_pos={0 0}, upload=235200]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: read tcp 139.59.144.22:49642->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 22 12:28:31.648034473 (266h44m17.006693117s) [seg_pos={0 0}, upload=235200]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Nov 22 12:28:31.747529469 (266h44m17.106188126s) [upload=235200]: Done uploading segments...
Nov 22 12:28:31.747571263 (266h44m17.106229924s) [upload=235200]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 2.304823829s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
2.969446738s trace:
https://jaeger.dev.storj.io/trace/17892cac9b103a92
FAIL (2025-11-22 12:28:54 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.969495383s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.001510507s trace:
https://jaeger.dev.storj.io/trace/17892cac9b103a92
FAIL (2025-11-22 12:28:50 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 30.001529333s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...........................................................X] duration:
5.001900008s trace:
https://jaeger.dev.storj.io/trace/74063d5209f81b22
FAIL (2025-11-22 12:28:40 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001920882s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.101659202s trace:
https://jaeger.dev.storj.io/trace/51125b0f567b79ac
FAIL (2025-11-22 12:28:31 UTC)
orbiter warning:
operation: Commit
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 11)
======LOGS======
Nov 22 12:28:01.919416928 (266h43m47.278075583s) [upload=235200]: Starting upload
Nov 22 12:28:01.919480818 (266h43m47.278139473s) [upload=235200]: Done starting upload
Nov 22 12:28:01.919615272 (266h43m47.278273952s) [upload=235200]: Uploading segments...
Nov 22 12:28:01.920129622 (266h43m47.278788286s) [upload=235200]: Got next segment. Inline: false
Nov 22 12:28:01.920467007 (266h43m47.279125669s) [upload=235200]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Nov 22 12:28:01.920490083 (266h43m47.279148738s) [upload=235200]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Nov 22 12:28:02.030268044 (266h43m47.388926702s) [seg_pos={0 0}, upload=235200]: Begin upload segment...
Nov 22 12:28:02.030369022 (266h43m47.389027683s) [noise=true , address=145.79.227.20:4439 , piece_id=A3QCT2DI7K5ZLH76TCSZNKM5AWBQS4XOQKOWBCKW276IDPYPAB4Q, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.034078188 (266h43m47.392736845s) [seg_pos={0 0}, upload=235200]: Done begin upload segment.
Nov 22 12:28:02.034174332 (266h43m47.392833s) [noise=true , address=145.79.227.11:4730 , piece_id=VPOJUOE426WFMOCZQHMDTVUPRXNZJJJE3BBR5PGEKLXZGO2DB6EQ, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.034951433 (266h43m47.393610102s) [noise=true , address=45.91.116.12:4225 , piece_id=TH274VOPTSMGHPZYXRZ6LYRALHQIEEODGN2YLPLZ2NJSY2A5EGXQ, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.036810303 (266h43m47.395468971s) [noise=true , address=77.90.31.13:4628 , piece_id=N7U7DJ63UWL463WOIKQ4B33BQX3PAANH7DEXXQ6JRBK23VMNOG5A, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.039091569 (266h43m47.39775026s) [noise=true , address=145.79.227.21:4475 , piece_id=D3JAG7JOALQZCFKSRQYNRVSQFU6X47LC64Y65BHTE4BN7E7YEQYQ, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.039359308 (266h43m47.398017977s) [noise=true , address=145.79.227.6:4258 , piece_id=EN47NLQULZMBOPCZUPKBEA5KIIYNOU6DH4P3FFGJNO3NJXA5XJYA, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.041951754 (266h43m47.400610415s) [noise=true , address=145.79.227.14:4837 , piece_id=SG67SGG3RYZGRXADNVM352ONMONYJABAOL5NXECDFYD7KYHIQZNA, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.043248768 (266h43m47.401907433s) [noise=true , address=145.79.227.25:4619 , piece_id=OBEW4APNLTAIQZ4NVJW65IFP3QJU2WWC2TGW27XFVWV7BFVQE6WQ, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.044121915 (266h43m47.402780583s) [noise=true , address=145.79.227.12:4767 , piece_id=74PSXYTWYLWMUBGSMD6TU6ECYWZGTWLUOBAZFZZNW3ZIAKO3Q4NQ, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.045770844 (266h43m47.404429565s) [noise=true , address=145.79.227.26:4653 , piece_id=5NHURGUQI64KD2W7XOZ3MQ5XSC4LKOWH2FMB6PLZGS5AJ4PIIVWQ, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.047043815 (266h43m47.405702483s) [noise=true , address=145.79.227.22:4510 , piece_id=UKZITHRBUE6XSTNZ75QPA6CXM47J5VA4JTVVLN2YEPP57GZEFUHQ, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.049880744 (266h43m47.408539411s) [noise=true , address=77.90.31.21:4877 , piece_id=EAZBORRL2KEJUPA4UBPA6WTYJ3DDKEWOJBRCGV4DUSZLXMC2MGSQ, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.051296178 (266h43m47.409954842s) [noise=true , address=145.79.227.17:4969 , piece_id=PDDQSVNS5SVL53IETHJT3ISNM4YMZKMFDIPA6CKGAF7AAX2R7SPA, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.057653012 (266h43m47.41631168s) [noise=true , address=45.91.116.9:4263 , piece_id=VAKRYSB2XYX3NCJHDZSU74MSERC5476BAGT6EWRXMJAEMIKMUVHQ, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.059231071 (266h43m47.41788974s) [noise=true , address=45.91.116.8:4047 , piece_id=PJTK7WLEKPQIXYPZBU3WBTO5DGXCVFKLFR2VEZKAT4FGM7G7BBGA, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.062711176 (266h43m47.421369844s) [noise=true , address=145.79.227.10:4403 , piece_id=YF45JGLWYZ7NEGLJRR2ZFS7YV5VQIUKD7XSJLKLVQY3YJCJ2KZIA, seg_pos={0 0}, upload=235200]: Uploading piece...
Nov 22 12:28:02.659147463 (266h43m48.017806127s) [upload=235200]: Next returned nil segment
Nov 22 12:28:02.659177752 (266h43m48.017836418s) [upload=235200]: Waiting for error group managing segments...
Nov 22 12:28:02.802314837 (266h43m48.160973504s) [noise=true , address=145.79.227.14:4837 , piece_id=SG67SGG3RYZGRXADNVM352ONMONYJABAOL5NXECDFYD7KYHIQZNA, seg_pos={0 0}, upload=235200]: Done uploading piece. err: <nil>
Nov 22 12:28:02.812545911 (266h43m48.171204567s) [noise=true , address=145.79.227.12:4767 , piece_id=74PSXYTWYLWMUBGSMD6TU6ECYWZGTWLUOBAZFZZNW3ZIAKO3Q4NQ, seg_pos={0 0}, upload=235200]: Done uploading piece. err: <nil>
Nov 22 12:28:02.812946565 (266h43m48.171605222s) [noise=true , address=145.79.227.11:4730 , piece_id=VPOJUOE426WFMOCZQHMDTVUPRXNZJJJE3BBR5PGEKLXZGO2DB6EQ, seg_pos={0 0}, upload=235200]: Done uploading piece. err: <nil>
Nov 22 12:28:02.813428679 (266h43m48.172087335s) [noise=true , address=145.79.227.10:4403 , piece_id=YF45JGLWYZ7NEGLJRR2ZFS7YV5VQIUKD7XSJLKLVQY3YJCJ2KZIA, seg_pos={0 0}, upload=235200]: Done uploading piece. err: <nil>
Nov 22 12:28:02.813854689 (266h43m48.172513344s) [noise=true , address=145.79.227.22:4510 , piece_id=UKZITHRBUE6XSTNZ75QPA6CXM47J5VA4JTVVLN2YEPP57GZEFUHQ, seg_pos={0 0}, upload=235200]: Done uploading piece. err: <nil>
Nov 22 12:28:02.814320318 (266h43m48.172978975s) [noise=true , address=145.79.227.20:4439 , piece_id=A3QCT2DI7K5ZLH76TCSZNKM5AWBQS4XOQKOWBCKW276IDPYPAB4Q, seg_pos={0 0}, upload=235200]: Done uploading piece. err: <nil>
Nov 22 12:28:02.814717265 (266h43m48.173375919s) [noise=true , address=145.79.227.6:4258 , piece_id=EN47NLQULZMBOPCZUPKBEA5KIIYNOU6DH4P3FFGJNO3NJXA5XJYA, seg_pos={0 0}, upload=235200]: Done uploading piece. err: <nil>
Nov 22 12:28:02.815557597 (266h43m48.174216256s) [noise=true , address=145.79.227.25:4619 , piece_id=OBEW4APNLTAIQZ4NVJW65IFP3QJU2WWC2TGW27XFVWV7BFVQE6WQ, seg_pos={0 0}, upload=235200]: Done uploading piece. err: <nil>
Nov 22 12:28:02.816139191 (266h43m48.174797847s) [noise=true , address=145.79.227.26:4653 , piece_id=5NHURGUQI64KD2W7XOZ3MQ5XSC4LKOWH2FMB6PLZGS5AJ4PIIVWQ, seg_pos={0 0}, upload=235200]: Done uploading piece. err: <nil>
Nov 22 12:28:02.818536673 (266h43m48.177195346s) [noise=true , address=145.79.227.17:4969 , piece_id=PDDQSVNS5SVL53IETHJT3ISNM4YMZKMFDIPA6CKGAF7AAX2R7SPA, seg_pos={0 0}, upload=235200]: Done uploading piece. err: <nil>
Nov 22 12:28:02.823862626 (266h43m48.182521287s) [noise=true , address=145.79.227.21:4475 , piece_id=D3JAG7JOALQZCFKSRQYNRVSQFU6X47LC64Y65BHTE4BN7E7YEQYQ, seg_pos={0 0}, upload=235200]: Done uploading piece. err: <nil>
Nov 22 12:28:31.647513820 (266h44m17.006172483s) [noise=true , address=77.90.31.21:4877 , piece_id=EAZBORRL2KEJUPA4UBPA6WTYJ3DDKEWOJBRCGV4DUSZLXMC2MGSQ, seg_pos={0 0}, upload=235200]: Done uploading piece. err: ecclient: upload failed (node:12qy6swRPui25KAsuj9PzHvijxQFHoaLMJ95LvK34pCA9UU3gR2, address:77.90.31.21:4877): protocol: write tcp 139.59.144.22:45714->77.90.31.21:4877: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 22 12:28:31.647682296 (266h44m17.006340952s) [noise=true , address=45.91.116.12:4225 , piece_id=TH274VOPTSMGHPZYXRZ6LYRALHQIEEODGN2YLPLZ2NJSY2A5EGXQ, seg_pos={0 0}, upload=235200]: Done uploading piece. err: ecclient: upload failed (node:12AXaXCJFwDBoz9beNXsHYyfdgRkcX684iB6msjy9d5FkmwCWhy, address:45.91.116.12:4225): protocol: context deadline exceeded; context deadline exceeded
Nov 22 12:28:31.647783194 (266h44m17.00644184s) [noise=true , address=45.91.116.9:4263 , piece_id=VAKRYSB2XYX3NCJHDZSU74MSERC5476BAGT6EWRXMJAEMIKMUVHQ, seg_pos={0 0}, upload=235200]: Done uploading piece. err: ecclient: upload failed (node:1TP3JkhssLqPE6onMrKvTwA49PQUBJfuZWcPnGUeJd8UqR8zrF, address:45.91.116.9:4263): protocol: write tcp 139.59.144.22:54566->45.91.116.9:4263: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 22 12:28:31.647933048 (266h44m17.006591707s) [noise=true , address=77.90.31.13:4628 , piece_id=N7U7DJ63UWL463WOIKQ4B33BQX3PAANH7DEXXQ6JRBK23VMNOG5A, seg_pos={0 0}, upload=235200]: Done uploading piece. err: ecclient: upload failed (node:1ERDD2hvVwWnBGdG7C1aCWMZGzbGHtKeKio5fwRkmo5f8fms8a, address:77.90.31.13:4628): protocol: rpc: dial tcp 77.90.31.13:4628: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 22 12:28:31.648006034 (266h44m17.006664691s) [noise=true , address=45.91.116.8:4047 , piece_id=PJTK7WLEKPQIXYPZBU3WBTO5DGXCVFKLFR2VEZKAT4FGM7G7BBGA, seg_pos={0 0}, upload=235200]: Done uploading piece. err: ecclient: upload failed (node:12g3HzcNJXwLseiT8QVdE5yRJc91qtYsH9D7HGTiRVkiwnQ7sdN, address:45.91.116.8:4047): protocol: read tcp 139.59.144.22:49642->45.91.116.8:4047: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Nov 22 12:28:31.648034473 (266h44m17.006693117s) [seg_pos={0 0}, upload=235200]: Done waiting for segment. successful: 11 optimal: 13 errs: <nil>
Nov 22 12:28:31.747529469 (266h44m17.106188126s) [upload=235200]: Done uploading segments...
Nov 22 12:28:31.747571263 (266h44m17.106229924s) [upload=235200]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 11)
Duration: 30.101688169s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [X...........................................................] duration:
1.584712024s trace:
https://jaeger.dev.storj.io/trace/16a78aa03a8a3341
FAIL (2025-11-22 12:13:42 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.584739144s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.X..........................................................] duration:
1.644983634s trace:
https://jaeger.dev.storj.io/trace/16a78aa03a8a3341
FAIL (2025-11-22 12:12:58 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.644998251s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..X.........................................................] duration:
1.547058457s trace:
https://jaeger.dev.storj.io/trace/16a78aa03a8a3341
FAIL (2025-11-22 12:11:59 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.547094637s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...X........................................................] duration:
1.527390333s trace:
https://jaeger.dev.storj.io/trace/16a78aa03a8a3341
FAIL (2025-11-22 12:10:56 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.527419135s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [....X.......................................................] duration:
1.872178536s trace:
https://jaeger.dev.storj.io/trace/16a78aa03a8a3341
FAIL (2025-11-22 12:10:35 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.872204468s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.....X......................................................] duration:
1.571632318s trace:
https://jaeger.dev.storj.io/trace/16a78aa03a8a3341
FAIL (2025-11-22 12:09:37 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.571665721s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [......X.....................................................] duration:
1.617934175s trace:
https://jaeger.dev.storj.io/trace/16a78aa03a8a3341
FAIL (2025-11-22 12:08:29 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.617954781s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.......X....................................................] duration:
1.647337562s trace:
https://jaeger.dev.storj.io/trace/16a78aa03a8a3341
FAIL (2025-11-22 12:08:12 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.647445195s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [........X...................................................] duration:
1.654228527s trace:
https://jaeger.dev.storj.io/trace/16a78aa03a8a3341
FAIL (2025-11-22 12:07:19 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.654258781s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.........X..................................................] duration:
1.959954742s trace:
https://jaeger.dev.storj.io/trace/16a78aa03a8a3341
FAIL (2025-11-22 12:06:25 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.959976962s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..........X.................................................] duration:
1.692393972s trace:
https://jaeger.dev.storj.io/trace/16a78aa03a8a3341
FAIL (2025-11-22 12:06:02 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.692482512s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...........X................................................] duration:
1.584393354s trace:
https://jaeger.dev.storj.io/trace/16a78aa03a8a3341
FAIL (2025-11-22 12:04:52 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.584419911s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [............X...............................................] duration:
1.574931745s trace:
https://jaeger.dev.storj.io/trace/16a78aa03a8a3341
FAIL (2025-11-22 12:04:21 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.57497039s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.............X..............................................] duration:
1.622528287s trace:
https://jaeger.dev.storj.io/trace/16a78aa03a8a3341
FAIL (2025-11-22 12:03:42 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.622623715s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..............X.............................................] duration:
1.571077921s trace:
https://jaeger.dev.storj.io/trace/16a78aa03a8a3341
FAIL (2025-11-22 12:02:35 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.571105433s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...............X............................................] duration:
1.580014907s trace:
https://jaeger.dev.storj.io/trace/16a78aa03a8a3341
FAIL (2025-11-22 12:02:18 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.580155913s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [................X...........................................] duration:
1.634197512s trace:
https://jaeger.dev.storj.io/trace/16a78aa03a8a3341
FAIL (2025-11-22 12:02:03 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.634229274s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.................X..........................................] duration:
1.646594588s trace:
https://jaeger.dev.storj.io/trace/16a78aa03a8a3341
FAIL (2025-11-22 12:01:03 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.646679735s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..................X.........................................] duration:
1.662008284s trace:
https://jaeger.dev.storj.io/trace/16a78aa03a8a3341
FAIL (2025-11-22 12:00:38 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.662040139s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...................X........................................] duration:
2.168216308s trace:
https://jaeger.dev.storj.io/trace/16a78aa03a8a3341
FAIL (2025-11-22 11:59:44 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.168245134s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [....................X.......................................] duration:
1.594664247s trace:
https://jaeger.dev.storj.io/trace/16a78aa03a8a3341
FAIL (2025-11-22 11:58:36 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.594691709s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.....................X......................................] duration:
1.622427086s trace:
https://jaeger.dev.storj.io/trace/16a78aa03a8a3341
FAIL (2025-11-22 11:57:42 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.622460734s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [......................X.....................................] duration:
1.708684887s trace:
https://jaeger.dev.storj.io/trace/16a78aa03a8a3341
FAIL (2025-11-22 11:56:32 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.708710054s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.......................X....................................] duration:
1.685258716s trace:
https://jaeger.dev.storj.io/trace/16a78aa03a8a3341
FAIL (2025-11-22 11:55:45 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.685273033s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [........................X...................................] duration:
1.621495693s trace:
https://jaeger.dev.storj.io/trace/16a78aa03a8a3341
FAIL (2025-11-22 11:55:21 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.621542098s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.........................X..................................] duration:
1.705193341s trace:
https://jaeger.dev.storj.io/trace/16a78aa03a8a3341
FAIL (2025-11-22 11:54:30 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.705266912s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..........................X.................................] duration:
1.590408277s trace:
https://jaeger.dev.storj.io/trace/16a78aa03a8a3341
FAIL (2025-11-22 11:53:30 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.590430747s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...........................X................................] duration:
2.186066951s trace:
https://jaeger.dev.storj.io/trace/16a78aa03a8a3341
FAIL (2025-11-22 11:52:25 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.186258503s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [............................X...............................] duration:
1.643032849s trace:
https://jaeger.dev.storj.io/trace/16a78aa03a8a3341
FAIL (2025-11-22 11:51:50 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.64305896s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.............................X..............................] duration:
1.681903076s trace:
https://jaeger.dev.storj.io/trace/16a78aa03a8a3341
FAIL (2025-11-22 11:50:44 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.681931183s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..............................X.............................] duration:
1.522714534s trace:
https://jaeger.dev.storj.io/trace/16a78aa03a8a3341
FAIL (2025-11-22 11:49:46 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.52273193s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...............................X............................] duration:
1.664525084s trace:
https://jaeger.dev.storj.io/trace/16a78aa03a8a3341
FAIL (2025-11-22 11:48:36 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.664552248s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [................................X...........................] duration:
1.791423817s trace:
https://jaeger.dev.storj.io/trace/16a78aa03a8a3341
FAIL (2025-11-22 11:47:55 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.791445046s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [.................................X..........................] duration:
1.81700833s trace:
https://jaeger.dev.storj.io/trace/16a78aa03a8a3341
FAIL (2025-11-22 11:47:01 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.817032235s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [..................................X.........................] duration:
1.636071846s trace:
https://jaeger.dev.storj.io/trace/16a78aa03a8a3341
FAIL (2025-11-22 11:46:33 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 1.636096208s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [...................................X........................] duration:
2.231549375s trace:
https://jaeger.dev.storj.io/trace/16a78aa03a8a3341
FAIL (2025-11-22 11:46:02 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.231577612s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)antiblip:
1 out of 60 is failed (threshold=6) [....................................X.......................] duration:
2.116967385s trace:
https://jaeger.dev.storj.io/trace/16a78aa03a8a3341
FAIL (2025-11-22 11:45:31 UTC)
orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.116991988s
core
uplink
us-select-1
us1-placement-20
|