Orbiter History

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 300.624922ms FAIL (2025-08-09 03:36:57 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 300.656235ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 2.790975599s FAIL (2025-08-09 03:36:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.791004269s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............X.X............................................] duration: 2.349985247s FAIL (2025-08-09 03:36:44 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 9 03:05:31.488178202 (9h39m53.447275451s) [upload=10003]: Starting upload Aug 9 03:05:31.488243062 (9h39m53.447340313s) [upload=10003]: Done starting upload Aug 9 03:05:31.488520349 (9h39m53.447617586s) [upload=10003]: Uploading segments... Aug 9 03:05:31.488561280 (9h39m53.447658531s) [upload=10003]: Got next segment. Inline: false Aug 9 03:05:31.488597455 (9h39m53.4476947s) [upload=10003]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:05:31.488603235 (9h39m53.447700483s) [upload=10003]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:05:31.690199947 (9h39m53.64929718s) [seg_pos={0 0}, upload=10003]: Begin upload segment... Aug 9 03:05:31.690262128 (9h39m53.649359359s) [seg_pos={0 0}, upload=10003]: Done begin upload segment. Aug 9 03:05:31.690288316 (9h39m53.649385564s) [noise=true , address=104.36.82.34:4580 , piece_id=BRRNV77O47TZTLBLQAMU35KH7W42DJJMYDYZBCZI63TZBIRT22ZQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.690685581 (9h39m53.649782826s) [noise=true , address=104.36.82.16:4326 , piece_id=WBKXCDM2WHHL7BPGGXWMH5VQHHLDYMEAKDIV5OELPLK4BMYA2A3A, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.690925443 (9h39m53.650022688s) [noise=true , address=104.36.82.5:4850 , piece_id=YGTUS6L4ELADSHJ6QYQ4TVJISX2JFORARWXLTFVKJBP6U5G3VRXQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.691149841 (9h39m53.650247086s) [noise=true , address=104.36.82.3:4772 , piece_id=I6Q2XEMVL7CZRKENESNBVTNAMPJF4IHQZE5W5FUGZSZXKH6YRXYQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.691380031 (9h39m53.650477275s) [noise=true , address=104.36.82.13:4202 , piece_id=PX2AVXLFICW4VGCM5WRS3CY3GRCXAR4ZN6JQSXGNOVO26AEFQPTQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.691612202 (9h39m53.650709446s) [noise=true , address=104.36.82.4:4814 , piece_id=Q5DTS47O6DLKJTCI5F7OZB6W4WZNOSMF462Q73UETEYVLFUDX62Q, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.691827018 (9h39m53.650924264s) [noise=true , address=45.91.116.14:4195 , piece_id=U763VPOFJAUF3XRGH7BIPOMCTL35D7LT4OA6ZZ2AS3DCKRYUJNCQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.692040013 (9h39m53.651137258s) [noise=true , address=104.36.82.60:4358 , piece_id=AHUW2J7XY7EWOWCAIP2PMGNUF5VRGBKNZCIFFZ2KFQNGT7MQYZ3A, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.692254203 (9h39m53.651351447s) [noise=true , address=104.36.82.37:4667 , piece_id=XA7XLBRYMZLV6UB2IF5UZSMCFNK3VW3GGBQDPFUBOFGBSYEALKDQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.692476775 (9h39m53.651574019s) [noise=true , address=104.36.82.43:4848 , piece_id=WQHSYXUZ2FXCAOXY5C4J5LDOMVJI5E47IM3C5TFGH33YI4IZIJAA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.692785368 (9h39m53.651882616s) [noise=true , address=104.36.82.54:4190 , piece_id=RT7X76F4QPLLWESXMT6SDXBS7MG7S5PYMCIQHZ3JCA5XIIUS5ESQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.693052989 (9h39m53.652150234s) [noise=true , address=64.49.13.26:4953 , piece_id=2GNCQMTWJGSSKHYOCSN5S57UX5YTVHBSGFJAM5UTZFJAKKL6FQCQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.693314052 (9h39m53.652411297s) [noise=true , address=104.36.82.17:4347 , piece_id=QHSZXBGCDFH7DNEKD3LAYS4XA4YU7DUAK6CRHKKZHOSWSDRF6QDA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.693595248 (9h39m53.6526925s) [noise=true , address=104.36.82.46:4500 , piece_id=LRR2PS5QFTUPGYYNK7EEHRTROP3AQ7QE74F6JAK4LWVE7EN2EZBA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.693869121 (9h39m53.652966367s) [noise=true , address=45.91.116.7:4025 , piece_id=Z6A447ONI4GUMEF5WWQ2L2PHBRJTKO4QCOZLTEXVAHHBZUUFKOUA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.694207416 (9h39m53.653304665s) [noise=true , address=104.36.82.41:4779 , piece_id=PE4J4FHPAUHP6NQEU6C7PHT4BNYUABILIJINN37JESLHOYYLXMYA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.694448521 (9h39m53.653545768s) [noise=true , address=104.36.82.58:4295 , piece_id=MMIHZOQEG3JPK7GAW5NQPHH3Y6NRZXMGRJKEUTG5THJKYW3A7XDQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.694674957 (9h39m53.653772205s) [noise=true , address=104.36.82.11:4148 , piece_id=Q2VZE5VX4E4N4LA3QQQ5EYYNLTYX25LUEQ6PR7E336BNEOUZY7MQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:32.242593722 (9h39m54.201690968s) [upload=10003]: Next returned nil segment Aug 9 03:05:32.242617676 (9h39m54.201714926s) [upload=10003]: Waiting for error group managing segments... Aug 9 03:05:32.425674691 (9h39m54.384771929s) [noise=true , address=104.36.82.54:4190 , piece_id=RT7X76F4QPLLWESXMT6SDXBS7MG7S5PYMCIQHZ3JCA5XIIUS5ESQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.427558968 (9h39m54.386656208s) [noise=true , address=104.36.82.58:4295 , piece_id=MMIHZOQEG3JPK7GAW5NQPHH3Y6NRZXMGRJKEUTG5THJKYW3A7XDQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.429461053 (9h39m54.388558292s) [noise=true , address=45.91.116.14:4195 , piece_id=U763VPOFJAUF3XRGH7BIPOMCTL35D7LT4OA6ZZ2AS3DCKRYUJNCQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.432230839 (9h39m54.39132809s) [noise=true , address=104.36.82.41:4779 , piece_id=PE4J4FHPAUHP6NQEU6C7PHT4BNYUABILIJINN37JESLHOYYLXMYA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.432859806 (9h39m54.391957052s) [noise=true , address=104.36.82.3:4772 , piece_id=I6Q2XEMVL7CZRKENESNBVTNAMPJF4IHQZE5W5FUGZSZXKH6YRXYQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.433288450 (9h39m54.392385696s) [noise=true , address=104.36.82.11:4148 , piece_id=Q2VZE5VX4E4N4LA3QQQ5EYYNLTYX25LUEQ6PR7E336BNEOUZY7MQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.433815721 (9h39m54.392912967s) [noise=true , address=104.36.82.37:4667 , piece_id=XA7XLBRYMZLV6UB2IF5UZSMCFNK3VW3GGBQDPFUBOFGBSYEALKDQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.434420797 (9h39m54.393518033s) [noise=true , address=104.36.82.5:4850 , piece_id=YGTUS6L4ELADSHJ6QYQ4TVJISX2JFORARWXLTFVKJBP6U5G3VRXQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.434893408 (9h39m54.393990652s) [noise=true , address=45.91.116.7:4025 , piece_id=Z6A447ONI4GUMEF5WWQ2L2PHBRJTKO4QCOZLTEXVAHHBZUUFKOUA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.437617758 (9h39m54.396715008s) [noise=true , address=104.36.82.16:4326 , piece_id=WBKXCDM2WHHL7BPGGXWMH5VQHHLDYMEAKDIV5OELPLK4BMYA2A3A, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.446231916 (9h39m54.40532915s) [noise=true , address=104.36.82.4:4814 , piece_id=Q5DTS47O6DLKJTCI5F7OZB6W4WZNOSMF462Q73UETEYVLFUDX62Q, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.446909731 (9h39m54.406006978s) [noise=true , address=104.36.82.13:4202 , piece_id=PX2AVXLFICW4VGCM5WRS3CY3GRCXAR4ZN6JQSXGNOVO26AEFQPTQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.448246534 (9h39m54.407343784s) [noise=true , address=104.36.82.46:4500 , piece_id=LRR2PS5QFTUPGYYNK7EEHRTROP3AQ7QE74F6JAK4LWVE7EN2EZBA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.449834746 (9h39m54.408931999s) [noise=true , address=104.36.82.60:4358 , piece_id=AHUW2J7XY7EWOWCAIP2PMGNUF5VRGBKNZCIFFZ2KFQNGT7MQYZ3A, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.449851811 (9h39m54.408949064s) [seg_pos={0 0}, upload=10003]: Segment reached optimal threshold of 14 pieces. Aug 9 03:05:32.450304422 (9h39m54.409401679s) [noise=true , address=104.36.82.34:4580 , piece_id=BRRNV77O47TZTLBLQAMU35KH7W42DJJMYDYZBCZI63TZBIRT22ZQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12569SWj8WmR8tWoBXk7XJK1KS6BZMcYHrQjPKGfhj21xFPQ1W3): protocol: expected piece hash; context canceled; EOF Aug 9 03:05:32.450411008 (9h39m54.409508255s) [noise=true , address=104.36.82.17:4347 , piece_id=QHSZXBGCDFH7DNEKD3LAYS4XA4YU7DUAK6CRHKKZHOSWSDRF6QDA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gCmsGzM2h65bWs16EY6VPrxewcUDnhvfdb1aRPZ8EMhCYHfaA): protocol: expected piece hash; context canceled; EOF Aug 9 03:05:32.450492811 (9h39m54.409590057s) [noise=true , address=104.36.82.43:4848 , piece_id=WQHSYXUZ2FXCAOXY5C4J5LDOMVJI5E47IM3C5TFGH33YI4IZIJAA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DPLv5Kfsx9RLVWeRrxbdkaLGJc4dfrzGnPLwc8us9hT5uiPbj): protocol: expected piece hash; context canceled; EOF Aug 9 03:05:32.450611707 (9h39m54.409708955s) [noise=true , address=64.49.13.26:4953 , piece_id=2GNCQMTWJGSSKHYOCSN5S57UX5YTVHBSGFJAM5UTZFJAKKL6FQCQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvztpAXVj8B4XY7FgaFcsWtqwSxzpV4sRc926EigSpGqnytXE): protocol: write tcp 139.59.144.22:35798->64.49.13.26:4953: use of closed network connection; write tcp 139.59.144.22:35798->64.49.13.26:4953: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35798->64.49.13.26:4953: use of closed network connection Aug 9 03:05:32.450627802 (9h39m54.409725061s) [seg_pos={0 0}, upload=10003]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:05:32.450714540 (9h39m54.409811797s) [upload=10003]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:05:32.450720222 (9h39m54.409817475s) [upload=10003]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:05:32.612407319 (9h39m54.571504583s) [upload=10003]: Done uploading segments... Aug 9 03:05:32.612437481 (9h39m54.571534716s) [upload=10003]: Upload finished. err: <nil> Duration: 2.350020274s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [............X....................................X..........] duration: 971.418799ms FAIL (2025-08-09 03:36:32 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:29:07.630773590 (10h3m29.589870841s) [upload=10421]: Starting upload Aug 9 03:29:07.630849282 (10h3m29.589946539s) [upload=10421]: Done starting upload Aug 9 03:29:07.630961591 (10h3m29.590058839s) [upload=10421]: Uploading segments... Aug 9 03:29:07.631490444 (10h3m29.5905877s) [upload=10421]: Got next segment. Inline: true Aug 9 03:29:07.631520161 (10h3m29.590617411s) [upload=10421]: Waiting for error group managing segments... Aug 9 03:29:07.631602338 (10h3m29.59069957s) [upload=10421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:29:07.631609557 (10h3m29.590706809s) [upload=10421]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:29:07.631614555 (10h3m29.590711801s) [upload=10421]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:29:07.719629732 (10h3m29.678726989s) [upload=10421]: Done uploading segments... Aug 9 03:29:07.719673059 (10h3m29.678770322s) [upload=10421]: Upload finished. err: metaclient: Too Many Requests Duration:* 971.450219ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 1.033426068s FAIL (2025-08-09 03:36:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.033454879s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 1.108255074s FAIL (2025-08-09 03:35:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.10829396s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 2.842214291s FAIL (2025-08-09 03:35:53 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.842247252s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.............X....................................X.........] duration: 893.832184ms FAIL (2025-08-09 03:35:44 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:29:07.630773590 (10h3m29.589870841s) [upload=10421]: Starting upload Aug 9 03:29:07.630849282 (10h3m29.589946539s) [upload=10421]: Done starting upload Aug 9 03:29:07.630961591 (10h3m29.590058839s) [upload=10421]: Uploading segments... Aug 9 03:29:07.631490444 (10h3m29.5905877s) [upload=10421]: Got next segment. Inline: true Aug 9 03:29:07.631520161 (10h3m29.590617411s) [upload=10421]: Waiting for error group managing segments... Aug 9 03:29:07.631602338 (10h3m29.59069957s) [upload=10421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:29:07.631609557 (10h3m29.590706809s) [upload=10421]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:29:07.631614555 (10h3m29.590711801s) [upload=10421]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:29:07.719629732 (10h3m29.678726989s) [upload=10421]: Done uploading segments... Aug 9 03:29:07.719673059 (10h3m29.678770322s) [upload=10421]: Upload finished. err: metaclient: Too Many Requests Duration:* 893.857471ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 357.639728ms FAIL (2025-08-09 03:35:44 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 357.668795ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............X.X...........................................] duration: 2.396222097s FAIL (2025-08-09 03:35:29 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 9 03:05:31.488178202 (9h39m53.447275451s) [upload=10003]: Starting upload Aug 9 03:05:31.488243062 (9h39m53.447340313s) [upload=10003]: Done starting upload Aug 9 03:05:31.488520349 (9h39m53.447617586s) [upload=10003]: Uploading segments... Aug 9 03:05:31.488561280 (9h39m53.447658531s) [upload=10003]: Got next segment. Inline: false Aug 9 03:05:31.488597455 (9h39m53.4476947s) [upload=10003]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:05:31.488603235 (9h39m53.447700483s) [upload=10003]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:05:31.690199947 (9h39m53.64929718s) [seg_pos={0 0}, upload=10003]: Begin upload segment... Aug 9 03:05:31.690262128 (9h39m53.649359359s) [seg_pos={0 0}, upload=10003]: Done begin upload segment. Aug 9 03:05:31.690288316 (9h39m53.649385564s) [noise=true , address=104.36.82.34:4580 , piece_id=BRRNV77O47TZTLBLQAMU35KH7W42DJJMYDYZBCZI63TZBIRT22ZQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.690685581 (9h39m53.649782826s) [noise=true , address=104.36.82.16:4326 , piece_id=WBKXCDM2WHHL7BPGGXWMH5VQHHLDYMEAKDIV5OELPLK4BMYA2A3A, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.690925443 (9h39m53.650022688s) [noise=true , address=104.36.82.5:4850 , piece_id=YGTUS6L4ELADSHJ6QYQ4TVJISX2JFORARWXLTFVKJBP6U5G3VRXQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.691149841 (9h39m53.650247086s) [noise=true , address=104.36.82.3:4772 , piece_id=I6Q2XEMVL7CZRKENESNBVTNAMPJF4IHQZE5W5FUGZSZXKH6YRXYQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.691380031 (9h39m53.650477275s) [noise=true , address=104.36.82.13:4202 , piece_id=PX2AVXLFICW4VGCM5WRS3CY3GRCXAR4ZN6JQSXGNOVO26AEFQPTQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.691612202 (9h39m53.650709446s) [noise=true , address=104.36.82.4:4814 , piece_id=Q5DTS47O6DLKJTCI5F7OZB6W4WZNOSMF462Q73UETEYVLFUDX62Q, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.691827018 (9h39m53.650924264s) [noise=true , address=45.91.116.14:4195 , piece_id=U763VPOFJAUF3XRGH7BIPOMCTL35D7LT4OA6ZZ2AS3DCKRYUJNCQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.692040013 (9h39m53.651137258s) [noise=true , address=104.36.82.60:4358 , piece_id=AHUW2J7XY7EWOWCAIP2PMGNUF5VRGBKNZCIFFZ2KFQNGT7MQYZ3A, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.692254203 (9h39m53.651351447s) [noise=true , address=104.36.82.37:4667 , piece_id=XA7XLBRYMZLV6UB2IF5UZSMCFNK3VW3GGBQDPFUBOFGBSYEALKDQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.692476775 (9h39m53.651574019s) [noise=true , address=104.36.82.43:4848 , piece_id=WQHSYXUZ2FXCAOXY5C4J5LDOMVJI5E47IM3C5TFGH33YI4IZIJAA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.692785368 (9h39m53.651882616s) [noise=true , address=104.36.82.54:4190 , piece_id=RT7X76F4QPLLWESXMT6SDXBS7MG7S5PYMCIQHZ3JCA5XIIUS5ESQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.693052989 (9h39m53.652150234s) [noise=true , address=64.49.13.26:4953 , piece_id=2GNCQMTWJGSSKHYOCSN5S57UX5YTVHBSGFJAM5UTZFJAKKL6FQCQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.693314052 (9h39m53.652411297s) [noise=true , address=104.36.82.17:4347 , piece_id=QHSZXBGCDFH7DNEKD3LAYS4XA4YU7DUAK6CRHKKZHOSWSDRF6QDA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.693595248 (9h39m53.6526925s) [noise=true , address=104.36.82.46:4500 , piece_id=LRR2PS5QFTUPGYYNK7EEHRTROP3AQ7QE74F6JAK4LWVE7EN2EZBA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.693869121 (9h39m53.652966367s) [noise=true , address=45.91.116.7:4025 , piece_id=Z6A447ONI4GUMEF5WWQ2L2PHBRJTKO4QCOZLTEXVAHHBZUUFKOUA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.694207416 (9h39m53.653304665s) [noise=true , address=104.36.82.41:4779 , piece_id=PE4J4FHPAUHP6NQEU6C7PHT4BNYUABILIJINN37JESLHOYYLXMYA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.694448521 (9h39m53.653545768s) [noise=true , address=104.36.82.58:4295 , piece_id=MMIHZOQEG3JPK7GAW5NQPHH3Y6NRZXMGRJKEUTG5THJKYW3A7XDQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.694674957 (9h39m53.653772205s) [noise=true , address=104.36.82.11:4148 , piece_id=Q2VZE5VX4E4N4LA3QQQ5EYYNLTYX25LUEQ6PR7E336BNEOUZY7MQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:32.242593722 (9h39m54.201690968s) [upload=10003]: Next returned nil segment Aug 9 03:05:32.242617676 (9h39m54.201714926s) [upload=10003]: Waiting for error group managing segments... Aug 9 03:05:32.425674691 (9h39m54.384771929s) [noise=true , address=104.36.82.54:4190 , piece_id=RT7X76F4QPLLWESXMT6SDXBS7MG7S5PYMCIQHZ3JCA5XIIUS5ESQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.427558968 (9h39m54.386656208s) [noise=true , address=104.36.82.58:4295 , piece_id=MMIHZOQEG3JPK7GAW5NQPHH3Y6NRZXMGRJKEUTG5THJKYW3A7XDQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.429461053 (9h39m54.388558292s) [noise=true , address=45.91.116.14:4195 , piece_id=U763VPOFJAUF3XRGH7BIPOMCTL35D7LT4OA6ZZ2AS3DCKRYUJNCQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.432230839 (9h39m54.39132809s) [noise=true , address=104.36.82.41:4779 , piece_id=PE4J4FHPAUHP6NQEU6C7PHT4BNYUABILIJINN37JESLHOYYLXMYA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.432859806 (9h39m54.391957052s) [noise=true , address=104.36.82.3:4772 , piece_id=I6Q2XEMVL7CZRKENESNBVTNAMPJF4IHQZE5W5FUGZSZXKH6YRXYQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.433288450 (9h39m54.392385696s) [noise=true , address=104.36.82.11:4148 , piece_id=Q2VZE5VX4E4N4LA3QQQ5EYYNLTYX25LUEQ6PR7E336BNEOUZY7MQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.433815721 (9h39m54.392912967s) [noise=true , address=104.36.82.37:4667 , piece_id=XA7XLBRYMZLV6UB2IF5UZSMCFNK3VW3GGBQDPFUBOFGBSYEALKDQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.434420797 (9h39m54.393518033s) [noise=true , address=104.36.82.5:4850 , piece_id=YGTUS6L4ELADSHJ6QYQ4TVJISX2JFORARWXLTFVKJBP6U5G3VRXQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.434893408 (9h39m54.393990652s) [noise=true , address=45.91.116.7:4025 , piece_id=Z6A447ONI4GUMEF5WWQ2L2PHBRJTKO4QCOZLTEXVAHHBZUUFKOUA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.437617758 (9h39m54.396715008s) [noise=true , address=104.36.82.16:4326 , piece_id=WBKXCDM2WHHL7BPGGXWMH5VQHHLDYMEAKDIV5OELPLK4BMYA2A3A, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.446231916 (9h39m54.40532915s) [noise=true , address=104.36.82.4:4814 , piece_id=Q5DTS47O6DLKJTCI5F7OZB6W4WZNOSMF462Q73UETEYVLFUDX62Q, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.446909731 (9h39m54.406006978s) [noise=true , address=104.36.82.13:4202 , piece_id=PX2AVXLFICW4VGCM5WRS3CY3GRCXAR4ZN6JQSXGNOVO26AEFQPTQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.448246534 (9h39m54.407343784s) [noise=true , address=104.36.82.46:4500 , piece_id=LRR2PS5QFTUPGYYNK7EEHRTROP3AQ7QE74F6JAK4LWVE7EN2EZBA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.449834746 (9h39m54.408931999s) [noise=true , address=104.36.82.60:4358 , piece_id=AHUW2J7XY7EWOWCAIP2PMGNUF5VRGBKNZCIFFZ2KFQNGT7MQYZ3A, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.449851811 (9h39m54.408949064s) [seg_pos={0 0}, upload=10003]: Segment reached optimal threshold of 14 pieces. Aug 9 03:05:32.450304422 (9h39m54.409401679s) [noise=true , address=104.36.82.34:4580 , piece_id=BRRNV77O47TZTLBLQAMU35KH7W42DJJMYDYZBCZI63TZBIRT22ZQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12569SWj8WmR8tWoBXk7XJK1KS6BZMcYHrQjPKGfhj21xFPQ1W3): protocol: expected piece hash; context canceled; EOF Aug 9 03:05:32.450411008 (9h39m54.409508255s) [noise=true , address=104.36.82.17:4347 , piece_id=QHSZXBGCDFH7DNEKD3LAYS4XA4YU7DUAK6CRHKKZHOSWSDRF6QDA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gCmsGzM2h65bWs16EY6VPrxewcUDnhvfdb1aRPZ8EMhCYHfaA): protocol: expected piece hash; context canceled; EOF Aug 9 03:05:32.450492811 (9h39m54.409590057s) [noise=true , address=104.36.82.43:4848 , piece_id=WQHSYXUZ2FXCAOXY5C4J5LDOMVJI5E47IM3C5TFGH33YI4IZIJAA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DPLv5Kfsx9RLVWeRrxbdkaLGJc4dfrzGnPLwc8us9hT5uiPbj): protocol: expected piece hash; context canceled; EOF Aug 9 03:05:32.450611707 (9h39m54.409708955s) [noise=true , address=64.49.13.26:4953 , piece_id=2GNCQMTWJGSSKHYOCSN5S57UX5YTVHBSGFJAM5UTZFJAKKL6FQCQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvztpAXVj8B4XY7FgaFcsWtqwSxzpV4sRc926EigSpGqnytXE): protocol: write tcp 139.59.144.22:35798->64.49.13.26:4953: use of closed network connection; write tcp 139.59.144.22:35798->64.49.13.26:4953: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35798->64.49.13.26:4953: use of closed network connection Aug 9 03:05:32.450627802 (9h39m54.409725061s) [seg_pos={0 0}, upload=10003]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:05:32.450714540 (9h39m54.409811797s) [upload=10003]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:05:32.450720222 (9h39m54.409817475s) [upload=10003]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:05:32.612407319 (9h39m54.571504583s) [upload=10003]: Done uploading segments... Aug 9 03:05:32.612437481 (9h39m54.571534716s) [upload=10003]: Upload finished. err: <nil> Duration: 2.396250488s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..............X....................................X........] duration: 843.388698ms FAIL (2025-08-09 03:35:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:29:07.630773590 (10h3m29.589870841s) [upload=10421]: Starting upload Aug 9 03:29:07.630849282 (10h3m29.589946539s) [upload=10421]: Done starting upload Aug 9 03:29:07.630961591 (10h3m29.590058839s) [upload=10421]: Uploading segments... Aug 9 03:29:07.631490444 (10h3m29.5905877s) [upload=10421]: Got next segment. Inline: true Aug 9 03:29:07.631520161 (10h3m29.590617411s) [upload=10421]: Waiting for error group managing segments... Aug 9 03:29:07.631602338 (10h3m29.59069957s) [upload=10421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:29:07.631609557 (10h3m29.590706809s) [upload=10421]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:29:07.631614555 (10h3m29.590711801s) [upload=10421]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:29:07.719629732 (10h3m29.678726989s) [upload=10421]: Done uploading segments... Aug 9 03:29:07.719673059 (10h3m29.678770322s) [upload=10421]: Upload finished. err: metaclient: Too Many Requests Duration:* 843.628432ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 2.942306698s FAIL (2025-08-09 03:35:11 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.942333067s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 2.594713144s FAIL (2025-08-09 03:34:48 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.594733436s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 1.110465488s FAIL (2025-08-09 03:34:47 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.110502553s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 334.396646ms FAIL (2025-08-09 03:34:32 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 334.424723ms edge authservice http us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 390.277644ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 03:34:21 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 390.303379ms edge gateway vhost us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............X.X..........................................] duration: 2.338844186s FAIL (2025-08-09 03:34:18 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 9 03:05:31.488178202 (9h39m53.447275451s) [upload=10003]: Starting upload Aug 9 03:05:31.488243062 (9h39m53.447340313s) [upload=10003]: Done starting upload Aug 9 03:05:31.488520349 (9h39m53.447617586s) [upload=10003]: Uploading segments... Aug 9 03:05:31.488561280 (9h39m53.447658531s) [upload=10003]: Got next segment. Inline: false Aug 9 03:05:31.488597455 (9h39m53.4476947s) [upload=10003]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:05:31.488603235 (9h39m53.447700483s) [upload=10003]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:05:31.690199947 (9h39m53.64929718s) [seg_pos={0 0}, upload=10003]: Begin upload segment... Aug 9 03:05:31.690262128 (9h39m53.649359359s) [seg_pos={0 0}, upload=10003]: Done begin upload segment. Aug 9 03:05:31.690288316 (9h39m53.649385564s) [noise=true , address=104.36.82.34:4580 , piece_id=BRRNV77O47TZTLBLQAMU35KH7W42DJJMYDYZBCZI63TZBIRT22ZQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.690685581 (9h39m53.649782826s) [noise=true , address=104.36.82.16:4326 , piece_id=WBKXCDM2WHHL7BPGGXWMH5VQHHLDYMEAKDIV5OELPLK4BMYA2A3A, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.690925443 (9h39m53.650022688s) [noise=true , address=104.36.82.5:4850 , piece_id=YGTUS6L4ELADSHJ6QYQ4TVJISX2JFORARWXLTFVKJBP6U5G3VRXQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.691149841 (9h39m53.650247086s) [noise=true , address=104.36.82.3:4772 , piece_id=I6Q2XEMVL7CZRKENESNBVTNAMPJF4IHQZE5W5FUGZSZXKH6YRXYQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.691380031 (9h39m53.650477275s) [noise=true , address=104.36.82.13:4202 , piece_id=PX2AVXLFICW4VGCM5WRS3CY3GRCXAR4ZN6JQSXGNOVO26AEFQPTQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.691612202 (9h39m53.650709446s) [noise=true , address=104.36.82.4:4814 , piece_id=Q5DTS47O6DLKJTCI5F7OZB6W4WZNOSMF462Q73UETEYVLFUDX62Q, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.691827018 (9h39m53.650924264s) [noise=true , address=45.91.116.14:4195 , piece_id=U763VPOFJAUF3XRGH7BIPOMCTL35D7LT4OA6ZZ2AS3DCKRYUJNCQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.692040013 (9h39m53.651137258s) [noise=true , address=104.36.82.60:4358 , piece_id=AHUW2J7XY7EWOWCAIP2PMGNUF5VRGBKNZCIFFZ2KFQNGT7MQYZ3A, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.692254203 (9h39m53.651351447s) [noise=true , address=104.36.82.37:4667 , piece_id=XA7XLBRYMZLV6UB2IF5UZSMCFNK3VW3GGBQDPFUBOFGBSYEALKDQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.692476775 (9h39m53.651574019s) [noise=true , address=104.36.82.43:4848 , piece_id=WQHSYXUZ2FXCAOXY5C4J5LDOMVJI5E47IM3C5TFGH33YI4IZIJAA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.692785368 (9h39m53.651882616s) [noise=true , address=104.36.82.54:4190 , piece_id=RT7X76F4QPLLWESXMT6SDXBS7MG7S5PYMCIQHZ3JCA5XIIUS5ESQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.693052989 (9h39m53.652150234s) [noise=true , address=64.49.13.26:4953 , piece_id=2GNCQMTWJGSSKHYOCSN5S57UX5YTVHBSGFJAM5UTZFJAKKL6FQCQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.693314052 (9h39m53.652411297s) [noise=true , address=104.36.82.17:4347 , piece_id=QHSZXBGCDFH7DNEKD3LAYS4XA4YU7DUAK6CRHKKZHOSWSDRF6QDA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.693595248 (9h39m53.6526925s) [noise=true , address=104.36.82.46:4500 , piece_id=LRR2PS5QFTUPGYYNK7EEHRTROP3AQ7QE74F6JAK4LWVE7EN2EZBA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.693869121 (9h39m53.652966367s) [noise=true , address=45.91.116.7:4025 , piece_id=Z6A447ONI4GUMEF5WWQ2L2PHBRJTKO4QCOZLTEXVAHHBZUUFKOUA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.694207416 (9h39m53.653304665s) [noise=true , address=104.36.82.41:4779 , piece_id=PE4J4FHPAUHP6NQEU6C7PHT4BNYUABILIJINN37JESLHOYYLXMYA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.694448521 (9h39m53.653545768s) [noise=true , address=104.36.82.58:4295 , piece_id=MMIHZOQEG3JPK7GAW5NQPHH3Y6NRZXMGRJKEUTG5THJKYW3A7XDQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.694674957 (9h39m53.653772205s) [noise=true , address=104.36.82.11:4148 , piece_id=Q2VZE5VX4E4N4LA3QQQ5EYYNLTYX25LUEQ6PR7E336BNEOUZY7MQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:32.242593722 (9h39m54.201690968s) [upload=10003]: Next returned nil segment Aug 9 03:05:32.242617676 (9h39m54.201714926s) [upload=10003]: Waiting for error group managing segments... Aug 9 03:05:32.425674691 (9h39m54.384771929s) [noise=true , address=104.36.82.54:4190 , piece_id=RT7X76F4QPLLWESXMT6SDXBS7MG7S5PYMCIQHZ3JCA5XIIUS5ESQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.427558968 (9h39m54.386656208s) [noise=true , address=104.36.82.58:4295 , piece_id=MMIHZOQEG3JPK7GAW5NQPHH3Y6NRZXMGRJKEUTG5THJKYW3A7XDQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.429461053 (9h39m54.388558292s) [noise=true , address=45.91.116.14:4195 , piece_id=U763VPOFJAUF3XRGH7BIPOMCTL35D7LT4OA6ZZ2AS3DCKRYUJNCQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.432230839 (9h39m54.39132809s) [noise=true , address=104.36.82.41:4779 , piece_id=PE4J4FHPAUHP6NQEU6C7PHT4BNYUABILIJINN37JESLHOYYLXMYA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.432859806 (9h39m54.391957052s) [noise=true , address=104.36.82.3:4772 , piece_id=I6Q2XEMVL7CZRKENESNBVTNAMPJF4IHQZE5W5FUGZSZXKH6YRXYQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.433288450 (9h39m54.392385696s) [noise=true , address=104.36.82.11:4148 , piece_id=Q2VZE5VX4E4N4LA3QQQ5EYYNLTYX25LUEQ6PR7E336BNEOUZY7MQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.433815721 (9h39m54.392912967s) [noise=true , address=104.36.82.37:4667 , piece_id=XA7XLBRYMZLV6UB2IF5UZSMCFNK3VW3GGBQDPFUBOFGBSYEALKDQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.434420797 (9h39m54.393518033s) [noise=true , address=104.36.82.5:4850 , piece_id=YGTUS6L4ELADSHJ6QYQ4TVJISX2JFORARWXLTFVKJBP6U5G3VRXQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.434893408 (9h39m54.393990652s) [noise=true , address=45.91.116.7:4025 , piece_id=Z6A447ONI4GUMEF5WWQ2L2PHBRJTKO4QCOZLTEXVAHHBZUUFKOUA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.437617758 (9h39m54.396715008s) [noise=true , address=104.36.82.16:4326 , piece_id=WBKXCDM2WHHL7BPGGXWMH5VQHHLDYMEAKDIV5OELPLK4BMYA2A3A, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.446231916 (9h39m54.40532915s) [noise=true , address=104.36.82.4:4814 , piece_id=Q5DTS47O6DLKJTCI5F7OZB6W4WZNOSMF462Q73UETEYVLFUDX62Q, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.446909731 (9h39m54.406006978s) [noise=true , address=104.36.82.13:4202 , piece_id=PX2AVXLFICW4VGCM5WRS3CY3GRCXAR4ZN6JQSXGNOVO26AEFQPTQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.448246534 (9h39m54.407343784s) [noise=true , address=104.36.82.46:4500 , piece_id=LRR2PS5QFTUPGYYNK7EEHRTROP3AQ7QE74F6JAK4LWVE7EN2EZBA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.449834746 (9h39m54.408931999s) [noise=true , address=104.36.82.60:4358 , piece_id=AHUW2J7XY7EWOWCAIP2PMGNUF5VRGBKNZCIFFZ2KFQNGT7MQYZ3A, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.449851811 (9h39m54.408949064s) [seg_pos={0 0}, upload=10003]: Segment reached optimal threshold of 14 pieces. Aug 9 03:05:32.450304422 (9h39m54.409401679s) [noise=true , address=104.36.82.34:4580 , piece_id=BRRNV77O47TZTLBLQAMU35KH7W42DJJMYDYZBCZI63TZBIRT22ZQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12569SWj8WmR8tWoBXk7XJK1KS6BZMcYHrQjPKGfhj21xFPQ1W3): protocol: expected piece hash; context canceled; EOF Aug 9 03:05:32.450411008 (9h39m54.409508255s) [noise=true , address=104.36.82.17:4347 , piece_id=QHSZXBGCDFH7DNEKD3LAYS4XA4YU7DUAK6CRHKKZHOSWSDRF6QDA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gCmsGzM2h65bWs16EY6VPrxewcUDnhvfdb1aRPZ8EMhCYHfaA): protocol: expected piece hash; context canceled; EOF Aug 9 03:05:32.450492811 (9h39m54.409590057s) [noise=true , address=104.36.82.43:4848 , piece_id=WQHSYXUZ2FXCAOXY5C4J5LDOMVJI5E47IM3C5TFGH33YI4IZIJAA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DPLv5Kfsx9RLVWeRrxbdkaLGJc4dfrzGnPLwc8us9hT5uiPbj): protocol: expected piece hash; context canceled; EOF Aug 9 03:05:32.450611707 (9h39m54.409708955s) [noise=true , address=64.49.13.26:4953 , piece_id=2GNCQMTWJGSSKHYOCSN5S57UX5YTVHBSGFJAM5UTZFJAKKL6FQCQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvztpAXVj8B4XY7FgaFcsWtqwSxzpV4sRc926EigSpGqnytXE): protocol: write tcp 139.59.144.22:35798->64.49.13.26:4953: use of closed network connection; write tcp 139.59.144.22:35798->64.49.13.26:4953: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35798->64.49.13.26:4953: use of closed network connection Aug 9 03:05:32.450627802 (9h39m54.409725061s) [seg_pos={0 0}, upload=10003]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:05:32.450714540 (9h39m54.409811797s) [upload=10003]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:05:32.450720222 (9h39m54.409817475s) [upload=10003]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:05:32.612407319 (9h39m54.571504583s) [upload=10003]: Done uploading segments... Aug 9 03:05:32.612437481 (9h39m54.571534716s) [upload=10003]: Upload finished. err: <nil> Duration: 2.338878761s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 2.602379358s FAIL (2025-08-09 03:34:14 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.602514244s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...............X....................................X.......] duration: 1.001362406s FAIL (2025-08-09 03:34:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:29:07.630773590 (10h3m29.589870841s) [upload=10421]: Starting upload Aug 9 03:29:07.630849282 (10h3m29.589946539s) [upload=10421]: Done starting upload Aug 9 03:29:07.630961591 (10h3m29.590058839s) [upload=10421]: Uploading segments... Aug 9 03:29:07.631490444 (10h3m29.5905877s) [upload=10421]: Got next segment. Inline: true Aug 9 03:29:07.631520161 (10h3m29.590617411s) [upload=10421]: Waiting for error group managing segments... Aug 9 03:29:07.631602338 (10h3m29.59069957s) [upload=10421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:29:07.631609557 (10h3m29.590706809s) [upload=10421]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:29:07.631614555 (10h3m29.590711801s) [upload=10421]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:29:07.719629732 (10h3m29.678726989s) [upload=10421]: Done uploading segments... Aug 9 03:29:07.719673059 (10h3m29.678770322s) [upload=10421]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.001393577s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 317.482756ms FAIL (2025-08-09 03:34:05 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 317.506872ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [................X.X.........................................] duration: 2.609926217s FAIL (2025-08-09 03:34:02 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 9 03:05:31.488178202 (9h39m53.447275451s) [upload=10003]: Starting upload Aug 9 03:05:31.488243062 (9h39m53.447340313s) [upload=10003]: Done starting upload Aug 9 03:05:31.488520349 (9h39m53.447617586s) [upload=10003]: Uploading segments... Aug 9 03:05:31.488561280 (9h39m53.447658531s) [upload=10003]: Got next segment. Inline: false Aug 9 03:05:31.488597455 (9h39m53.4476947s) [upload=10003]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:05:31.488603235 (9h39m53.447700483s) [upload=10003]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:05:31.690199947 (9h39m53.64929718s) [seg_pos={0 0}, upload=10003]: Begin upload segment... Aug 9 03:05:31.690262128 (9h39m53.649359359s) [seg_pos={0 0}, upload=10003]: Done begin upload segment. Aug 9 03:05:31.690288316 (9h39m53.649385564s) [noise=true , address=104.36.82.34:4580 , piece_id=BRRNV77O47TZTLBLQAMU35KH7W42DJJMYDYZBCZI63TZBIRT22ZQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.690685581 (9h39m53.649782826s) [noise=true , address=104.36.82.16:4326 , piece_id=WBKXCDM2WHHL7BPGGXWMH5VQHHLDYMEAKDIV5OELPLK4BMYA2A3A, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.690925443 (9h39m53.650022688s) [noise=true , address=104.36.82.5:4850 , piece_id=YGTUS6L4ELADSHJ6QYQ4TVJISX2JFORARWXLTFVKJBP6U5G3VRXQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.691149841 (9h39m53.650247086s) [noise=true , address=104.36.82.3:4772 , piece_id=I6Q2XEMVL7CZRKENESNBVTNAMPJF4IHQZE5W5FUGZSZXKH6YRXYQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.691380031 (9h39m53.650477275s) [noise=true , address=104.36.82.13:4202 , piece_id=PX2AVXLFICW4VGCM5WRS3CY3GRCXAR4ZN6JQSXGNOVO26AEFQPTQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.691612202 (9h39m53.650709446s) [noise=true , address=104.36.82.4:4814 , piece_id=Q5DTS47O6DLKJTCI5F7OZB6W4WZNOSMF462Q73UETEYVLFUDX62Q, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.691827018 (9h39m53.650924264s) [noise=true , address=45.91.116.14:4195 , piece_id=U763VPOFJAUF3XRGH7BIPOMCTL35D7LT4OA6ZZ2AS3DCKRYUJNCQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.692040013 (9h39m53.651137258s) [noise=true , address=104.36.82.60:4358 , piece_id=AHUW2J7XY7EWOWCAIP2PMGNUF5VRGBKNZCIFFZ2KFQNGT7MQYZ3A, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.692254203 (9h39m53.651351447s) [noise=true , address=104.36.82.37:4667 , piece_id=XA7XLBRYMZLV6UB2IF5UZSMCFNK3VW3GGBQDPFUBOFGBSYEALKDQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.692476775 (9h39m53.651574019s) [noise=true , address=104.36.82.43:4848 , piece_id=WQHSYXUZ2FXCAOXY5C4J5LDOMVJI5E47IM3C5TFGH33YI4IZIJAA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.692785368 (9h39m53.651882616s) [noise=true , address=104.36.82.54:4190 , piece_id=RT7X76F4QPLLWESXMT6SDXBS7MG7S5PYMCIQHZ3JCA5XIIUS5ESQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.693052989 (9h39m53.652150234s) [noise=true , address=64.49.13.26:4953 , piece_id=2GNCQMTWJGSSKHYOCSN5S57UX5YTVHBSGFJAM5UTZFJAKKL6FQCQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.693314052 (9h39m53.652411297s) [noise=true , address=104.36.82.17:4347 , piece_id=QHSZXBGCDFH7DNEKD3LAYS4XA4YU7DUAK6CRHKKZHOSWSDRF6QDA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.693595248 (9h39m53.6526925s) [noise=true , address=104.36.82.46:4500 , piece_id=LRR2PS5QFTUPGYYNK7EEHRTROP3AQ7QE74F6JAK4LWVE7EN2EZBA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.693869121 (9h39m53.652966367s) [noise=true , address=45.91.116.7:4025 , piece_id=Z6A447ONI4GUMEF5WWQ2L2PHBRJTKO4QCOZLTEXVAHHBZUUFKOUA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.694207416 (9h39m53.653304665s) [noise=true , address=104.36.82.41:4779 , piece_id=PE4J4FHPAUHP6NQEU6C7PHT4BNYUABILIJINN37JESLHOYYLXMYA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.694448521 (9h39m53.653545768s) [noise=true , address=104.36.82.58:4295 , piece_id=MMIHZOQEG3JPK7GAW5NQPHH3Y6NRZXMGRJKEUTG5THJKYW3A7XDQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.694674957 (9h39m53.653772205s) [noise=true , address=104.36.82.11:4148 , piece_id=Q2VZE5VX4E4N4LA3QQQ5EYYNLTYX25LUEQ6PR7E336BNEOUZY7MQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:32.242593722 (9h39m54.201690968s) [upload=10003]: Next returned nil segment Aug 9 03:05:32.242617676 (9h39m54.201714926s) [upload=10003]: Waiting for error group managing segments... Aug 9 03:05:32.425674691 (9h39m54.384771929s) [noise=true , address=104.36.82.54:4190 , piece_id=RT7X76F4QPLLWESXMT6SDXBS7MG7S5PYMCIQHZ3JCA5XIIUS5ESQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.427558968 (9h39m54.386656208s) [noise=true , address=104.36.82.58:4295 , piece_id=MMIHZOQEG3JPK7GAW5NQPHH3Y6NRZXMGRJKEUTG5THJKYW3A7XDQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.429461053 (9h39m54.388558292s) [noise=true , address=45.91.116.14:4195 , piece_id=U763VPOFJAUF3XRGH7BIPOMCTL35D7LT4OA6ZZ2AS3DCKRYUJNCQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.432230839 (9h39m54.39132809s) [noise=true , address=104.36.82.41:4779 , piece_id=PE4J4FHPAUHP6NQEU6C7PHT4BNYUABILIJINN37JESLHOYYLXMYA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.432859806 (9h39m54.391957052s) [noise=true , address=104.36.82.3:4772 , piece_id=I6Q2XEMVL7CZRKENESNBVTNAMPJF4IHQZE5W5FUGZSZXKH6YRXYQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.433288450 (9h39m54.392385696s) [noise=true , address=104.36.82.11:4148 , piece_id=Q2VZE5VX4E4N4LA3QQQ5EYYNLTYX25LUEQ6PR7E336BNEOUZY7MQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.433815721 (9h39m54.392912967s) [noise=true , address=104.36.82.37:4667 , piece_id=XA7XLBRYMZLV6UB2IF5UZSMCFNK3VW3GGBQDPFUBOFGBSYEALKDQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.434420797 (9h39m54.393518033s) [noise=true , address=104.36.82.5:4850 , piece_id=YGTUS6L4ELADSHJ6QYQ4TVJISX2JFORARWXLTFVKJBP6U5G3VRXQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.434893408 (9h39m54.393990652s) [noise=true , address=45.91.116.7:4025 , piece_id=Z6A447ONI4GUMEF5WWQ2L2PHBRJTKO4QCOZLTEXVAHHBZUUFKOUA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.437617758 (9h39m54.396715008s) [noise=true , address=104.36.82.16:4326 , piece_id=WBKXCDM2WHHL7BPGGXWMH5VQHHLDYMEAKDIV5OELPLK4BMYA2A3A, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.446231916 (9h39m54.40532915s) [noise=true , address=104.36.82.4:4814 , piece_id=Q5DTS47O6DLKJTCI5F7OZB6W4WZNOSMF462Q73UETEYVLFUDX62Q, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.446909731 (9h39m54.406006978s) [noise=true , address=104.36.82.13:4202 , piece_id=PX2AVXLFICW4VGCM5WRS3CY3GRCXAR4ZN6JQSXGNOVO26AEFQPTQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.448246534 (9h39m54.407343784s) [noise=true , address=104.36.82.46:4500 , piece_id=LRR2PS5QFTUPGYYNK7EEHRTROP3AQ7QE74F6JAK4LWVE7EN2EZBA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.449834746 (9h39m54.408931999s) [noise=true , address=104.36.82.60:4358 , piece_id=AHUW2J7XY7EWOWCAIP2PMGNUF5VRGBKNZCIFFZ2KFQNGT7MQYZ3A, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.449851811 (9h39m54.408949064s) [seg_pos={0 0}, upload=10003]: Segment reached optimal threshold of 14 pieces. Aug 9 03:05:32.450304422 (9h39m54.409401679s) [noise=true , address=104.36.82.34:4580 , piece_id=BRRNV77O47TZTLBLQAMU35KH7W42DJJMYDYZBCZI63TZBIRT22ZQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12569SWj8WmR8tWoBXk7XJK1KS6BZMcYHrQjPKGfhj21xFPQ1W3): protocol: expected piece hash; context canceled; EOF Aug 9 03:05:32.450411008 (9h39m54.409508255s) [noise=true , address=104.36.82.17:4347 , piece_id=QHSZXBGCDFH7DNEKD3LAYS4XA4YU7DUAK6CRHKKZHOSWSDRF6QDA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gCmsGzM2h65bWs16EY6VPrxewcUDnhvfdb1aRPZ8EMhCYHfaA): protocol: expected piece hash; context canceled; EOF Aug 9 03:05:32.450492811 (9h39m54.409590057s) [noise=true , address=104.36.82.43:4848 , piece_id=WQHSYXUZ2FXCAOXY5C4J5LDOMVJI5E47IM3C5TFGH33YI4IZIJAA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DPLv5Kfsx9RLVWeRrxbdkaLGJc4dfrzGnPLwc8us9hT5uiPbj): protocol: expected piece hash; context canceled; EOF Aug 9 03:05:32.450611707 (9h39m54.409708955s) [noise=true , address=64.49.13.26:4953 , piece_id=2GNCQMTWJGSSKHYOCSN5S57UX5YTVHBSGFJAM5UTZFJAKKL6FQCQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvztpAXVj8B4XY7FgaFcsWtqwSxzpV4sRc926EigSpGqnytXE): protocol: write tcp 139.59.144.22:35798->64.49.13.26:4953: use of closed network connection; write tcp 139.59.144.22:35798->64.49.13.26:4953: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35798->64.49.13.26:4953: use of closed network connection Aug 9 03:05:32.450627802 (9h39m54.409725061s) [seg_pos={0 0}, upload=10003]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:05:32.450714540 (9h39m54.409811797s) [upload=10003]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:05:32.450720222 (9h39m54.409817475s) [upload=10003]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:05:32.612407319 (9h39m54.571504583s) [upload=10003]: Done uploading segments... Aug 9 03:05:32.612437481 (9h39m54.571534716s) [upload=10003]: Upload finished. err: <nil> Duration: 2.609958166s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 1.289013754s FAIL (2025-08-09 03:34:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.289043148s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 2.328019054s FAIL (2025-08-09 03:33:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.328044539s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [................X....................................X......] duration: 923.903705ms FAIL (2025-08-09 03:33:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:29:07.630773590 (10h3m29.589870841s) [upload=10421]: Starting upload Aug 9 03:29:07.630849282 (10h3m29.589946539s) [upload=10421]: Done starting upload Aug 9 03:29:07.630961591 (10h3m29.590058839s) [upload=10421]: Uploading segments... Aug 9 03:29:07.631490444 (10h3m29.5905877s) [upload=10421]: Got next segment. Inline: true Aug 9 03:29:07.631520161 (10h3m29.590617411s) [upload=10421]: Waiting for error group managing segments... Aug 9 03:29:07.631602338 (10h3m29.59069957s) [upload=10421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:29:07.631609557 (10h3m29.590706809s) [upload=10421]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:29:07.631614555 (10h3m29.590711801s) [upload=10421]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:29:07.719629732 (10h3m29.678726989s) [upload=10421]: Done uploading segments... Aug 9 03:29:07.719673059 (10h3m29.678770322s) [upload=10421]: Upload finished. err: metaclient: Too Many Requests Duration:* 923.938562ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 916.454976ms FAIL (2025-08-09 03:33:18 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 916.483894ms edge authservice http us-select-1
checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 283.561716ms remote: "tcp:45.38.24.2:443" target: https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410 FAIL (2025-08-09 03:33:16 UTC) orbiter warning: Get "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410": context deadline exceeded Duration: 283.576612ms edge gateway vhost us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 2.846618874s FAIL (2025-08-09 03:33:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.846645009s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................X.X........................................] duration: 2.503738586s FAIL (2025-08-09 03:33:06 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 9 03:05:31.488178202 (9h39m53.447275451s) [upload=10003]: Starting upload Aug 9 03:05:31.488243062 (9h39m53.447340313s) [upload=10003]: Done starting upload Aug 9 03:05:31.488520349 (9h39m53.447617586s) [upload=10003]: Uploading segments... Aug 9 03:05:31.488561280 (9h39m53.447658531s) [upload=10003]: Got next segment. Inline: false Aug 9 03:05:31.488597455 (9h39m53.4476947s) [upload=10003]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:05:31.488603235 (9h39m53.447700483s) [upload=10003]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:05:31.690199947 (9h39m53.64929718s) [seg_pos={0 0}, upload=10003]: Begin upload segment... Aug 9 03:05:31.690262128 (9h39m53.649359359s) [seg_pos={0 0}, upload=10003]: Done begin upload segment. Aug 9 03:05:31.690288316 (9h39m53.649385564s) [noise=true , address=104.36.82.34:4580 , piece_id=BRRNV77O47TZTLBLQAMU35KH7W42DJJMYDYZBCZI63TZBIRT22ZQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.690685581 (9h39m53.649782826s) [noise=true , address=104.36.82.16:4326 , piece_id=WBKXCDM2WHHL7BPGGXWMH5VQHHLDYMEAKDIV5OELPLK4BMYA2A3A, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.690925443 (9h39m53.650022688s) [noise=true , address=104.36.82.5:4850 , piece_id=YGTUS6L4ELADSHJ6QYQ4TVJISX2JFORARWXLTFVKJBP6U5G3VRXQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.691149841 (9h39m53.650247086s) [noise=true , address=104.36.82.3:4772 , piece_id=I6Q2XEMVL7CZRKENESNBVTNAMPJF4IHQZE5W5FUGZSZXKH6YRXYQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.691380031 (9h39m53.650477275s) [noise=true , address=104.36.82.13:4202 , piece_id=PX2AVXLFICW4VGCM5WRS3CY3GRCXAR4ZN6JQSXGNOVO26AEFQPTQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.691612202 (9h39m53.650709446s) [noise=true , address=104.36.82.4:4814 , piece_id=Q5DTS47O6DLKJTCI5F7OZB6W4WZNOSMF462Q73UETEYVLFUDX62Q, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.691827018 (9h39m53.650924264s) [noise=true , address=45.91.116.14:4195 , piece_id=U763VPOFJAUF3XRGH7BIPOMCTL35D7LT4OA6ZZ2AS3DCKRYUJNCQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.692040013 (9h39m53.651137258s) [noise=true , address=104.36.82.60:4358 , piece_id=AHUW2J7XY7EWOWCAIP2PMGNUF5VRGBKNZCIFFZ2KFQNGT7MQYZ3A, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.692254203 (9h39m53.651351447s) [noise=true , address=104.36.82.37:4667 , piece_id=XA7XLBRYMZLV6UB2IF5UZSMCFNK3VW3GGBQDPFUBOFGBSYEALKDQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.692476775 (9h39m53.651574019s) [noise=true , address=104.36.82.43:4848 , piece_id=WQHSYXUZ2FXCAOXY5C4J5LDOMVJI5E47IM3C5TFGH33YI4IZIJAA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.692785368 (9h39m53.651882616s) [noise=true , address=104.36.82.54:4190 , piece_id=RT7X76F4QPLLWESXMT6SDXBS7MG7S5PYMCIQHZ3JCA5XIIUS5ESQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.693052989 (9h39m53.652150234s) [noise=true , address=64.49.13.26:4953 , piece_id=2GNCQMTWJGSSKHYOCSN5S57UX5YTVHBSGFJAM5UTZFJAKKL6FQCQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.693314052 (9h39m53.652411297s) [noise=true , address=104.36.82.17:4347 , piece_id=QHSZXBGCDFH7DNEKD3LAYS4XA4YU7DUAK6CRHKKZHOSWSDRF6QDA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.693595248 (9h39m53.6526925s) [noise=true , address=104.36.82.46:4500 , piece_id=LRR2PS5QFTUPGYYNK7EEHRTROP3AQ7QE74F6JAK4LWVE7EN2EZBA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.693869121 (9h39m53.652966367s) [noise=true , address=45.91.116.7:4025 , piece_id=Z6A447ONI4GUMEF5WWQ2L2PHBRJTKO4QCOZLTEXVAHHBZUUFKOUA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.694207416 (9h39m53.653304665s) [noise=true , address=104.36.82.41:4779 , piece_id=PE4J4FHPAUHP6NQEU6C7PHT4BNYUABILIJINN37JESLHOYYLXMYA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.694448521 (9h39m53.653545768s) [noise=true , address=104.36.82.58:4295 , piece_id=MMIHZOQEG3JPK7GAW5NQPHH3Y6NRZXMGRJKEUTG5THJKYW3A7XDQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.694674957 (9h39m53.653772205s) [noise=true , address=104.36.82.11:4148 , piece_id=Q2VZE5VX4E4N4LA3QQQ5EYYNLTYX25LUEQ6PR7E336BNEOUZY7MQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:32.242593722 (9h39m54.201690968s) [upload=10003]: Next returned nil segment Aug 9 03:05:32.242617676 (9h39m54.201714926s) [upload=10003]: Waiting for error group managing segments... Aug 9 03:05:32.425674691 (9h39m54.384771929s) [noise=true , address=104.36.82.54:4190 , piece_id=RT7X76F4QPLLWESXMT6SDXBS7MG7S5PYMCIQHZ3JCA5XIIUS5ESQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.427558968 (9h39m54.386656208s) [noise=true , address=104.36.82.58:4295 , piece_id=MMIHZOQEG3JPK7GAW5NQPHH3Y6NRZXMGRJKEUTG5THJKYW3A7XDQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.429461053 (9h39m54.388558292s) [noise=true , address=45.91.116.14:4195 , piece_id=U763VPOFJAUF3XRGH7BIPOMCTL35D7LT4OA6ZZ2AS3DCKRYUJNCQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.432230839 (9h39m54.39132809s) [noise=true , address=104.36.82.41:4779 , piece_id=PE4J4FHPAUHP6NQEU6C7PHT4BNYUABILIJINN37JESLHOYYLXMYA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.432859806 (9h39m54.391957052s) [noise=true , address=104.36.82.3:4772 , piece_id=I6Q2XEMVL7CZRKENESNBVTNAMPJF4IHQZE5W5FUGZSZXKH6YRXYQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.433288450 (9h39m54.392385696s) [noise=true , address=104.36.82.11:4148 , piece_id=Q2VZE5VX4E4N4LA3QQQ5EYYNLTYX25LUEQ6PR7E336BNEOUZY7MQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.433815721 (9h39m54.392912967s) [noise=true , address=104.36.82.37:4667 , piece_id=XA7XLBRYMZLV6UB2IF5UZSMCFNK3VW3GGBQDPFUBOFGBSYEALKDQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.434420797 (9h39m54.393518033s) [noise=true , address=104.36.82.5:4850 , piece_id=YGTUS6L4ELADSHJ6QYQ4TVJISX2JFORARWXLTFVKJBP6U5G3VRXQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.434893408 (9h39m54.393990652s) [noise=true , address=45.91.116.7:4025 , piece_id=Z6A447ONI4GUMEF5WWQ2L2PHBRJTKO4QCOZLTEXVAHHBZUUFKOUA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.437617758 (9h39m54.396715008s) [noise=true , address=104.36.82.16:4326 , piece_id=WBKXCDM2WHHL7BPGGXWMH5VQHHLDYMEAKDIV5OELPLK4BMYA2A3A, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.446231916 (9h39m54.40532915s) [noise=true , address=104.36.82.4:4814 , piece_id=Q5DTS47O6DLKJTCI5F7OZB6W4WZNOSMF462Q73UETEYVLFUDX62Q, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.446909731 (9h39m54.406006978s) [noise=true , address=104.36.82.13:4202 , piece_id=PX2AVXLFICW4VGCM5WRS3CY3GRCXAR4ZN6JQSXGNOVO26AEFQPTQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.448246534 (9h39m54.407343784s) [noise=true , address=104.36.82.46:4500 , piece_id=LRR2PS5QFTUPGYYNK7EEHRTROP3AQ7QE74F6JAK4LWVE7EN2EZBA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.449834746 (9h39m54.408931999s) [noise=true , address=104.36.82.60:4358 , piece_id=AHUW2J7XY7EWOWCAIP2PMGNUF5VRGBKNZCIFFZ2KFQNGT7MQYZ3A, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.449851811 (9h39m54.408949064s) [seg_pos={0 0}, upload=10003]: Segment reached optimal threshold of 14 pieces. Aug 9 03:05:32.450304422 (9h39m54.409401679s) [noise=true , address=104.36.82.34:4580 , piece_id=BRRNV77O47TZTLBLQAMU35KH7W42DJJMYDYZBCZI63TZBIRT22ZQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12569SWj8WmR8tWoBXk7XJK1KS6BZMcYHrQjPKGfhj21xFPQ1W3): protocol: expected piece hash; context canceled; EOF Aug 9 03:05:32.450411008 (9h39m54.409508255s) [noise=true , address=104.36.82.17:4347 , piece_id=QHSZXBGCDFH7DNEKD3LAYS4XA4YU7DUAK6CRHKKZHOSWSDRF6QDA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gCmsGzM2h65bWs16EY6VPrxewcUDnhvfdb1aRPZ8EMhCYHfaA): protocol: expected piece hash; context canceled; EOF Aug 9 03:05:32.450492811 (9h39m54.409590057s) [noise=true , address=104.36.82.43:4848 , piece_id=WQHSYXUZ2FXCAOXY5C4J5LDOMVJI5E47IM3C5TFGH33YI4IZIJAA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DPLv5Kfsx9RLVWeRrxbdkaLGJc4dfrzGnPLwc8us9hT5uiPbj): protocol: expected piece hash; context canceled; EOF Aug 9 03:05:32.450611707 (9h39m54.409708955s) [noise=true , address=64.49.13.26:4953 , piece_id=2GNCQMTWJGSSKHYOCSN5S57UX5YTVHBSGFJAM5UTZFJAKKL6FQCQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvztpAXVj8B4XY7FgaFcsWtqwSxzpV4sRc926EigSpGqnytXE): protocol: write tcp 139.59.144.22:35798->64.49.13.26:4953: use of closed network connection; write tcp 139.59.144.22:35798->64.49.13.26:4953: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35798->64.49.13.26:4953: use of closed network connection Aug 9 03:05:32.450627802 (9h39m54.409725061s) [seg_pos={0 0}, upload=10003]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:05:32.450714540 (9h39m54.409811797s) [upload=10003]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:05:32.450720222 (9h39m54.409817475s) [upload=10003]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:05:32.612407319 (9h39m54.571504583s) [upload=10003]: Done uploading segments... Aug 9 03:05:32.612437481 (9h39m54.571534716s) [upload=10003]: Upload finished. err: <nil> Duration: 2.503769867s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.001292247s FAIL (2025-08-09 03:32:50 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 30.001608524s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 371.469649ms FAIL (2025-08-09 03:32:49 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 371.527334ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................X.X.......................................] duration: 2.458991834s FAIL (2025-08-09 03:32:32 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 9 03:05:31.488178202 (9h39m53.447275451s) [upload=10003]: Starting upload Aug 9 03:05:31.488243062 (9h39m53.447340313s) [upload=10003]: Done starting upload Aug 9 03:05:31.488520349 (9h39m53.447617586s) [upload=10003]: Uploading segments... Aug 9 03:05:31.488561280 (9h39m53.447658531s) [upload=10003]: Got next segment. Inline: false Aug 9 03:05:31.488597455 (9h39m53.4476947s) [upload=10003]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:05:31.488603235 (9h39m53.447700483s) [upload=10003]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:05:31.690199947 (9h39m53.64929718s) [seg_pos={0 0}, upload=10003]: Begin upload segment... Aug 9 03:05:31.690262128 (9h39m53.649359359s) [seg_pos={0 0}, upload=10003]: Done begin upload segment. Aug 9 03:05:31.690288316 (9h39m53.649385564s) [noise=true , address=104.36.82.34:4580 , piece_id=BRRNV77O47TZTLBLQAMU35KH7W42DJJMYDYZBCZI63TZBIRT22ZQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.690685581 (9h39m53.649782826s) [noise=true , address=104.36.82.16:4326 , piece_id=WBKXCDM2WHHL7BPGGXWMH5VQHHLDYMEAKDIV5OELPLK4BMYA2A3A, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.690925443 (9h39m53.650022688s) [noise=true , address=104.36.82.5:4850 , piece_id=YGTUS6L4ELADSHJ6QYQ4TVJISX2JFORARWXLTFVKJBP6U5G3VRXQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.691149841 (9h39m53.650247086s) [noise=true , address=104.36.82.3:4772 , piece_id=I6Q2XEMVL7CZRKENESNBVTNAMPJF4IHQZE5W5FUGZSZXKH6YRXYQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.691380031 (9h39m53.650477275s) [noise=true , address=104.36.82.13:4202 , piece_id=PX2AVXLFICW4VGCM5WRS3CY3GRCXAR4ZN6JQSXGNOVO26AEFQPTQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.691612202 (9h39m53.650709446s) [noise=true , address=104.36.82.4:4814 , piece_id=Q5DTS47O6DLKJTCI5F7OZB6W4WZNOSMF462Q73UETEYVLFUDX62Q, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.691827018 (9h39m53.650924264s) [noise=true , address=45.91.116.14:4195 , piece_id=U763VPOFJAUF3XRGH7BIPOMCTL35D7LT4OA6ZZ2AS3DCKRYUJNCQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.692040013 (9h39m53.651137258s) [noise=true , address=104.36.82.60:4358 , piece_id=AHUW2J7XY7EWOWCAIP2PMGNUF5VRGBKNZCIFFZ2KFQNGT7MQYZ3A, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.692254203 (9h39m53.651351447s) [noise=true , address=104.36.82.37:4667 , piece_id=XA7XLBRYMZLV6UB2IF5UZSMCFNK3VW3GGBQDPFUBOFGBSYEALKDQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.692476775 (9h39m53.651574019s) [noise=true , address=104.36.82.43:4848 , piece_id=WQHSYXUZ2FXCAOXY5C4J5LDOMVJI5E47IM3C5TFGH33YI4IZIJAA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.692785368 (9h39m53.651882616s) [noise=true , address=104.36.82.54:4190 , piece_id=RT7X76F4QPLLWESXMT6SDXBS7MG7S5PYMCIQHZ3JCA5XIIUS5ESQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.693052989 (9h39m53.652150234s) [noise=true , address=64.49.13.26:4953 , piece_id=2GNCQMTWJGSSKHYOCSN5S57UX5YTVHBSGFJAM5UTZFJAKKL6FQCQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.693314052 (9h39m53.652411297s) [noise=true , address=104.36.82.17:4347 , piece_id=QHSZXBGCDFH7DNEKD3LAYS4XA4YU7DUAK6CRHKKZHOSWSDRF6QDA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.693595248 (9h39m53.6526925s) [noise=true , address=104.36.82.46:4500 , piece_id=LRR2PS5QFTUPGYYNK7EEHRTROP3AQ7QE74F6JAK4LWVE7EN2EZBA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.693869121 (9h39m53.652966367s) [noise=true , address=45.91.116.7:4025 , piece_id=Z6A447ONI4GUMEF5WWQ2L2PHBRJTKO4QCOZLTEXVAHHBZUUFKOUA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.694207416 (9h39m53.653304665s) [noise=true , address=104.36.82.41:4779 , piece_id=PE4J4FHPAUHP6NQEU6C7PHT4BNYUABILIJINN37JESLHOYYLXMYA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.694448521 (9h39m53.653545768s) [noise=true , address=104.36.82.58:4295 , piece_id=MMIHZOQEG3JPK7GAW5NQPHH3Y6NRZXMGRJKEUTG5THJKYW3A7XDQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.694674957 (9h39m53.653772205s) [noise=true , address=104.36.82.11:4148 , piece_id=Q2VZE5VX4E4N4LA3QQQ5EYYNLTYX25LUEQ6PR7E336BNEOUZY7MQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:32.242593722 (9h39m54.201690968s) [upload=10003]: Next returned nil segment Aug 9 03:05:32.242617676 (9h39m54.201714926s) [upload=10003]: Waiting for error group managing segments... Aug 9 03:05:32.425674691 (9h39m54.384771929s) [noise=true , address=104.36.82.54:4190 , piece_id=RT7X76F4QPLLWESXMT6SDXBS7MG7S5PYMCIQHZ3JCA5XIIUS5ESQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.427558968 (9h39m54.386656208s) [noise=true , address=104.36.82.58:4295 , piece_id=MMIHZOQEG3JPK7GAW5NQPHH3Y6NRZXMGRJKEUTG5THJKYW3A7XDQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.429461053 (9h39m54.388558292s) [noise=true , address=45.91.116.14:4195 , piece_id=U763VPOFJAUF3XRGH7BIPOMCTL35D7LT4OA6ZZ2AS3DCKRYUJNCQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.432230839 (9h39m54.39132809s) [noise=true , address=104.36.82.41:4779 , piece_id=PE4J4FHPAUHP6NQEU6C7PHT4BNYUABILIJINN37JESLHOYYLXMYA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.432859806 (9h39m54.391957052s) [noise=true , address=104.36.82.3:4772 , piece_id=I6Q2XEMVL7CZRKENESNBVTNAMPJF4IHQZE5W5FUGZSZXKH6YRXYQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.433288450 (9h39m54.392385696s) [noise=true , address=104.36.82.11:4148 , piece_id=Q2VZE5VX4E4N4LA3QQQ5EYYNLTYX25LUEQ6PR7E336BNEOUZY7MQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.433815721 (9h39m54.392912967s) [noise=true , address=104.36.82.37:4667 , piece_id=XA7XLBRYMZLV6UB2IF5UZSMCFNK3VW3GGBQDPFUBOFGBSYEALKDQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.434420797 (9h39m54.393518033s) [noise=true , address=104.36.82.5:4850 , piece_id=YGTUS6L4ELADSHJ6QYQ4TVJISX2JFORARWXLTFVKJBP6U5G3VRXQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.434893408 (9h39m54.393990652s) [noise=true , address=45.91.116.7:4025 , piece_id=Z6A447ONI4GUMEF5WWQ2L2PHBRJTKO4QCOZLTEXVAHHBZUUFKOUA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.437617758 (9h39m54.396715008s) [noise=true , address=104.36.82.16:4326 , piece_id=WBKXCDM2WHHL7BPGGXWMH5VQHHLDYMEAKDIV5OELPLK4BMYA2A3A, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.446231916 (9h39m54.40532915s) [noise=true , address=104.36.82.4:4814 , piece_id=Q5DTS47O6DLKJTCI5F7OZB6W4WZNOSMF462Q73UETEYVLFUDX62Q, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.446909731 (9h39m54.406006978s) [noise=true , address=104.36.82.13:4202 , piece_id=PX2AVXLFICW4VGCM5WRS3CY3GRCXAR4ZN6JQSXGNOVO26AEFQPTQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.448246534 (9h39m54.407343784s) [noise=true , address=104.36.82.46:4500 , piece_id=LRR2PS5QFTUPGYYNK7EEHRTROP3AQ7QE74F6JAK4LWVE7EN2EZBA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.449834746 (9h39m54.408931999s) [noise=true , address=104.36.82.60:4358 , piece_id=AHUW2J7XY7EWOWCAIP2PMGNUF5VRGBKNZCIFFZ2KFQNGT7MQYZ3A, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.449851811 (9h39m54.408949064s) [seg_pos={0 0}, upload=10003]: Segment reached optimal threshold of 14 pieces. Aug 9 03:05:32.450304422 (9h39m54.409401679s) [noise=true , address=104.36.82.34:4580 , piece_id=BRRNV77O47TZTLBLQAMU35KH7W42DJJMYDYZBCZI63TZBIRT22ZQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12569SWj8WmR8tWoBXk7XJK1KS6BZMcYHrQjPKGfhj21xFPQ1W3): protocol: expected piece hash; context canceled; EOF Aug 9 03:05:32.450411008 (9h39m54.409508255s) [noise=true , address=104.36.82.17:4347 , piece_id=QHSZXBGCDFH7DNEKD3LAYS4XA4YU7DUAK6CRHKKZHOSWSDRF6QDA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gCmsGzM2h65bWs16EY6VPrxewcUDnhvfdb1aRPZ8EMhCYHfaA): protocol: expected piece hash; context canceled; EOF Aug 9 03:05:32.450492811 (9h39m54.409590057s) [noise=true , address=104.36.82.43:4848 , piece_id=WQHSYXUZ2FXCAOXY5C4J5LDOMVJI5E47IM3C5TFGH33YI4IZIJAA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DPLv5Kfsx9RLVWeRrxbdkaLGJc4dfrzGnPLwc8us9hT5uiPbj): protocol: expected piece hash; context canceled; EOF Aug 9 03:05:32.450611707 (9h39m54.409708955s) [noise=true , address=64.49.13.26:4953 , piece_id=2GNCQMTWJGSSKHYOCSN5S57UX5YTVHBSGFJAM5UTZFJAKKL6FQCQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvztpAXVj8B4XY7FgaFcsWtqwSxzpV4sRc926EigSpGqnytXE): protocol: write tcp 139.59.144.22:35798->64.49.13.26:4953: use of closed network connection; write tcp 139.59.144.22:35798->64.49.13.26:4953: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35798->64.49.13.26:4953: use of closed network connection Aug 9 03:05:32.450627802 (9h39m54.409725061s) [seg_pos={0 0}, upload=10003]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:05:32.450714540 (9h39m54.409811797s) [upload=10003]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:05:32.450720222 (9h39m54.409817475s) [upload=10003]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:05:32.612407319 (9h39m54.571504583s) [upload=10003]: Done uploading segments... Aug 9 03:05:32.612437481 (9h39m54.571534716s) [upload=10003]: Upload finished. err: <nil> Duration: 2.459033801s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.................X....................................X.....] duration: 837.107746ms FAIL (2025-08-09 03:32:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:29:07.630773590 (10h3m29.589870841s) [upload=10421]: Starting upload Aug 9 03:29:07.630849282 (10h3m29.589946539s) [upload=10421]: Done starting upload Aug 9 03:29:07.630961591 (10h3m29.590058839s) [upload=10421]: Uploading segments... Aug 9 03:29:07.631490444 (10h3m29.5905877s) [upload=10421]: Got next segment. Inline: true Aug 9 03:29:07.631520161 (10h3m29.590617411s) [upload=10421]: Waiting for error group managing segments... Aug 9 03:29:07.631602338 (10h3m29.59069957s) [upload=10421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:29:07.631609557 (10h3m29.590706809s) [upload=10421]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:29:07.631614555 (10h3m29.590711801s) [upload=10421]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:29:07.719629732 (10h3m29.678726989s) [upload=10421]: Done uploading segments... Aug 9 03:29:07.719673059 (10h3m29.678770322s) [upload=10421]: Upload finished. err: metaclient: Too Many Requests Duration:* 837.145538ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.712585932s FAIL (2025-08-09 03:32:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.712607824s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................X.X......................................] duration: 2.435976187s FAIL (2025-08-09 03:32:06 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 9 03:05:31.488178202 (9h39m53.447275451s) [upload=10003]: Starting upload Aug 9 03:05:31.488243062 (9h39m53.447340313s) [upload=10003]: Done starting upload Aug 9 03:05:31.488520349 (9h39m53.447617586s) [upload=10003]: Uploading segments... Aug 9 03:05:31.488561280 (9h39m53.447658531s) [upload=10003]: Got next segment. Inline: false Aug 9 03:05:31.488597455 (9h39m53.4476947s) [upload=10003]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:05:31.488603235 (9h39m53.447700483s) [upload=10003]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:05:31.690199947 (9h39m53.64929718s) [seg_pos={0 0}, upload=10003]: Begin upload segment... Aug 9 03:05:31.690262128 (9h39m53.649359359s) [seg_pos={0 0}, upload=10003]: Done begin upload segment. Aug 9 03:05:31.690288316 (9h39m53.649385564s) [noise=true , address=104.36.82.34:4580 , piece_id=BRRNV77O47TZTLBLQAMU35KH7W42DJJMYDYZBCZI63TZBIRT22ZQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.690685581 (9h39m53.649782826s) [noise=true , address=104.36.82.16:4326 , piece_id=WBKXCDM2WHHL7BPGGXWMH5VQHHLDYMEAKDIV5OELPLK4BMYA2A3A, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.690925443 (9h39m53.650022688s) [noise=true , address=104.36.82.5:4850 , piece_id=YGTUS6L4ELADSHJ6QYQ4TVJISX2JFORARWXLTFVKJBP6U5G3VRXQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.691149841 (9h39m53.650247086s) [noise=true , address=104.36.82.3:4772 , piece_id=I6Q2XEMVL7CZRKENESNBVTNAMPJF4IHQZE5W5FUGZSZXKH6YRXYQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.691380031 (9h39m53.650477275s) [noise=true , address=104.36.82.13:4202 , piece_id=PX2AVXLFICW4VGCM5WRS3CY3GRCXAR4ZN6JQSXGNOVO26AEFQPTQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.691612202 (9h39m53.650709446s) [noise=true , address=104.36.82.4:4814 , piece_id=Q5DTS47O6DLKJTCI5F7OZB6W4WZNOSMF462Q73UETEYVLFUDX62Q, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.691827018 (9h39m53.650924264s) [noise=true , address=45.91.116.14:4195 , piece_id=U763VPOFJAUF3XRGH7BIPOMCTL35D7LT4OA6ZZ2AS3DCKRYUJNCQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.692040013 (9h39m53.651137258s) [noise=true , address=104.36.82.60:4358 , piece_id=AHUW2J7XY7EWOWCAIP2PMGNUF5VRGBKNZCIFFZ2KFQNGT7MQYZ3A, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.692254203 (9h39m53.651351447s) [noise=true , address=104.36.82.37:4667 , piece_id=XA7XLBRYMZLV6UB2IF5UZSMCFNK3VW3GGBQDPFUBOFGBSYEALKDQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.692476775 (9h39m53.651574019s) [noise=true , address=104.36.82.43:4848 , piece_id=WQHSYXUZ2FXCAOXY5C4J5LDOMVJI5E47IM3C5TFGH33YI4IZIJAA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.692785368 (9h39m53.651882616s) [noise=true , address=104.36.82.54:4190 , piece_id=RT7X76F4QPLLWESXMT6SDXBS7MG7S5PYMCIQHZ3JCA5XIIUS5ESQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.693052989 (9h39m53.652150234s) [noise=true , address=64.49.13.26:4953 , piece_id=2GNCQMTWJGSSKHYOCSN5S57UX5YTVHBSGFJAM5UTZFJAKKL6FQCQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.693314052 (9h39m53.652411297s) [noise=true , address=104.36.82.17:4347 , piece_id=QHSZXBGCDFH7DNEKD3LAYS4XA4YU7DUAK6CRHKKZHOSWSDRF6QDA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.693595248 (9h39m53.6526925s) [noise=true , address=104.36.82.46:4500 , piece_id=LRR2PS5QFTUPGYYNK7EEHRTROP3AQ7QE74F6JAK4LWVE7EN2EZBA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.693869121 (9h39m53.652966367s) [noise=true , address=45.91.116.7:4025 , piece_id=Z6A447ONI4GUMEF5WWQ2L2PHBRJTKO4QCOZLTEXVAHHBZUUFKOUA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.694207416 (9h39m53.653304665s) [noise=true , address=104.36.82.41:4779 , piece_id=PE4J4FHPAUHP6NQEU6C7PHT4BNYUABILIJINN37JESLHOYYLXMYA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.694448521 (9h39m53.653545768s) [noise=true , address=104.36.82.58:4295 , piece_id=MMIHZOQEG3JPK7GAW5NQPHH3Y6NRZXMGRJKEUTG5THJKYW3A7XDQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.694674957 (9h39m53.653772205s) [noise=true , address=104.36.82.11:4148 , piece_id=Q2VZE5VX4E4N4LA3QQQ5EYYNLTYX25LUEQ6PR7E336BNEOUZY7MQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:32.242593722 (9h39m54.201690968s) [upload=10003]: Next returned nil segment Aug 9 03:05:32.242617676 (9h39m54.201714926s) [upload=10003]: Waiting for error group managing segments... Aug 9 03:05:32.425674691 (9h39m54.384771929s) [noise=true , address=104.36.82.54:4190 , piece_id=RT7X76F4QPLLWESXMT6SDXBS7MG7S5PYMCIQHZ3JCA5XIIUS5ESQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.427558968 (9h39m54.386656208s) [noise=true , address=104.36.82.58:4295 , piece_id=MMIHZOQEG3JPK7GAW5NQPHH3Y6NRZXMGRJKEUTG5THJKYW3A7XDQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.429461053 (9h39m54.388558292s) [noise=true , address=45.91.116.14:4195 , piece_id=U763VPOFJAUF3XRGH7BIPOMCTL35D7LT4OA6ZZ2AS3DCKRYUJNCQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.432230839 (9h39m54.39132809s) [noise=true , address=104.36.82.41:4779 , piece_id=PE4J4FHPAUHP6NQEU6C7PHT4BNYUABILIJINN37JESLHOYYLXMYA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.432859806 (9h39m54.391957052s) [noise=true , address=104.36.82.3:4772 , piece_id=I6Q2XEMVL7CZRKENESNBVTNAMPJF4IHQZE5W5FUGZSZXKH6YRXYQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.433288450 (9h39m54.392385696s) [noise=true , address=104.36.82.11:4148 , piece_id=Q2VZE5VX4E4N4LA3QQQ5EYYNLTYX25LUEQ6PR7E336BNEOUZY7MQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.433815721 (9h39m54.392912967s) [noise=true , address=104.36.82.37:4667 , piece_id=XA7XLBRYMZLV6UB2IF5UZSMCFNK3VW3GGBQDPFUBOFGBSYEALKDQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.434420797 (9h39m54.393518033s) [noise=true , address=104.36.82.5:4850 , piece_id=YGTUS6L4ELADSHJ6QYQ4TVJISX2JFORARWXLTFVKJBP6U5G3VRXQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.434893408 (9h39m54.393990652s) [noise=true , address=45.91.116.7:4025 , piece_id=Z6A447ONI4GUMEF5WWQ2L2PHBRJTKO4QCOZLTEXVAHHBZUUFKOUA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.437617758 (9h39m54.396715008s) [noise=true , address=104.36.82.16:4326 , piece_id=WBKXCDM2WHHL7BPGGXWMH5VQHHLDYMEAKDIV5OELPLK4BMYA2A3A, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.446231916 (9h39m54.40532915s) [noise=true , address=104.36.82.4:4814 , piece_id=Q5DTS47O6DLKJTCI5F7OZB6W4WZNOSMF462Q73UETEYVLFUDX62Q, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.446909731 (9h39m54.406006978s) [noise=true , address=104.36.82.13:4202 , piece_id=PX2AVXLFICW4VGCM5WRS3CY3GRCXAR4ZN6JQSXGNOVO26AEFQPTQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.448246534 (9h39m54.407343784s) [noise=true , address=104.36.82.46:4500 , piece_id=LRR2PS5QFTUPGYYNK7EEHRTROP3AQ7QE74F6JAK4LWVE7EN2EZBA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.449834746 (9h39m54.408931999s) [noise=true , address=104.36.82.60:4358 , piece_id=AHUW2J7XY7EWOWCAIP2PMGNUF5VRGBKNZCIFFZ2KFQNGT7MQYZ3A, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.449851811 (9h39m54.408949064s) [seg_pos={0 0}, upload=10003]: Segment reached optimal threshold of 14 pieces. Aug 9 03:05:32.450304422 (9h39m54.409401679s) [noise=true , address=104.36.82.34:4580 , piece_id=BRRNV77O47TZTLBLQAMU35KH7W42DJJMYDYZBCZI63TZBIRT22ZQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12569SWj8WmR8tWoBXk7XJK1KS6BZMcYHrQjPKGfhj21xFPQ1W3): protocol: expected piece hash; context canceled; EOF Aug 9 03:05:32.450411008 (9h39m54.409508255s) [noise=true , address=104.36.82.17:4347 , piece_id=QHSZXBGCDFH7DNEKD3LAYS4XA4YU7DUAK6CRHKKZHOSWSDRF6QDA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gCmsGzM2h65bWs16EY6VPrxewcUDnhvfdb1aRPZ8EMhCYHfaA): protocol: expected piece hash; context canceled; EOF Aug 9 03:05:32.450492811 (9h39m54.409590057s) [noise=true , address=104.36.82.43:4848 , piece_id=WQHSYXUZ2FXCAOXY5C4J5LDOMVJI5E47IM3C5TFGH33YI4IZIJAA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DPLv5Kfsx9RLVWeRrxbdkaLGJc4dfrzGnPLwc8us9hT5uiPbj): protocol: expected piece hash; context canceled; EOF Aug 9 03:05:32.450611707 (9h39m54.409708955s) [noise=true , address=64.49.13.26:4953 , piece_id=2GNCQMTWJGSSKHYOCSN5S57UX5YTVHBSGFJAM5UTZFJAKKL6FQCQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvztpAXVj8B4XY7FgaFcsWtqwSxzpV4sRc926EigSpGqnytXE): protocol: write tcp 139.59.144.22:35798->64.49.13.26:4953: use of closed network connection; write tcp 139.59.144.22:35798->64.49.13.26:4953: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35798->64.49.13.26:4953: use of closed network connection Aug 9 03:05:32.450627802 (9h39m54.409725061s) [seg_pos={0 0}, upload=10003]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:05:32.450714540 (9h39m54.409811797s) [upload=10003]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:05:32.450720222 (9h39m54.409817475s) [upload=10003]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:05:32.612407319 (9h39m54.571504583s) [upload=10003]: Done uploading segments... Aug 9 03:05:32.612437481 (9h39m54.571534716s) [upload=10003]: Upload finished. err: <nil> Duration: 2.436015703s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..................X....................................X....] duration: 840.597128ms FAIL (2025-08-09 03:32:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:29:07.630773590 (10h3m29.589870841s) [upload=10421]: Starting upload Aug 9 03:29:07.630849282 (10h3m29.589946539s) [upload=10421]: Done starting upload Aug 9 03:29:07.630961591 (10h3m29.590058839s) [upload=10421]: Uploading segments... Aug 9 03:29:07.631490444 (10h3m29.5905877s) [upload=10421]: Got next segment. Inline: true Aug 9 03:29:07.631520161 (10h3m29.590617411s) [upload=10421]: Waiting for error group managing segments... Aug 9 03:29:07.631602338 (10h3m29.59069957s) [upload=10421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:29:07.631609557 (10h3m29.590706809s) [upload=10421]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:29:07.631614555 (10h3m29.590711801s) [upload=10421]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:29:07.719629732 (10h3m29.678726989s) [upload=10421]: Done uploading segments... Aug 9 03:29:07.719673059 (10h3m29.678770322s) [upload=10421]: Upload finished. err: metaclient: Too Many Requests Duration:* 840.655584ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 2.597262813s FAIL (2025-08-09 03:31:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.597293323s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...................X....................................X...] duration: 824.143952ms FAIL (2025-08-09 03:31:40 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:29:07.630773590 (10h3m29.589870841s) [upload=10421]: Starting upload Aug 9 03:29:07.630849282 (10h3m29.589946539s) [upload=10421]: Done starting upload Aug 9 03:29:07.630961591 (10h3m29.590058839s) [upload=10421]: Uploading segments... Aug 9 03:29:07.631490444 (10h3m29.5905877s) [upload=10421]: Got next segment. Inline: true Aug 9 03:29:07.631520161 (10h3m29.590617411s) [upload=10421]: Waiting for error group managing segments... Aug 9 03:29:07.631602338 (10h3m29.59069957s) [upload=10421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:29:07.631609557 (10h3m29.590706809s) [upload=10421]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:29:07.631614555 (10h3m29.590711801s) [upload=10421]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:29:07.719629732 (10h3m29.678726989s) [upload=10421]: Done uploading segments... Aug 9 03:29:07.719673059 (10h3m29.678770322s) [upload=10421]: Upload finished. err: metaclient: Too Many Requests Duration:* 824.175742ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 326.461147ms FAIL (2025-08-09 03:31:35 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 326.493074ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.753994008s FAIL (2025-08-09 03:31:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.754035509s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................X.X.....................................] duration: 2.387405357s FAIL (2025-08-09 03:31:18 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 9 03:05:31.488178202 (9h39m53.447275451s) [upload=10003]: Starting upload Aug 9 03:05:31.488243062 (9h39m53.447340313s) [upload=10003]: Done starting upload Aug 9 03:05:31.488520349 (9h39m53.447617586s) [upload=10003]: Uploading segments... Aug 9 03:05:31.488561280 (9h39m53.447658531s) [upload=10003]: Got next segment. Inline: false Aug 9 03:05:31.488597455 (9h39m53.4476947s) [upload=10003]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:05:31.488603235 (9h39m53.447700483s) [upload=10003]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:05:31.690199947 (9h39m53.64929718s) [seg_pos={0 0}, upload=10003]: Begin upload segment... Aug 9 03:05:31.690262128 (9h39m53.649359359s) [seg_pos={0 0}, upload=10003]: Done begin upload segment. Aug 9 03:05:31.690288316 (9h39m53.649385564s) [noise=true , address=104.36.82.34:4580 , piece_id=BRRNV77O47TZTLBLQAMU35KH7W42DJJMYDYZBCZI63TZBIRT22ZQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.690685581 (9h39m53.649782826s) [noise=true , address=104.36.82.16:4326 , piece_id=WBKXCDM2WHHL7BPGGXWMH5VQHHLDYMEAKDIV5OELPLK4BMYA2A3A, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.690925443 (9h39m53.650022688s) [noise=true , address=104.36.82.5:4850 , piece_id=YGTUS6L4ELADSHJ6QYQ4TVJISX2JFORARWXLTFVKJBP6U5G3VRXQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.691149841 (9h39m53.650247086s) [noise=true , address=104.36.82.3:4772 , piece_id=I6Q2XEMVL7CZRKENESNBVTNAMPJF4IHQZE5W5FUGZSZXKH6YRXYQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.691380031 (9h39m53.650477275s) [noise=true , address=104.36.82.13:4202 , piece_id=PX2AVXLFICW4VGCM5WRS3CY3GRCXAR4ZN6JQSXGNOVO26AEFQPTQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.691612202 (9h39m53.650709446s) [noise=true , address=104.36.82.4:4814 , piece_id=Q5DTS47O6DLKJTCI5F7OZB6W4WZNOSMF462Q73UETEYVLFUDX62Q, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.691827018 (9h39m53.650924264s) [noise=true , address=45.91.116.14:4195 , piece_id=U763VPOFJAUF3XRGH7BIPOMCTL35D7LT4OA6ZZ2AS3DCKRYUJNCQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.692040013 (9h39m53.651137258s) [noise=true , address=104.36.82.60:4358 , piece_id=AHUW2J7XY7EWOWCAIP2PMGNUF5VRGBKNZCIFFZ2KFQNGT7MQYZ3A, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.692254203 (9h39m53.651351447s) [noise=true , address=104.36.82.37:4667 , piece_id=XA7XLBRYMZLV6UB2IF5UZSMCFNK3VW3GGBQDPFUBOFGBSYEALKDQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.692476775 (9h39m53.651574019s) [noise=true , address=104.36.82.43:4848 , piece_id=WQHSYXUZ2FXCAOXY5C4J5LDOMVJI5E47IM3C5TFGH33YI4IZIJAA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.692785368 (9h39m53.651882616s) [noise=true , address=104.36.82.54:4190 , piece_id=RT7X76F4QPLLWESXMT6SDXBS7MG7S5PYMCIQHZ3JCA5XIIUS5ESQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.693052989 (9h39m53.652150234s) [noise=true , address=64.49.13.26:4953 , piece_id=2GNCQMTWJGSSKHYOCSN5S57UX5YTVHBSGFJAM5UTZFJAKKL6FQCQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.693314052 (9h39m53.652411297s) [noise=true , address=104.36.82.17:4347 , piece_id=QHSZXBGCDFH7DNEKD3LAYS4XA4YU7DUAK6CRHKKZHOSWSDRF6QDA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.693595248 (9h39m53.6526925s) [noise=true , address=104.36.82.46:4500 , piece_id=LRR2PS5QFTUPGYYNK7EEHRTROP3AQ7QE74F6JAK4LWVE7EN2EZBA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.693869121 (9h39m53.652966367s) [noise=true , address=45.91.116.7:4025 , piece_id=Z6A447ONI4GUMEF5WWQ2L2PHBRJTKO4QCOZLTEXVAHHBZUUFKOUA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.694207416 (9h39m53.653304665s) [noise=true , address=104.36.82.41:4779 , piece_id=PE4J4FHPAUHP6NQEU6C7PHT4BNYUABILIJINN37JESLHOYYLXMYA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.694448521 (9h39m53.653545768s) [noise=true , address=104.36.82.58:4295 , piece_id=MMIHZOQEG3JPK7GAW5NQPHH3Y6NRZXMGRJKEUTG5THJKYW3A7XDQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.694674957 (9h39m53.653772205s) [noise=true , address=104.36.82.11:4148 , piece_id=Q2VZE5VX4E4N4LA3QQQ5EYYNLTYX25LUEQ6PR7E336BNEOUZY7MQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:32.242593722 (9h39m54.201690968s) [upload=10003]: Next returned nil segment Aug 9 03:05:32.242617676 (9h39m54.201714926s) [upload=10003]: Waiting for error group managing segments... Aug 9 03:05:32.425674691 (9h39m54.384771929s) [noise=true , address=104.36.82.54:4190 , piece_id=RT7X76F4QPLLWESXMT6SDXBS7MG7S5PYMCIQHZ3JCA5XIIUS5ESQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.427558968 (9h39m54.386656208s) [noise=true , address=104.36.82.58:4295 , piece_id=MMIHZOQEG3JPK7GAW5NQPHH3Y6NRZXMGRJKEUTG5THJKYW3A7XDQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.429461053 (9h39m54.388558292s) [noise=true , address=45.91.116.14:4195 , piece_id=U763VPOFJAUF3XRGH7BIPOMCTL35D7LT4OA6ZZ2AS3DCKRYUJNCQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.432230839 (9h39m54.39132809s) [noise=true , address=104.36.82.41:4779 , piece_id=PE4J4FHPAUHP6NQEU6C7PHT4BNYUABILIJINN37JESLHOYYLXMYA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.432859806 (9h39m54.391957052s) [noise=true , address=104.36.82.3:4772 , piece_id=I6Q2XEMVL7CZRKENESNBVTNAMPJF4IHQZE5W5FUGZSZXKH6YRXYQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.433288450 (9h39m54.392385696s) [noise=true , address=104.36.82.11:4148 , piece_id=Q2VZE5VX4E4N4LA3QQQ5EYYNLTYX25LUEQ6PR7E336BNEOUZY7MQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.433815721 (9h39m54.392912967s) [noise=true , address=104.36.82.37:4667 , piece_id=XA7XLBRYMZLV6UB2IF5UZSMCFNK3VW3GGBQDPFUBOFGBSYEALKDQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.434420797 (9h39m54.393518033s) [noise=true , address=104.36.82.5:4850 , piece_id=YGTUS6L4ELADSHJ6QYQ4TVJISX2JFORARWXLTFVKJBP6U5G3VRXQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.434893408 (9h39m54.393990652s) [noise=true , address=45.91.116.7:4025 , piece_id=Z6A447ONI4GUMEF5WWQ2L2PHBRJTKO4QCOZLTEXVAHHBZUUFKOUA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.437617758 (9h39m54.396715008s) [noise=true , address=104.36.82.16:4326 , piece_id=WBKXCDM2WHHL7BPGGXWMH5VQHHLDYMEAKDIV5OELPLK4BMYA2A3A, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.446231916 (9h39m54.40532915s) [noise=true , address=104.36.82.4:4814 , piece_id=Q5DTS47O6DLKJTCI5F7OZB6W4WZNOSMF462Q73UETEYVLFUDX62Q, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.446909731 (9h39m54.406006978s) [noise=true , address=104.36.82.13:4202 , piece_id=PX2AVXLFICW4VGCM5WRS3CY3GRCXAR4ZN6JQSXGNOVO26AEFQPTQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.448246534 (9h39m54.407343784s) [noise=true , address=104.36.82.46:4500 , piece_id=LRR2PS5QFTUPGYYNK7EEHRTROP3AQ7QE74F6JAK4LWVE7EN2EZBA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.449834746 (9h39m54.408931999s) [noise=true , address=104.36.82.60:4358 , piece_id=AHUW2J7XY7EWOWCAIP2PMGNUF5VRGBKNZCIFFZ2KFQNGT7MQYZ3A, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.449851811 (9h39m54.408949064s) [seg_pos={0 0}, upload=10003]: Segment reached optimal threshold of 14 pieces. Aug 9 03:05:32.450304422 (9h39m54.409401679s) [noise=true , address=104.36.82.34:4580 , piece_id=BRRNV77O47TZTLBLQAMU35KH7W42DJJMYDYZBCZI63TZBIRT22ZQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12569SWj8WmR8tWoBXk7XJK1KS6BZMcYHrQjPKGfhj21xFPQ1W3): protocol: expected piece hash; context canceled; EOF Aug 9 03:05:32.450411008 (9h39m54.409508255s) [noise=true , address=104.36.82.17:4347 , piece_id=QHSZXBGCDFH7DNEKD3LAYS4XA4YU7DUAK6CRHKKZHOSWSDRF6QDA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gCmsGzM2h65bWs16EY6VPrxewcUDnhvfdb1aRPZ8EMhCYHfaA): protocol: expected piece hash; context canceled; EOF Aug 9 03:05:32.450492811 (9h39m54.409590057s) [noise=true , address=104.36.82.43:4848 , piece_id=WQHSYXUZ2FXCAOXY5C4J5LDOMVJI5E47IM3C5TFGH33YI4IZIJAA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DPLv5Kfsx9RLVWeRrxbdkaLGJc4dfrzGnPLwc8us9hT5uiPbj): protocol: expected piece hash; context canceled; EOF Aug 9 03:05:32.450611707 (9h39m54.409708955s) [noise=true , address=64.49.13.26:4953 , piece_id=2GNCQMTWJGSSKHYOCSN5S57UX5YTVHBSGFJAM5UTZFJAKKL6FQCQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvztpAXVj8B4XY7FgaFcsWtqwSxzpV4sRc926EigSpGqnytXE): protocol: write tcp 139.59.144.22:35798->64.49.13.26:4953: use of closed network connection; write tcp 139.59.144.22:35798->64.49.13.26:4953: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35798->64.49.13.26:4953: use of closed network connection Aug 9 03:05:32.450627802 (9h39m54.409725061s) [seg_pos={0 0}, upload=10003]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:05:32.450714540 (9h39m54.409811797s) [upload=10003]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:05:32.450720222 (9h39m54.409817475s) [upload=10003]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:05:32.612407319 (9h39m54.571504583s) [upload=10003]: Done uploading segments... Aug 9 03:05:32.612437481 (9h39m54.571534716s) [upload=10003]: Upload finished. err: <nil> Duration: 2.387435239s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 359.495247ms FAIL (2025-08-09 03:30:50 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 359.521636ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [....................X....................................X..] duration: 964.217525ms FAIL (2025-08-09 03:30:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:29:07.630773590 (10h3m29.589870841s) [upload=10421]: Starting upload Aug 9 03:29:07.630849282 (10h3m29.589946539s) [upload=10421]: Done starting upload Aug 9 03:29:07.630961591 (10h3m29.590058839s) [upload=10421]: Uploading segments... Aug 9 03:29:07.631490444 (10h3m29.5905877s) [upload=10421]: Got next segment. Inline: true Aug 9 03:29:07.631520161 (10h3m29.590617411s) [upload=10421]: Waiting for error group managing segments... Aug 9 03:29:07.631602338 (10h3m29.59069957s) [upload=10421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:29:07.631609557 (10h3m29.590706809s) [upload=10421]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:29:07.631614555 (10h3m29.590711801s) [upload=10421]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:29:07.719629732 (10h3m29.678726989s) [upload=10421]: Done uploading segments... Aug 9 03:29:07.719673059 (10h3m29.678770322s) [upload=10421]: Upload finished. err: metaclient: Too Many Requests Duration:* 964.262822ms core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....................X.X....................................] duration: 2.338542609s FAIL (2025-08-09 03:30:19 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 9 03:05:31.488178202 (9h39m53.447275451s) [upload=10003]: Starting upload Aug 9 03:05:31.488243062 (9h39m53.447340313s) [upload=10003]: Done starting upload Aug 9 03:05:31.488520349 (9h39m53.447617586s) [upload=10003]: Uploading segments... Aug 9 03:05:31.488561280 (9h39m53.447658531s) [upload=10003]: Got next segment. Inline: false Aug 9 03:05:31.488597455 (9h39m53.4476947s) [upload=10003]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:05:31.488603235 (9h39m53.447700483s) [upload=10003]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:05:31.690199947 (9h39m53.64929718s) [seg_pos={0 0}, upload=10003]: Begin upload segment... Aug 9 03:05:31.690262128 (9h39m53.649359359s) [seg_pos={0 0}, upload=10003]: Done begin upload segment. Aug 9 03:05:31.690288316 (9h39m53.649385564s) [noise=true , address=104.36.82.34:4580 , piece_id=BRRNV77O47TZTLBLQAMU35KH7W42DJJMYDYZBCZI63TZBIRT22ZQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.690685581 (9h39m53.649782826s) [noise=true , address=104.36.82.16:4326 , piece_id=WBKXCDM2WHHL7BPGGXWMH5VQHHLDYMEAKDIV5OELPLK4BMYA2A3A, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.690925443 (9h39m53.650022688s) [noise=true , address=104.36.82.5:4850 , piece_id=YGTUS6L4ELADSHJ6QYQ4TVJISX2JFORARWXLTFVKJBP6U5G3VRXQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.691149841 (9h39m53.650247086s) [noise=true , address=104.36.82.3:4772 , piece_id=I6Q2XEMVL7CZRKENESNBVTNAMPJF4IHQZE5W5FUGZSZXKH6YRXYQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.691380031 (9h39m53.650477275s) [noise=true , address=104.36.82.13:4202 , piece_id=PX2AVXLFICW4VGCM5WRS3CY3GRCXAR4ZN6JQSXGNOVO26AEFQPTQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.691612202 (9h39m53.650709446s) [noise=true , address=104.36.82.4:4814 , piece_id=Q5DTS47O6DLKJTCI5F7OZB6W4WZNOSMF462Q73UETEYVLFUDX62Q, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.691827018 (9h39m53.650924264s) [noise=true , address=45.91.116.14:4195 , piece_id=U763VPOFJAUF3XRGH7BIPOMCTL35D7LT4OA6ZZ2AS3DCKRYUJNCQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.692040013 (9h39m53.651137258s) [noise=true , address=104.36.82.60:4358 , piece_id=AHUW2J7XY7EWOWCAIP2PMGNUF5VRGBKNZCIFFZ2KFQNGT7MQYZ3A, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.692254203 (9h39m53.651351447s) [noise=true , address=104.36.82.37:4667 , piece_id=XA7XLBRYMZLV6UB2IF5UZSMCFNK3VW3GGBQDPFUBOFGBSYEALKDQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.692476775 (9h39m53.651574019s) [noise=true , address=104.36.82.43:4848 , piece_id=WQHSYXUZ2FXCAOXY5C4J5LDOMVJI5E47IM3C5TFGH33YI4IZIJAA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.692785368 (9h39m53.651882616s) [noise=true , address=104.36.82.54:4190 , piece_id=RT7X76F4QPLLWESXMT6SDXBS7MG7S5PYMCIQHZ3JCA5XIIUS5ESQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.693052989 (9h39m53.652150234s) [noise=true , address=64.49.13.26:4953 , piece_id=2GNCQMTWJGSSKHYOCSN5S57UX5YTVHBSGFJAM5UTZFJAKKL6FQCQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.693314052 (9h39m53.652411297s) [noise=true , address=104.36.82.17:4347 , piece_id=QHSZXBGCDFH7DNEKD3LAYS4XA4YU7DUAK6CRHKKZHOSWSDRF6QDA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.693595248 (9h39m53.6526925s) [noise=true , address=104.36.82.46:4500 , piece_id=LRR2PS5QFTUPGYYNK7EEHRTROP3AQ7QE74F6JAK4LWVE7EN2EZBA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.693869121 (9h39m53.652966367s) [noise=true , address=45.91.116.7:4025 , piece_id=Z6A447ONI4GUMEF5WWQ2L2PHBRJTKO4QCOZLTEXVAHHBZUUFKOUA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.694207416 (9h39m53.653304665s) [noise=true , address=104.36.82.41:4779 , piece_id=PE4J4FHPAUHP6NQEU6C7PHT4BNYUABILIJINN37JESLHOYYLXMYA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.694448521 (9h39m53.653545768s) [noise=true , address=104.36.82.58:4295 , piece_id=MMIHZOQEG3JPK7GAW5NQPHH3Y6NRZXMGRJKEUTG5THJKYW3A7XDQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.694674957 (9h39m53.653772205s) [noise=true , address=104.36.82.11:4148 , piece_id=Q2VZE5VX4E4N4LA3QQQ5EYYNLTYX25LUEQ6PR7E336BNEOUZY7MQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:32.242593722 (9h39m54.201690968s) [upload=10003]: Next returned nil segment Aug 9 03:05:32.242617676 (9h39m54.201714926s) [upload=10003]: Waiting for error group managing segments... Aug 9 03:05:32.425674691 (9h39m54.384771929s) [noise=true , address=104.36.82.54:4190 , piece_id=RT7X76F4QPLLWESXMT6SDXBS7MG7S5PYMCIQHZ3JCA5XIIUS5ESQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.427558968 (9h39m54.386656208s) [noise=true , address=104.36.82.58:4295 , piece_id=MMIHZOQEG3JPK7GAW5NQPHH3Y6NRZXMGRJKEUTG5THJKYW3A7XDQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.429461053 (9h39m54.388558292s) [noise=true , address=45.91.116.14:4195 , piece_id=U763VPOFJAUF3XRGH7BIPOMCTL35D7LT4OA6ZZ2AS3DCKRYUJNCQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.432230839 (9h39m54.39132809s) [noise=true , address=104.36.82.41:4779 , piece_id=PE4J4FHPAUHP6NQEU6C7PHT4BNYUABILIJINN37JESLHOYYLXMYA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.432859806 (9h39m54.391957052s) [noise=true , address=104.36.82.3:4772 , piece_id=I6Q2XEMVL7CZRKENESNBVTNAMPJF4IHQZE5W5FUGZSZXKH6YRXYQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.433288450 (9h39m54.392385696s) [noise=true , address=104.36.82.11:4148 , piece_id=Q2VZE5VX4E4N4LA3QQQ5EYYNLTYX25LUEQ6PR7E336BNEOUZY7MQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.433815721 (9h39m54.392912967s) [noise=true , address=104.36.82.37:4667 , piece_id=XA7XLBRYMZLV6UB2IF5UZSMCFNK3VW3GGBQDPFUBOFGBSYEALKDQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.434420797 (9h39m54.393518033s) [noise=true , address=104.36.82.5:4850 , piece_id=YGTUS6L4ELADSHJ6QYQ4TVJISX2JFORARWXLTFVKJBP6U5G3VRXQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.434893408 (9h39m54.393990652s) [noise=true , address=45.91.116.7:4025 , piece_id=Z6A447ONI4GUMEF5WWQ2L2PHBRJTKO4QCOZLTEXVAHHBZUUFKOUA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.437617758 (9h39m54.396715008s) [noise=true , address=104.36.82.16:4326 , piece_id=WBKXCDM2WHHL7BPGGXWMH5VQHHLDYMEAKDIV5OELPLK4BMYA2A3A, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.446231916 (9h39m54.40532915s) [noise=true , address=104.36.82.4:4814 , piece_id=Q5DTS47O6DLKJTCI5F7OZB6W4WZNOSMF462Q73UETEYVLFUDX62Q, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.446909731 (9h39m54.406006978s) [noise=true , address=104.36.82.13:4202 , piece_id=PX2AVXLFICW4VGCM5WRS3CY3GRCXAR4ZN6JQSXGNOVO26AEFQPTQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.448246534 (9h39m54.407343784s) [noise=true , address=104.36.82.46:4500 , piece_id=LRR2PS5QFTUPGYYNK7EEHRTROP3AQ7QE74F6JAK4LWVE7EN2EZBA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.449834746 (9h39m54.408931999s) [noise=true , address=104.36.82.60:4358 , piece_id=AHUW2J7XY7EWOWCAIP2PMGNUF5VRGBKNZCIFFZ2KFQNGT7MQYZ3A, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.449851811 (9h39m54.408949064s) [seg_pos={0 0}, upload=10003]: Segment reached optimal threshold of 14 pieces. Aug 9 03:05:32.450304422 (9h39m54.409401679s) [noise=true , address=104.36.82.34:4580 , piece_id=BRRNV77O47TZTLBLQAMU35KH7W42DJJMYDYZBCZI63TZBIRT22ZQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12569SWj8WmR8tWoBXk7XJK1KS6BZMcYHrQjPKGfhj21xFPQ1W3): protocol: expected piece hash; context canceled; EOF Aug 9 03:05:32.450411008 (9h39m54.409508255s) [noise=true , address=104.36.82.17:4347 , piece_id=QHSZXBGCDFH7DNEKD3LAYS4XA4YU7DUAK6CRHKKZHOSWSDRF6QDA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gCmsGzM2h65bWs16EY6VPrxewcUDnhvfdb1aRPZ8EMhCYHfaA): protocol: expected piece hash; context canceled; EOF Aug 9 03:05:32.450492811 (9h39m54.409590057s) [noise=true , address=104.36.82.43:4848 , piece_id=WQHSYXUZ2FXCAOXY5C4J5LDOMVJI5E47IM3C5TFGH33YI4IZIJAA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DPLv5Kfsx9RLVWeRrxbdkaLGJc4dfrzGnPLwc8us9hT5uiPbj): protocol: expected piece hash; context canceled; EOF Aug 9 03:05:32.450611707 (9h39m54.409708955s) [noise=true , address=64.49.13.26:4953 , piece_id=2GNCQMTWJGSSKHYOCSN5S57UX5YTVHBSGFJAM5UTZFJAKKL6FQCQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvztpAXVj8B4XY7FgaFcsWtqwSxzpV4sRc926EigSpGqnytXE): protocol: write tcp 139.59.144.22:35798->64.49.13.26:4953: use of closed network connection; write tcp 139.59.144.22:35798->64.49.13.26:4953: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35798->64.49.13.26:4953: use of closed network connection Aug 9 03:05:32.450627802 (9h39m54.409725061s) [seg_pos={0 0}, upload=10003]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:05:32.450714540 (9h39m54.409811797s) [upload=10003]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:05:32.450720222 (9h39m54.409817475s) [upload=10003]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:05:32.612407319 (9h39m54.571504583s) [upload=10003]: Done uploading segments... Aug 9 03:05:32.612437481 (9h39m54.571534716s) [upload=10003]: Upload finished. err: <nil> Duration: 2.338576117s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 4.068628226s FAIL (2025-08-09 03:30:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 4.068655341s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.....................X....................................X.] duration: 1.00746619s FAIL (2025-08-09 03:30:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:29:07.630773590 (10h3m29.589870841s) [upload=10421]: Starting upload Aug 9 03:29:07.630849282 (10h3m29.589946539s) [upload=10421]: Done starting upload Aug 9 03:29:07.630961591 (10h3m29.590058839s) [upload=10421]: Uploading segments... Aug 9 03:29:07.631490444 (10h3m29.5905877s) [upload=10421]: Got next segment. Inline: true Aug 9 03:29:07.631520161 (10h3m29.590617411s) [upload=10421]: Waiting for error group managing segments... Aug 9 03:29:07.631602338 (10h3m29.59069957s) [upload=10421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:29:07.631609557 (10h3m29.590706809s) [upload=10421]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:29:07.631614555 (10h3m29.590711801s) [upload=10421]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:29:07.719629732 (10h3m29.678726989s) [upload=10421]: Done uploading segments... Aug 9 03:29:07.719673059 (10h3m29.678770322s) [upload=10421]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.007509059s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 2.824503147s FAIL (2025-08-09 03:29:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.824523974s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 329.697799ms FAIL (2025-08-09 03:29:54 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": context deadline exceeded Duration: 329.728587ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 2.632442605s FAIL (2025-08-09 03:29:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.632468108s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [......................X.X...................................] duration: 2.454852901s FAIL (2025-08-09 03:29:13 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 9 03:05:31.488178202 (9h39m53.447275451s) [upload=10003]: Starting upload Aug 9 03:05:31.488243062 (9h39m53.447340313s) [upload=10003]: Done starting upload Aug 9 03:05:31.488520349 (9h39m53.447617586s) [upload=10003]: Uploading segments... Aug 9 03:05:31.488561280 (9h39m53.447658531s) [upload=10003]: Got next segment. Inline: false Aug 9 03:05:31.488597455 (9h39m53.4476947s) [upload=10003]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:05:31.488603235 (9h39m53.447700483s) [upload=10003]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 9 03:05:31.690199947 (9h39m53.64929718s) [seg_pos={0 0}, upload=10003]: Begin upload segment... Aug 9 03:05:31.690262128 (9h39m53.649359359s) [seg_pos={0 0}, upload=10003]: Done begin upload segment. Aug 9 03:05:31.690288316 (9h39m53.649385564s) [noise=true , address=104.36.82.34:4580 , piece_id=BRRNV77O47TZTLBLQAMU35KH7W42DJJMYDYZBCZI63TZBIRT22ZQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.690685581 (9h39m53.649782826s) [noise=true , address=104.36.82.16:4326 , piece_id=WBKXCDM2WHHL7BPGGXWMH5VQHHLDYMEAKDIV5OELPLK4BMYA2A3A, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.690925443 (9h39m53.650022688s) [noise=true , address=104.36.82.5:4850 , piece_id=YGTUS6L4ELADSHJ6QYQ4TVJISX2JFORARWXLTFVKJBP6U5G3VRXQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.691149841 (9h39m53.650247086s) [noise=true , address=104.36.82.3:4772 , piece_id=I6Q2XEMVL7CZRKENESNBVTNAMPJF4IHQZE5W5FUGZSZXKH6YRXYQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.691380031 (9h39m53.650477275s) [noise=true , address=104.36.82.13:4202 , piece_id=PX2AVXLFICW4VGCM5WRS3CY3GRCXAR4ZN6JQSXGNOVO26AEFQPTQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.691612202 (9h39m53.650709446s) [noise=true , address=104.36.82.4:4814 , piece_id=Q5DTS47O6DLKJTCI5F7OZB6W4WZNOSMF462Q73UETEYVLFUDX62Q, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.691827018 (9h39m53.650924264s) [noise=true , address=45.91.116.14:4195 , piece_id=U763VPOFJAUF3XRGH7BIPOMCTL35D7LT4OA6ZZ2AS3DCKRYUJNCQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.692040013 (9h39m53.651137258s) [noise=true , address=104.36.82.60:4358 , piece_id=AHUW2J7XY7EWOWCAIP2PMGNUF5VRGBKNZCIFFZ2KFQNGT7MQYZ3A, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.692254203 (9h39m53.651351447s) [noise=true , address=104.36.82.37:4667 , piece_id=XA7XLBRYMZLV6UB2IF5UZSMCFNK3VW3GGBQDPFUBOFGBSYEALKDQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.692476775 (9h39m53.651574019s) [noise=true , address=104.36.82.43:4848 , piece_id=WQHSYXUZ2FXCAOXY5C4J5LDOMVJI5E47IM3C5TFGH33YI4IZIJAA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.692785368 (9h39m53.651882616s) [noise=true , address=104.36.82.54:4190 , piece_id=RT7X76F4QPLLWESXMT6SDXBS7MG7S5PYMCIQHZ3JCA5XIIUS5ESQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.693052989 (9h39m53.652150234s) [noise=true , address=64.49.13.26:4953 , piece_id=2GNCQMTWJGSSKHYOCSN5S57UX5YTVHBSGFJAM5UTZFJAKKL6FQCQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.693314052 (9h39m53.652411297s) [noise=true , address=104.36.82.17:4347 , piece_id=QHSZXBGCDFH7DNEKD3LAYS4XA4YU7DUAK6CRHKKZHOSWSDRF6QDA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.693595248 (9h39m53.6526925s) [noise=true , address=104.36.82.46:4500 , piece_id=LRR2PS5QFTUPGYYNK7EEHRTROP3AQ7QE74F6JAK4LWVE7EN2EZBA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.693869121 (9h39m53.652966367s) [noise=true , address=45.91.116.7:4025 , piece_id=Z6A447ONI4GUMEF5WWQ2L2PHBRJTKO4QCOZLTEXVAHHBZUUFKOUA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.694207416 (9h39m53.653304665s) [noise=true , address=104.36.82.41:4779 , piece_id=PE4J4FHPAUHP6NQEU6C7PHT4BNYUABILIJINN37JESLHOYYLXMYA, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.694448521 (9h39m53.653545768s) [noise=true , address=104.36.82.58:4295 , piece_id=MMIHZOQEG3JPK7GAW5NQPHH3Y6NRZXMGRJKEUTG5THJKYW3A7XDQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:31.694674957 (9h39m53.653772205s) [noise=true , address=104.36.82.11:4148 , piece_id=Q2VZE5VX4E4N4LA3QQQ5EYYNLTYX25LUEQ6PR7E336BNEOUZY7MQ, seg_pos={0 0}, upload=10003]: Uploading piece... Aug 9 03:05:32.242593722 (9h39m54.201690968s) [upload=10003]: Next returned nil segment Aug 9 03:05:32.242617676 (9h39m54.201714926s) [upload=10003]: Waiting for error group managing segments... Aug 9 03:05:32.425674691 (9h39m54.384771929s) [noise=true , address=104.36.82.54:4190 , piece_id=RT7X76F4QPLLWESXMT6SDXBS7MG7S5PYMCIQHZ3JCA5XIIUS5ESQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.427558968 (9h39m54.386656208s) [noise=true , address=104.36.82.58:4295 , piece_id=MMIHZOQEG3JPK7GAW5NQPHH3Y6NRZXMGRJKEUTG5THJKYW3A7XDQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.429461053 (9h39m54.388558292s) [noise=true , address=45.91.116.14:4195 , piece_id=U763VPOFJAUF3XRGH7BIPOMCTL35D7LT4OA6ZZ2AS3DCKRYUJNCQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.432230839 (9h39m54.39132809s) [noise=true , address=104.36.82.41:4779 , piece_id=PE4J4FHPAUHP6NQEU6C7PHT4BNYUABILIJINN37JESLHOYYLXMYA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.432859806 (9h39m54.391957052s) [noise=true , address=104.36.82.3:4772 , piece_id=I6Q2XEMVL7CZRKENESNBVTNAMPJF4IHQZE5W5FUGZSZXKH6YRXYQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.433288450 (9h39m54.392385696s) [noise=true , address=104.36.82.11:4148 , piece_id=Q2VZE5VX4E4N4LA3QQQ5EYYNLTYX25LUEQ6PR7E336BNEOUZY7MQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.433815721 (9h39m54.392912967s) [noise=true , address=104.36.82.37:4667 , piece_id=XA7XLBRYMZLV6UB2IF5UZSMCFNK3VW3GGBQDPFUBOFGBSYEALKDQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.434420797 (9h39m54.393518033s) [noise=true , address=104.36.82.5:4850 , piece_id=YGTUS6L4ELADSHJ6QYQ4TVJISX2JFORARWXLTFVKJBP6U5G3VRXQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.434893408 (9h39m54.393990652s) [noise=true , address=45.91.116.7:4025 , piece_id=Z6A447ONI4GUMEF5WWQ2L2PHBRJTKO4QCOZLTEXVAHHBZUUFKOUA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.437617758 (9h39m54.396715008s) [noise=true , address=104.36.82.16:4326 , piece_id=WBKXCDM2WHHL7BPGGXWMH5VQHHLDYMEAKDIV5OELPLK4BMYA2A3A, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.446231916 (9h39m54.40532915s) [noise=true , address=104.36.82.4:4814 , piece_id=Q5DTS47O6DLKJTCI5F7OZB6W4WZNOSMF462Q73UETEYVLFUDX62Q, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.446909731 (9h39m54.406006978s) [noise=true , address=104.36.82.13:4202 , piece_id=PX2AVXLFICW4VGCM5WRS3CY3GRCXAR4ZN6JQSXGNOVO26AEFQPTQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.448246534 (9h39m54.407343784s) [noise=true , address=104.36.82.46:4500 , piece_id=LRR2PS5QFTUPGYYNK7EEHRTROP3AQ7QE74F6JAK4LWVE7EN2EZBA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.449834746 (9h39m54.408931999s) [noise=true , address=104.36.82.60:4358 , piece_id=AHUW2J7XY7EWOWCAIP2PMGNUF5VRGBKNZCIFFZ2KFQNGT7MQYZ3A, seg_pos={0 0}, upload=10003]: Done uploading piece. err: <nil> Aug 9 03:05:32.449851811 (9h39m54.408949064s) [seg_pos={0 0}, upload=10003]: Segment reached optimal threshold of 14 pieces. Aug 9 03:05:32.450304422 (9h39m54.409401679s) [noise=true , address=104.36.82.34:4580 , piece_id=BRRNV77O47TZTLBLQAMU35KH7W42DJJMYDYZBCZI63TZBIRT22ZQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12569SWj8WmR8tWoBXk7XJK1KS6BZMcYHrQjPKGfhj21xFPQ1W3): protocol: expected piece hash; context canceled; EOF Aug 9 03:05:32.450411008 (9h39m54.409508255s) [noise=true , address=104.36.82.17:4347 , piece_id=QHSZXBGCDFH7DNEKD3LAYS4XA4YU7DUAK6CRHKKZHOSWSDRF6QDA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1gCmsGzM2h65bWs16EY6VPrxewcUDnhvfdb1aRPZ8EMhCYHfaA): protocol: expected piece hash; context canceled; EOF Aug 9 03:05:32.450492811 (9h39m54.409590057s) [noise=true , address=104.36.82.43:4848 , piece_id=WQHSYXUZ2FXCAOXY5C4J5LDOMVJI5E47IM3C5TFGH33YI4IZIJAA, seg_pos={0 0}, upload=10003]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1DPLv5Kfsx9RLVWeRrxbdkaLGJc4dfrzGnPLwc8us9hT5uiPbj): protocol: expected piece hash; context canceled; EOF Aug 9 03:05:32.450611707 (9h39m54.409708955s) [noise=true , address=64.49.13.26:4953 , piece_id=2GNCQMTWJGSSKHYOCSN5S57UX5YTVHBSGFJAM5UTZFJAKKL6FQCQ, seg_pos={0 0}, upload=10003]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JvztpAXVj8B4XY7FgaFcsWtqwSxzpV4sRc926EigSpGqnytXE): protocol: write tcp 139.59.144.22:35798->64.49.13.26:4953: use of closed network connection; write tcp 139.59.144.22:35798->64.49.13.26:4953: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35798->64.49.13.26:4953: use of closed network connection Aug 9 03:05:32.450627802 (9h39m54.409725061s) [seg_pos={0 0}, upload=10003]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 9 03:05:32.450714540 (9h39m54.409811797s) [upload=10003]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 9 03:05:32.450720222 (9h39m54.409817475s) [upload=10003]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:05:32.612407319 (9h39m54.571504583s) [upload=10003]: Done uploading segments... Aug 9 03:05:32.612437481 (9h39m54.571534716s) [upload=10003]: Upload finished. err: <nil> Duration: 2.454880005s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [......................X....................................X] duration: 358.682784ms FAIL (2025-08-09 03:29:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 03:29:07.630773590 (10h3m29.589870841s) [upload=10421]: Starting upload Aug 9 03:29:07.630849282 (10h3m29.589946539s) [upload=10421]: Done starting upload Aug 9 03:29:07.630961591 (10h3m29.590058839s) [upload=10421]: Uploading segments... Aug 9 03:29:07.631490444 (10h3m29.5905877s) [upload=10421]: Got next segment. Inline: true Aug 9 03:29:07.631520161 (10h3m29.590617411s) [upload=10421]: Waiting for error group managing segments... Aug 9 03:29:07.631602338 (10h3m29.59069957s) [upload=10421]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 9 03:29:07.631609557 (10h3m29.590706809s) [upload=10421]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 9 03:29:07.631614555 (10h3m29.590711801s) [upload=10421]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 9 03:29:07.719629732 (10h3m29.678726989s) [upload=10421]: Done uploading segments... Aug 9 03:29:07.719673059 (10h3m29.678770322s) [upload=10421]: Upload finished. err: metaclient: Too Many Requests Duration:* 358.733751ms core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.HTTP{"GET" "https://uptime-checks-us-select.s3.us-select-1.storjapi.io/hello-world.txt?AWSAccessKeyId=jv6fvdi5muos6nw22tdksxgfrd2a&Signature=KjTmfuFyjkIAPapJ1pe5FKXvyIY%3D&Expires=1771562410", ExpectedContent: "Hello, world!"} failure (antiblip window 3/60): (http.us_select_1.gateway)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)