Orbiter History

checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.884065346s trace: https://jaeger.dev.storj.io/trace/4dcbf2bdf7405449 FAIL (2026-02-08 19:01:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.884251315s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....XX.....................................................] duration: 2.38836079s trace: https://jaeger.dev.storj.io/trace/6d7de065855c854f FAIL (2026-02-08 19:01:50 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== oad=509178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 18:22:03.960927132 (578h26m41.84488134s) [upload=509178]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 18:22:04.110748788 (578h26m41.994702997s) [seg_pos={0 0}, upload=509178]: Begin upload segment... Feb 8 18:22:04.110820336 (578h26m41.994774543s) [seg_pos={0 0}, upload=509178]: Done begin upload segment. Feb 8 18:22:04.110856501 (578h26m41.994810703s) [noise=true , address=77.90.31.21:4880 , piece_id=USK3WG27XI5BWWHW4KD6PKF5QZFF2WC55LLDQ6DYICTR7RL4FEQA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.115693397 (578h26m41.999647587s) [noise=true , address=45.91.116.12:4244 , piece_id=677ZBCVMYCFHEHZXDZLMDNH7CAEH54SYWJTE5AVWFNFH4WGW3TVQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.116499874 (578h26m42.000454086s) [noise=true , address=145.79.227.36:4518 , piece_id=X6IT5WDM5GGJEUTBYRCU7JJT6E6SDR43J7MY25KWSHMENNBDZJOA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.118777725 (578h26m42.002731938s) [noise=true , address=77.90.31.16:4736 , piece_id=I3YMRQLJRC6AGZCS3X24NPS4ZMY6V2RUGMSYVQKA6CQCDP74Y6YA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.119400779 (578h26m42.003354998s) [noise=true , address=77.90.31.11:4556 , piece_id=BBBH26EPDCSQIHDGRXAK5R6B5P7LS2KINZJ4PX23X5ND4A4MEHIQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.119963979 (578h26m42.003918195s) [noise=true , address=45.91.116.7:4012 , piece_id=TQWEGKVB4YKOQQ5JUPDOUB3NJKXT7SJ3MN2HULE3KSDA6EEKG5KQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.120514589 (578h26m42.004468803s) [noise=true , address=45.91.116.9:4262 , piece_id=W4IKJMAXYTG3GMYNSRTWHHJFODGL6O23I74EIBWPHZN2EIYSUGZA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.121035040 (578h26m42.004989257s) [noise=true , address=77.90.31.19:4844 , piece_id=YQ4QWJRT22Y7FZ2PSZSYADSBYCIG2RW2J6AGVPJBUWF7RWAQRXGA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.121549635 (578h26m42.00550385s) [noise=true , address=79.127.219.38:4820 , piece_id=DDBMTKBRXR7DCD5YNOWWD4NANY6H2MAARBME5JRMGDC5O55ZTFPA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.122136143 (578h26m42.006090357s) [noise=true , address=45.91.116.12:4228 , piece_id=J5PHXEAUTYO3L2SCOWJV5DG4HSSCCRDXSU4FRQZPZGUAQNYCUCSA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.122700058 (578h26m42.006654279s) [noise=true , address=77.90.31.10:4520 , piece_id=GVEUY3LEGLLZOHGUHZJ342W77346FB5OIJGHYWL6RFWAPN6NJBEQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.123269841 (578h26m42.007224055s) [noise=true , address=79.127.219.38:4818 , piece_id=HBQ65EPXPLTY3RRBDJKOJWJOOEAHV2CDQPKSXJG2JJ4WVWIBGEBA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.123822811 (578h26m42.007777028s) [noise=true , address=77.90.31.13:4629 , piece_id=HOYQBJTPUN3ZJT24DYY4KPKNP3WC3PY7L5CUSGNMJZH3LZPVYMQQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.125362061 (578h26m42.009316274s) [noise=true , address=79.127.219.46:4894 , piece_id=Y4X54TAT6YVVCN7CBMZBBMTQJHMLPUB2CFOBPP3SEPDAXOE4MIFA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.126626714 (578h26m42.010580926s) [noise=true , address=45.91.116.11:4152 , piece_id=E2JT4VPQLPITKBG7VX3DGLHW3C75DKSXRFSDP4FTSMWJTCE2WNYQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.128551993 (578h26m42.012506207s) [noise=true , address=77.90.31.15:4697 , piece_id=BSVS5EKTGONBHXQSSCIIEWSKKHJCZPU57I6HA6JOLVDCK2THAPEA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.749709963 (578h26m42.633664174s) [upload=509178]: Next returned nil segment Feb 8 18:22:04.749726686 (578h26m42.633680894s) [upload=509178]: Waiting for error group managing segments... Feb 8 18:22:04.892514286 (578h26m42.776468499s) [noise=true , address=45.91.116.12:4228 , piece_id=J5PHXEAUTYO3L2SCOWJV5DG4HSSCCRDXSU4FRQZPZGUAQNYCUCSA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.892834641 (578h26m42.776788835s) [noise=true , address=45.91.116.9:4262 , piece_id=W4IKJMAXYTG3GMYNSRTWHHJFODGL6O23I74EIBWPHZN2EIYSUGZA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.895637894 (578h26m42.7795921s) [noise=true , address=45.91.116.11:4152 , piece_id=E2JT4VPQLPITKBG7VX3DGLHW3C75DKSXRFSDP4FTSMWJTCE2WNYQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.911053197 (578h26m42.795007406s) [noise=true , address=45.91.116.12:4244 , piece_id=677ZBCVMYCFHEHZXDZLMDNH7CAEH54SYWJTE5AVWFNFH4WGW3TVQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.913091544 (578h26m42.797045758s) [noise=true , address=45.91.116.7:4012 , piece_id=TQWEGKVB4YKOQQ5JUPDOUB3NJKXT7SJ3MN2HULE3KSDA6EEKG5KQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:08.025526151 (578h26m45.909480356s) [noise=true , address=79.127.219.38:4818 , piece_id=HBQ65EPXPLTY3RRBDJKOJWJOOEAHV2CDQPKSXJG2JJ4WVWIBGEBA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:10.693673801 (578h26m48.577628002s) [noise=true , address=145.79.227.36:4518 , piece_id=X6IT5WDM5GGJEUTBYRCU7JJT6E6SDR43J7MY25KWSHMENNBDZJOA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:12.731005984 (578h26m50.614960184s) [noise=true , address=79.127.219.46:4894 , piece_id=Y4X54TAT6YVVCN7CBMZBBMTQJHMLPUB2CFOBPP3SEPDAXOE4MIFA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:33.605468726 (578h27m11.489422938s) [noise=true , address=77.90.31.19:4844 , piece_id=YQ4QWJRT22Y7FZ2PSZSYADSBYCIG2RW2J6AGVPJBUWF7RWAQRXGA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: rpc: dial tcp 77.90.31.19:4844: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.605738489 (578h27m11.489692708s) [noise=true , address=77.90.31.10:4520 , piece_id=GVEUY3LEGLLZOHGUHZJ342W77346FB5OIJGHYWL6RFWAPN6NJBEQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: read tcp 139.59.144.22:58478->77.90.31.10:4520: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.605844639 (578h27m11.489798909s) [noise=true , address=77.90.31.13:4629 , piece_id=HOYQBJTPUN3ZJT24DYY4KPKNP3WC3PY7L5CUSGNMJZH3LZPVYMQQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:60068->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606136012 (578h27m11.490090201s) [noise=true , address=79.127.219.38:4820 , piece_id=DDBMTKBRXR7DCD5YNOWWD4NANY6H2MAARBME5JRMGDC5O55ZTFPA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection; write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection Feb 8 18:22:33.606166109 (578h27m11.490120322s) [noise=true , address=77.90.31.21:4880 , piece_id=USK3WG27XI5BWWHW4KD6PKF5QZFF2WC55LLDQ6DYICTR7RL4FEQA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb, address:77.90.31.21:4880): protocol: read tcp 139.59.144.22:60158->77.90.31.21:4880: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606403948 (578h27m11.490358158s) [noise=true , address=77.90.31.16:4736 , piece_id=I3YMRQLJRC6AGZCS3X24NPS4ZMY6V2RUGMSYVQKA6CQCDP74Y6YA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: read tcp 139.59.144.22:41548->77.90.31.16:4736: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606474964 (578h27m11.490429174s) [noise=true , address=77.90.31.11:4556 , piece_id=BBBH26EPDCSQIHDGRXAK5R6B5P7LS2KINZJ4PX23X5ND4A4MEHIQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1QNr5B8kdrSa59rHAb82TcvSYpru7m7zbdxXqqxw3FpcFyfpks, address:77.90.31.11:4556): protocol: read tcp 139.59.144.22:43432->77.90.31.11:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606659904 (578h27m11.490614092s) [noise=true , address=77.90.31.15:4697 , piece_id=BSVS5EKTGONBHXQSSCIIEWSKKHJCZPU57I6HA6JOLVDCK2THAPEA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:49004->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606692396 (578h27m11.490646597s) [seg_pos={0 0}, upload=509178]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 8 18:22:33.717090428 (578h27m11.601044639s) [upload=509178]: Done uploading segments... Feb 8 18:22:33.717136942 (578h27m11.601091151s) [upload=509178]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.3883893s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.....X......................................................] duration: 1.708250351s trace: https://jaeger.dev.storj.io/trace/42fce211b8a1e546 FAIL (2026-02-08 19:01:32 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.708382988s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.697094903s trace: https://jaeger.dev.storj.io/trace/4dcbf2bdf7405449 FAIL (2026-02-08 19:01:15 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.697122469s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.836246911s trace: https://jaeger.dev.storj.io/trace/4dcbf2bdf7405449 FAIL (2026-02-08 19:00:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.836269294s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [......X.....................................................] duration: 1.715153793s trace: https://jaeger.dev.storj.io/trace/42fce211b8a1e546 FAIL (2026-02-08 19:00:50 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.715251303s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......XX....................................................] duration: 2.299749277s trace: https://jaeger.dev.storj.io/trace/6d7de065855c854f FAIL (2026-02-08 19:00:48 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== oad=509178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 18:22:03.960927132 (578h26m41.84488134s) [upload=509178]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 18:22:04.110748788 (578h26m41.994702997s) [seg_pos={0 0}, upload=509178]: Begin upload segment... Feb 8 18:22:04.110820336 (578h26m41.994774543s) [seg_pos={0 0}, upload=509178]: Done begin upload segment. Feb 8 18:22:04.110856501 (578h26m41.994810703s) [noise=true , address=77.90.31.21:4880 , piece_id=USK3WG27XI5BWWHW4KD6PKF5QZFF2WC55LLDQ6DYICTR7RL4FEQA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.115693397 (578h26m41.999647587s) [noise=true , address=45.91.116.12:4244 , piece_id=677ZBCVMYCFHEHZXDZLMDNH7CAEH54SYWJTE5AVWFNFH4WGW3TVQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.116499874 (578h26m42.000454086s) [noise=true , address=145.79.227.36:4518 , piece_id=X6IT5WDM5GGJEUTBYRCU7JJT6E6SDR43J7MY25KWSHMENNBDZJOA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.118777725 (578h26m42.002731938s) [noise=true , address=77.90.31.16:4736 , piece_id=I3YMRQLJRC6AGZCS3X24NPS4ZMY6V2RUGMSYVQKA6CQCDP74Y6YA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.119400779 (578h26m42.003354998s) [noise=true , address=77.90.31.11:4556 , piece_id=BBBH26EPDCSQIHDGRXAK5R6B5P7LS2KINZJ4PX23X5ND4A4MEHIQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.119963979 (578h26m42.003918195s) [noise=true , address=45.91.116.7:4012 , piece_id=TQWEGKVB4YKOQQ5JUPDOUB3NJKXT7SJ3MN2HULE3KSDA6EEKG5KQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.120514589 (578h26m42.004468803s) [noise=true , address=45.91.116.9:4262 , piece_id=W4IKJMAXYTG3GMYNSRTWHHJFODGL6O23I74EIBWPHZN2EIYSUGZA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.121035040 (578h26m42.004989257s) [noise=true , address=77.90.31.19:4844 , piece_id=YQ4QWJRT22Y7FZ2PSZSYADSBYCIG2RW2J6AGVPJBUWF7RWAQRXGA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.121549635 (578h26m42.00550385s) [noise=true , address=79.127.219.38:4820 , piece_id=DDBMTKBRXR7DCD5YNOWWD4NANY6H2MAARBME5JRMGDC5O55ZTFPA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.122136143 (578h26m42.006090357s) [noise=true , address=45.91.116.12:4228 , piece_id=J5PHXEAUTYO3L2SCOWJV5DG4HSSCCRDXSU4FRQZPZGUAQNYCUCSA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.122700058 (578h26m42.006654279s) [noise=true , address=77.90.31.10:4520 , piece_id=GVEUY3LEGLLZOHGUHZJ342W77346FB5OIJGHYWL6RFWAPN6NJBEQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.123269841 (578h26m42.007224055s) [noise=true , address=79.127.219.38:4818 , piece_id=HBQ65EPXPLTY3RRBDJKOJWJOOEAHV2CDQPKSXJG2JJ4WVWIBGEBA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.123822811 (578h26m42.007777028s) [noise=true , address=77.90.31.13:4629 , piece_id=HOYQBJTPUN3ZJT24DYY4KPKNP3WC3PY7L5CUSGNMJZH3LZPVYMQQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.125362061 (578h26m42.009316274s) [noise=true , address=79.127.219.46:4894 , piece_id=Y4X54TAT6YVVCN7CBMZBBMTQJHMLPUB2CFOBPP3SEPDAXOE4MIFA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.126626714 (578h26m42.010580926s) [noise=true , address=45.91.116.11:4152 , piece_id=E2JT4VPQLPITKBG7VX3DGLHW3C75DKSXRFSDP4FTSMWJTCE2WNYQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.128551993 (578h26m42.012506207s) [noise=true , address=77.90.31.15:4697 , piece_id=BSVS5EKTGONBHXQSSCIIEWSKKHJCZPU57I6HA6JOLVDCK2THAPEA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.749709963 (578h26m42.633664174s) [upload=509178]: Next returned nil segment Feb 8 18:22:04.749726686 (578h26m42.633680894s) [upload=509178]: Waiting for error group managing segments... Feb 8 18:22:04.892514286 (578h26m42.776468499s) [noise=true , address=45.91.116.12:4228 , piece_id=J5PHXEAUTYO3L2SCOWJV5DG4HSSCCRDXSU4FRQZPZGUAQNYCUCSA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.892834641 (578h26m42.776788835s) [noise=true , address=45.91.116.9:4262 , piece_id=W4IKJMAXYTG3GMYNSRTWHHJFODGL6O23I74EIBWPHZN2EIYSUGZA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.895637894 (578h26m42.7795921s) [noise=true , address=45.91.116.11:4152 , piece_id=E2JT4VPQLPITKBG7VX3DGLHW3C75DKSXRFSDP4FTSMWJTCE2WNYQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.911053197 (578h26m42.795007406s) [noise=true , address=45.91.116.12:4244 , piece_id=677ZBCVMYCFHEHZXDZLMDNH7CAEH54SYWJTE5AVWFNFH4WGW3TVQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.913091544 (578h26m42.797045758s) [noise=true , address=45.91.116.7:4012 , piece_id=TQWEGKVB4YKOQQ5JUPDOUB3NJKXT7SJ3MN2HULE3KSDA6EEKG5KQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:08.025526151 (578h26m45.909480356s) [noise=true , address=79.127.219.38:4818 , piece_id=HBQ65EPXPLTY3RRBDJKOJWJOOEAHV2CDQPKSXJG2JJ4WVWIBGEBA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:10.693673801 (578h26m48.577628002s) [noise=true , address=145.79.227.36:4518 , piece_id=X6IT5WDM5GGJEUTBYRCU7JJT6E6SDR43J7MY25KWSHMENNBDZJOA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:12.731005984 (578h26m50.614960184s) [noise=true , address=79.127.219.46:4894 , piece_id=Y4X54TAT6YVVCN7CBMZBBMTQJHMLPUB2CFOBPP3SEPDAXOE4MIFA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:33.605468726 (578h27m11.489422938s) [noise=true , address=77.90.31.19:4844 , piece_id=YQ4QWJRT22Y7FZ2PSZSYADSBYCIG2RW2J6AGVPJBUWF7RWAQRXGA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: rpc: dial tcp 77.90.31.19:4844: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.605738489 (578h27m11.489692708s) [noise=true , address=77.90.31.10:4520 , piece_id=GVEUY3LEGLLZOHGUHZJ342W77346FB5OIJGHYWL6RFWAPN6NJBEQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: read tcp 139.59.144.22:58478->77.90.31.10:4520: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.605844639 (578h27m11.489798909s) [noise=true , address=77.90.31.13:4629 , piece_id=HOYQBJTPUN3ZJT24DYY4KPKNP3WC3PY7L5CUSGNMJZH3LZPVYMQQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:60068->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606136012 (578h27m11.490090201s) [noise=true , address=79.127.219.38:4820 , piece_id=DDBMTKBRXR7DCD5YNOWWD4NANY6H2MAARBME5JRMGDC5O55ZTFPA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection; write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection Feb 8 18:22:33.606166109 (578h27m11.490120322s) [noise=true , address=77.90.31.21:4880 , piece_id=USK3WG27XI5BWWHW4KD6PKF5QZFF2WC55LLDQ6DYICTR7RL4FEQA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb, address:77.90.31.21:4880): protocol: read tcp 139.59.144.22:60158->77.90.31.21:4880: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606403948 (578h27m11.490358158s) [noise=true , address=77.90.31.16:4736 , piece_id=I3YMRQLJRC6AGZCS3X24NPS4ZMY6V2RUGMSYVQKA6CQCDP74Y6YA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: read tcp 139.59.144.22:41548->77.90.31.16:4736: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606474964 (578h27m11.490429174s) [noise=true , address=77.90.31.11:4556 , piece_id=BBBH26EPDCSQIHDGRXAK5R6B5P7LS2KINZJ4PX23X5ND4A4MEHIQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1QNr5B8kdrSa59rHAb82TcvSYpru7m7zbdxXqqxw3FpcFyfpks, address:77.90.31.11:4556): protocol: read tcp 139.59.144.22:43432->77.90.31.11:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606659904 (578h27m11.490614092s) [noise=true , address=77.90.31.15:4697 , piece_id=BSVS5EKTGONBHXQSSCIIEWSKKHJCZPU57I6HA6JOLVDCK2THAPEA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:49004->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606692396 (578h27m11.490646597s) [seg_pos={0 0}, upload=509178]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 8 18:22:33.717090428 (578h27m11.601044639s) [upload=509178]: Done uploading segments... Feb 8 18:22:33.717136942 (578h27m11.601091151s) [upload=509178]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.299770228s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.870661883s trace: https://jaeger.dev.storj.io/trace/4dcbf2bdf7405449 FAIL (2026-02-08 19:00:41 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.870729704s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......XX...................................................] duration: 2.367462588s trace: https://jaeger.dev.storj.io/trace/6d7de065855c854f FAIL (2026-02-08 19:00:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== oad=509178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 18:22:03.960927132 (578h26m41.84488134s) [upload=509178]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 18:22:04.110748788 (578h26m41.994702997s) [seg_pos={0 0}, upload=509178]: Begin upload segment... Feb 8 18:22:04.110820336 (578h26m41.994774543s) [seg_pos={0 0}, upload=509178]: Done begin upload segment. Feb 8 18:22:04.110856501 (578h26m41.994810703s) [noise=true , address=77.90.31.21:4880 , piece_id=USK3WG27XI5BWWHW4KD6PKF5QZFF2WC55LLDQ6DYICTR7RL4FEQA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.115693397 (578h26m41.999647587s) [noise=true , address=45.91.116.12:4244 , piece_id=677ZBCVMYCFHEHZXDZLMDNH7CAEH54SYWJTE5AVWFNFH4WGW3TVQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.116499874 (578h26m42.000454086s) [noise=true , address=145.79.227.36:4518 , piece_id=X6IT5WDM5GGJEUTBYRCU7JJT6E6SDR43J7MY25KWSHMENNBDZJOA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.118777725 (578h26m42.002731938s) [noise=true , address=77.90.31.16:4736 , piece_id=I3YMRQLJRC6AGZCS3X24NPS4ZMY6V2RUGMSYVQKA6CQCDP74Y6YA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.119400779 (578h26m42.003354998s) [noise=true , address=77.90.31.11:4556 , piece_id=BBBH26EPDCSQIHDGRXAK5R6B5P7LS2KINZJ4PX23X5ND4A4MEHIQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.119963979 (578h26m42.003918195s) [noise=true , address=45.91.116.7:4012 , piece_id=TQWEGKVB4YKOQQ5JUPDOUB3NJKXT7SJ3MN2HULE3KSDA6EEKG5KQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.120514589 (578h26m42.004468803s) [noise=true , address=45.91.116.9:4262 , piece_id=W4IKJMAXYTG3GMYNSRTWHHJFODGL6O23I74EIBWPHZN2EIYSUGZA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.121035040 (578h26m42.004989257s) [noise=true , address=77.90.31.19:4844 , piece_id=YQ4QWJRT22Y7FZ2PSZSYADSBYCIG2RW2J6AGVPJBUWF7RWAQRXGA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.121549635 (578h26m42.00550385s) [noise=true , address=79.127.219.38:4820 , piece_id=DDBMTKBRXR7DCD5YNOWWD4NANY6H2MAARBME5JRMGDC5O55ZTFPA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.122136143 (578h26m42.006090357s) [noise=true , address=45.91.116.12:4228 , piece_id=J5PHXEAUTYO3L2SCOWJV5DG4HSSCCRDXSU4FRQZPZGUAQNYCUCSA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.122700058 (578h26m42.006654279s) [noise=true , address=77.90.31.10:4520 , piece_id=GVEUY3LEGLLZOHGUHZJ342W77346FB5OIJGHYWL6RFWAPN6NJBEQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.123269841 (578h26m42.007224055s) [noise=true , address=79.127.219.38:4818 , piece_id=HBQ65EPXPLTY3RRBDJKOJWJOOEAHV2CDQPKSXJG2JJ4WVWIBGEBA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.123822811 (578h26m42.007777028s) [noise=true , address=77.90.31.13:4629 , piece_id=HOYQBJTPUN3ZJT24DYY4KPKNP3WC3PY7L5CUSGNMJZH3LZPVYMQQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.125362061 (578h26m42.009316274s) [noise=true , address=79.127.219.46:4894 , piece_id=Y4X54TAT6YVVCN7CBMZBBMTQJHMLPUB2CFOBPP3SEPDAXOE4MIFA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.126626714 (578h26m42.010580926s) [noise=true , address=45.91.116.11:4152 , piece_id=E2JT4VPQLPITKBG7VX3DGLHW3C75DKSXRFSDP4FTSMWJTCE2WNYQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.128551993 (578h26m42.012506207s) [noise=true , address=77.90.31.15:4697 , piece_id=BSVS5EKTGONBHXQSSCIIEWSKKHJCZPU57I6HA6JOLVDCK2THAPEA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.749709963 (578h26m42.633664174s) [upload=509178]: Next returned nil segment Feb 8 18:22:04.749726686 (578h26m42.633680894s) [upload=509178]: Waiting for error group managing segments... Feb 8 18:22:04.892514286 (578h26m42.776468499s) [noise=true , address=45.91.116.12:4228 , piece_id=J5PHXEAUTYO3L2SCOWJV5DG4HSSCCRDXSU4FRQZPZGUAQNYCUCSA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.892834641 (578h26m42.776788835s) [noise=true , address=45.91.116.9:4262 , piece_id=W4IKJMAXYTG3GMYNSRTWHHJFODGL6O23I74EIBWPHZN2EIYSUGZA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.895637894 (578h26m42.7795921s) [noise=true , address=45.91.116.11:4152 , piece_id=E2JT4VPQLPITKBG7VX3DGLHW3C75DKSXRFSDP4FTSMWJTCE2WNYQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.911053197 (578h26m42.795007406s) [noise=true , address=45.91.116.12:4244 , piece_id=677ZBCVMYCFHEHZXDZLMDNH7CAEH54SYWJTE5AVWFNFH4WGW3TVQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.913091544 (578h26m42.797045758s) [noise=true , address=45.91.116.7:4012 , piece_id=TQWEGKVB4YKOQQ5JUPDOUB3NJKXT7SJ3MN2HULE3KSDA6EEKG5KQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:08.025526151 (578h26m45.909480356s) [noise=true , address=79.127.219.38:4818 , piece_id=HBQ65EPXPLTY3RRBDJKOJWJOOEAHV2CDQPKSXJG2JJ4WVWIBGEBA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:10.693673801 (578h26m48.577628002s) [noise=true , address=145.79.227.36:4518 , piece_id=X6IT5WDM5GGJEUTBYRCU7JJT6E6SDR43J7MY25KWSHMENNBDZJOA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:12.731005984 (578h26m50.614960184s) [noise=true , address=79.127.219.46:4894 , piece_id=Y4X54TAT6YVVCN7CBMZBBMTQJHMLPUB2CFOBPP3SEPDAXOE4MIFA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:33.605468726 (578h27m11.489422938s) [noise=true , address=77.90.31.19:4844 , piece_id=YQ4QWJRT22Y7FZ2PSZSYADSBYCIG2RW2J6AGVPJBUWF7RWAQRXGA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: rpc: dial tcp 77.90.31.19:4844: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.605738489 (578h27m11.489692708s) [noise=true , address=77.90.31.10:4520 , piece_id=GVEUY3LEGLLZOHGUHZJ342W77346FB5OIJGHYWL6RFWAPN6NJBEQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: read tcp 139.59.144.22:58478->77.90.31.10:4520: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.605844639 (578h27m11.489798909s) [noise=true , address=77.90.31.13:4629 , piece_id=HOYQBJTPUN3ZJT24DYY4KPKNP3WC3PY7L5CUSGNMJZH3LZPVYMQQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:60068->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606136012 (578h27m11.490090201s) [noise=true , address=79.127.219.38:4820 , piece_id=DDBMTKBRXR7DCD5YNOWWD4NANY6H2MAARBME5JRMGDC5O55ZTFPA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection; write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection Feb 8 18:22:33.606166109 (578h27m11.490120322s) [noise=true , address=77.90.31.21:4880 , piece_id=USK3WG27XI5BWWHW4KD6PKF5QZFF2WC55LLDQ6DYICTR7RL4FEQA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb, address:77.90.31.21:4880): protocol: read tcp 139.59.144.22:60158->77.90.31.21:4880: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606403948 (578h27m11.490358158s) [noise=true , address=77.90.31.16:4736 , piece_id=I3YMRQLJRC6AGZCS3X24NPS4ZMY6V2RUGMSYVQKA6CQCDP74Y6YA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: read tcp 139.59.144.22:41548->77.90.31.16:4736: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606474964 (578h27m11.490429174s) [noise=true , address=77.90.31.11:4556 , piece_id=BBBH26EPDCSQIHDGRXAK5R6B5P7LS2KINZJ4PX23X5ND4A4MEHIQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1QNr5B8kdrSa59rHAb82TcvSYpru7m7zbdxXqqxw3FpcFyfpks, address:77.90.31.11:4556): protocol: read tcp 139.59.144.22:43432->77.90.31.11:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606659904 (578h27m11.490614092s) [noise=true , address=77.90.31.15:4697 , piece_id=BSVS5EKTGONBHXQSSCIIEWSKKHJCZPU57I6HA6JOLVDCK2THAPEA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:49004->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606692396 (578h27m11.490646597s) [seg_pos={0 0}, upload=509178]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 8 18:22:33.717090428 (578h27m11.601044639s) [upload=509178]: Done uploading segments... Feb 8 18:22:33.717136942 (578h27m11.601091151s) [upload=509178]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.367494521s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.......X....................................................] duration: 1.662031283s trace: https://jaeger.dev.storj.io/trace/42fce211b8a1e546 FAIL (2026-02-08 19:00:15 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.662056317s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.930470169s trace: https://jaeger.dev.storj.io/trace/4dcbf2bdf7405449 FAIL (2026-02-08 18:59:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.93087457s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........XX..................................................] duration: 2.548923407s trace: https://jaeger.dev.storj.io/trace/6d7de065855c854f FAIL (2026-02-08 18:59:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== oad=509178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 18:22:03.960927132 (578h26m41.84488134s) [upload=509178]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 18:22:04.110748788 (578h26m41.994702997s) [seg_pos={0 0}, upload=509178]: Begin upload segment... Feb 8 18:22:04.110820336 (578h26m41.994774543s) [seg_pos={0 0}, upload=509178]: Done begin upload segment. Feb 8 18:22:04.110856501 (578h26m41.994810703s) [noise=true , address=77.90.31.21:4880 , piece_id=USK3WG27XI5BWWHW4KD6PKF5QZFF2WC55LLDQ6DYICTR7RL4FEQA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.115693397 (578h26m41.999647587s) [noise=true , address=45.91.116.12:4244 , piece_id=677ZBCVMYCFHEHZXDZLMDNH7CAEH54SYWJTE5AVWFNFH4WGW3TVQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.116499874 (578h26m42.000454086s) [noise=true , address=145.79.227.36:4518 , piece_id=X6IT5WDM5GGJEUTBYRCU7JJT6E6SDR43J7MY25KWSHMENNBDZJOA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.118777725 (578h26m42.002731938s) [noise=true , address=77.90.31.16:4736 , piece_id=I3YMRQLJRC6AGZCS3X24NPS4ZMY6V2RUGMSYVQKA6CQCDP74Y6YA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.119400779 (578h26m42.003354998s) [noise=true , address=77.90.31.11:4556 , piece_id=BBBH26EPDCSQIHDGRXAK5R6B5P7LS2KINZJ4PX23X5ND4A4MEHIQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.119963979 (578h26m42.003918195s) [noise=true , address=45.91.116.7:4012 , piece_id=TQWEGKVB4YKOQQ5JUPDOUB3NJKXT7SJ3MN2HULE3KSDA6EEKG5KQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.120514589 (578h26m42.004468803s) [noise=true , address=45.91.116.9:4262 , piece_id=W4IKJMAXYTG3GMYNSRTWHHJFODGL6O23I74EIBWPHZN2EIYSUGZA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.121035040 (578h26m42.004989257s) [noise=true , address=77.90.31.19:4844 , piece_id=YQ4QWJRT22Y7FZ2PSZSYADSBYCIG2RW2J6AGVPJBUWF7RWAQRXGA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.121549635 (578h26m42.00550385s) [noise=true , address=79.127.219.38:4820 , piece_id=DDBMTKBRXR7DCD5YNOWWD4NANY6H2MAARBME5JRMGDC5O55ZTFPA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.122136143 (578h26m42.006090357s) [noise=true , address=45.91.116.12:4228 , piece_id=J5PHXEAUTYO3L2SCOWJV5DG4HSSCCRDXSU4FRQZPZGUAQNYCUCSA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.122700058 (578h26m42.006654279s) [noise=true , address=77.90.31.10:4520 , piece_id=GVEUY3LEGLLZOHGUHZJ342W77346FB5OIJGHYWL6RFWAPN6NJBEQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.123269841 (578h26m42.007224055s) [noise=true , address=79.127.219.38:4818 , piece_id=HBQ65EPXPLTY3RRBDJKOJWJOOEAHV2CDQPKSXJG2JJ4WVWIBGEBA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.123822811 (578h26m42.007777028s) [noise=true , address=77.90.31.13:4629 , piece_id=HOYQBJTPUN3ZJT24DYY4KPKNP3WC3PY7L5CUSGNMJZH3LZPVYMQQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.125362061 (578h26m42.009316274s) [noise=true , address=79.127.219.46:4894 , piece_id=Y4X54TAT6YVVCN7CBMZBBMTQJHMLPUB2CFOBPP3SEPDAXOE4MIFA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.126626714 (578h26m42.010580926s) [noise=true , address=45.91.116.11:4152 , piece_id=E2JT4VPQLPITKBG7VX3DGLHW3C75DKSXRFSDP4FTSMWJTCE2WNYQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.128551993 (578h26m42.012506207s) [noise=true , address=77.90.31.15:4697 , piece_id=BSVS5EKTGONBHXQSSCIIEWSKKHJCZPU57I6HA6JOLVDCK2THAPEA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.749709963 (578h26m42.633664174s) [upload=509178]: Next returned nil segment Feb 8 18:22:04.749726686 (578h26m42.633680894s) [upload=509178]: Waiting for error group managing segments... Feb 8 18:22:04.892514286 (578h26m42.776468499s) [noise=true , address=45.91.116.12:4228 , piece_id=J5PHXEAUTYO3L2SCOWJV5DG4HSSCCRDXSU4FRQZPZGUAQNYCUCSA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.892834641 (578h26m42.776788835s) [noise=true , address=45.91.116.9:4262 , piece_id=W4IKJMAXYTG3GMYNSRTWHHJFODGL6O23I74EIBWPHZN2EIYSUGZA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.895637894 (578h26m42.7795921s) [noise=true , address=45.91.116.11:4152 , piece_id=E2JT4VPQLPITKBG7VX3DGLHW3C75DKSXRFSDP4FTSMWJTCE2WNYQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.911053197 (578h26m42.795007406s) [noise=true , address=45.91.116.12:4244 , piece_id=677ZBCVMYCFHEHZXDZLMDNH7CAEH54SYWJTE5AVWFNFH4WGW3TVQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.913091544 (578h26m42.797045758s) [noise=true , address=45.91.116.7:4012 , piece_id=TQWEGKVB4YKOQQ5JUPDOUB3NJKXT7SJ3MN2HULE3KSDA6EEKG5KQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:08.025526151 (578h26m45.909480356s) [noise=true , address=79.127.219.38:4818 , piece_id=HBQ65EPXPLTY3RRBDJKOJWJOOEAHV2CDQPKSXJG2JJ4WVWIBGEBA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:10.693673801 (578h26m48.577628002s) [noise=true , address=145.79.227.36:4518 , piece_id=X6IT5WDM5GGJEUTBYRCU7JJT6E6SDR43J7MY25KWSHMENNBDZJOA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:12.731005984 (578h26m50.614960184s) [noise=true , address=79.127.219.46:4894 , piece_id=Y4X54TAT6YVVCN7CBMZBBMTQJHMLPUB2CFOBPP3SEPDAXOE4MIFA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:33.605468726 (578h27m11.489422938s) [noise=true , address=77.90.31.19:4844 , piece_id=YQ4QWJRT22Y7FZ2PSZSYADSBYCIG2RW2J6AGVPJBUWF7RWAQRXGA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: rpc: dial tcp 77.90.31.19:4844: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.605738489 (578h27m11.489692708s) [noise=true , address=77.90.31.10:4520 , piece_id=GVEUY3LEGLLZOHGUHZJ342W77346FB5OIJGHYWL6RFWAPN6NJBEQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: read tcp 139.59.144.22:58478->77.90.31.10:4520: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.605844639 (578h27m11.489798909s) [noise=true , address=77.90.31.13:4629 , piece_id=HOYQBJTPUN3ZJT24DYY4KPKNP3WC3PY7L5CUSGNMJZH3LZPVYMQQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:60068->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606136012 (578h27m11.490090201s) [noise=true , address=79.127.219.38:4820 , piece_id=DDBMTKBRXR7DCD5YNOWWD4NANY6H2MAARBME5JRMGDC5O55ZTFPA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection; write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection Feb 8 18:22:33.606166109 (578h27m11.490120322s) [noise=true , address=77.90.31.21:4880 , piece_id=USK3WG27XI5BWWHW4KD6PKF5QZFF2WC55LLDQ6DYICTR7RL4FEQA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb, address:77.90.31.21:4880): protocol: read tcp 139.59.144.22:60158->77.90.31.21:4880: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606403948 (578h27m11.490358158s) [noise=true , address=77.90.31.16:4736 , piece_id=I3YMRQLJRC6AGZCS3X24NPS4ZMY6V2RUGMSYVQKA6CQCDP74Y6YA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: read tcp 139.59.144.22:41548->77.90.31.16:4736: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606474964 (578h27m11.490429174s) [noise=true , address=77.90.31.11:4556 , piece_id=BBBH26EPDCSQIHDGRXAK5R6B5P7LS2KINZJ4PX23X5ND4A4MEHIQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1QNr5B8kdrSa59rHAb82TcvSYpru7m7zbdxXqqxw3FpcFyfpks, address:77.90.31.11:4556): protocol: read tcp 139.59.144.22:43432->77.90.31.11:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606659904 (578h27m11.490614092s) [noise=true , address=77.90.31.15:4697 , piece_id=BSVS5EKTGONBHXQSSCIIEWSKKHJCZPU57I6HA6JOLVDCK2THAPEA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:49004->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606692396 (578h27m11.490646597s) [seg_pos={0 0}, upload=509178]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 8 18:22:33.717090428 (578h27m11.601044639s) [upload=509178]: Done uploading segments... Feb 8 18:22:33.717136942 (578h27m11.601091151s) [upload=509178]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.548948418s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........XX.................................................] duration: 2.548756108s trace: https://jaeger.dev.storj.io/trace/6d7de065855c854f FAIL (2026-02-08 18:59:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== oad=509178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 18:22:03.960927132 (578h26m41.84488134s) [upload=509178]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 18:22:04.110748788 (578h26m41.994702997s) [seg_pos={0 0}, upload=509178]: Begin upload segment... Feb 8 18:22:04.110820336 (578h26m41.994774543s) [seg_pos={0 0}, upload=509178]: Done begin upload segment. Feb 8 18:22:04.110856501 (578h26m41.994810703s) [noise=true , address=77.90.31.21:4880 , piece_id=USK3WG27XI5BWWHW4KD6PKF5QZFF2WC55LLDQ6DYICTR7RL4FEQA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.115693397 (578h26m41.999647587s) [noise=true , address=45.91.116.12:4244 , piece_id=677ZBCVMYCFHEHZXDZLMDNH7CAEH54SYWJTE5AVWFNFH4WGW3TVQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.116499874 (578h26m42.000454086s) [noise=true , address=145.79.227.36:4518 , piece_id=X6IT5WDM5GGJEUTBYRCU7JJT6E6SDR43J7MY25KWSHMENNBDZJOA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.118777725 (578h26m42.002731938s) [noise=true , address=77.90.31.16:4736 , piece_id=I3YMRQLJRC6AGZCS3X24NPS4ZMY6V2RUGMSYVQKA6CQCDP74Y6YA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.119400779 (578h26m42.003354998s) [noise=true , address=77.90.31.11:4556 , piece_id=BBBH26EPDCSQIHDGRXAK5R6B5P7LS2KINZJ4PX23X5ND4A4MEHIQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.119963979 (578h26m42.003918195s) [noise=true , address=45.91.116.7:4012 , piece_id=TQWEGKVB4YKOQQ5JUPDOUB3NJKXT7SJ3MN2HULE3KSDA6EEKG5KQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.120514589 (578h26m42.004468803s) [noise=true , address=45.91.116.9:4262 , piece_id=W4IKJMAXYTG3GMYNSRTWHHJFODGL6O23I74EIBWPHZN2EIYSUGZA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.121035040 (578h26m42.004989257s) [noise=true , address=77.90.31.19:4844 , piece_id=YQ4QWJRT22Y7FZ2PSZSYADSBYCIG2RW2J6AGVPJBUWF7RWAQRXGA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.121549635 (578h26m42.00550385s) [noise=true , address=79.127.219.38:4820 , piece_id=DDBMTKBRXR7DCD5YNOWWD4NANY6H2MAARBME5JRMGDC5O55ZTFPA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.122136143 (578h26m42.006090357s) [noise=true , address=45.91.116.12:4228 , piece_id=J5PHXEAUTYO3L2SCOWJV5DG4HSSCCRDXSU4FRQZPZGUAQNYCUCSA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.122700058 (578h26m42.006654279s) [noise=true , address=77.90.31.10:4520 , piece_id=GVEUY3LEGLLZOHGUHZJ342W77346FB5OIJGHYWL6RFWAPN6NJBEQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.123269841 (578h26m42.007224055s) [noise=true , address=79.127.219.38:4818 , piece_id=HBQ65EPXPLTY3RRBDJKOJWJOOEAHV2CDQPKSXJG2JJ4WVWIBGEBA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.123822811 (578h26m42.007777028s) [noise=true , address=77.90.31.13:4629 , piece_id=HOYQBJTPUN3ZJT24DYY4KPKNP3WC3PY7L5CUSGNMJZH3LZPVYMQQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.125362061 (578h26m42.009316274s) [noise=true , address=79.127.219.46:4894 , piece_id=Y4X54TAT6YVVCN7CBMZBBMTQJHMLPUB2CFOBPP3SEPDAXOE4MIFA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.126626714 (578h26m42.010580926s) [noise=true , address=45.91.116.11:4152 , piece_id=E2JT4VPQLPITKBG7VX3DGLHW3C75DKSXRFSDP4FTSMWJTCE2WNYQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.128551993 (578h26m42.012506207s) [noise=true , address=77.90.31.15:4697 , piece_id=BSVS5EKTGONBHXQSSCIIEWSKKHJCZPU57I6HA6JOLVDCK2THAPEA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.749709963 (578h26m42.633664174s) [upload=509178]: Next returned nil segment Feb 8 18:22:04.749726686 (578h26m42.633680894s) [upload=509178]: Waiting for error group managing segments... Feb 8 18:22:04.892514286 (578h26m42.776468499s) [noise=true , address=45.91.116.12:4228 , piece_id=J5PHXEAUTYO3L2SCOWJV5DG4HSSCCRDXSU4FRQZPZGUAQNYCUCSA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.892834641 (578h26m42.776788835s) [noise=true , address=45.91.116.9:4262 , piece_id=W4IKJMAXYTG3GMYNSRTWHHJFODGL6O23I74EIBWPHZN2EIYSUGZA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.895637894 (578h26m42.7795921s) [noise=true , address=45.91.116.11:4152 , piece_id=E2JT4VPQLPITKBG7VX3DGLHW3C75DKSXRFSDP4FTSMWJTCE2WNYQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.911053197 (578h26m42.795007406s) [noise=true , address=45.91.116.12:4244 , piece_id=677ZBCVMYCFHEHZXDZLMDNH7CAEH54SYWJTE5AVWFNFH4WGW3TVQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.913091544 (578h26m42.797045758s) [noise=true , address=45.91.116.7:4012 , piece_id=TQWEGKVB4YKOQQ5JUPDOUB3NJKXT7SJ3MN2HULE3KSDA6EEKG5KQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:08.025526151 (578h26m45.909480356s) [noise=true , address=79.127.219.38:4818 , piece_id=HBQ65EPXPLTY3RRBDJKOJWJOOEAHV2CDQPKSXJG2JJ4WVWIBGEBA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:10.693673801 (578h26m48.577628002s) [noise=true , address=145.79.227.36:4518 , piece_id=X6IT5WDM5GGJEUTBYRCU7JJT6E6SDR43J7MY25KWSHMENNBDZJOA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:12.731005984 (578h26m50.614960184s) [noise=true , address=79.127.219.46:4894 , piece_id=Y4X54TAT6YVVCN7CBMZBBMTQJHMLPUB2CFOBPP3SEPDAXOE4MIFA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:33.605468726 (578h27m11.489422938s) [noise=true , address=77.90.31.19:4844 , piece_id=YQ4QWJRT22Y7FZ2PSZSYADSBYCIG2RW2J6AGVPJBUWF7RWAQRXGA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: rpc: dial tcp 77.90.31.19:4844: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.605738489 (578h27m11.489692708s) [noise=true , address=77.90.31.10:4520 , piece_id=GVEUY3LEGLLZOHGUHZJ342W77346FB5OIJGHYWL6RFWAPN6NJBEQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: read tcp 139.59.144.22:58478->77.90.31.10:4520: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.605844639 (578h27m11.489798909s) [noise=true , address=77.90.31.13:4629 , piece_id=HOYQBJTPUN3ZJT24DYY4KPKNP3WC3PY7L5CUSGNMJZH3LZPVYMQQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:60068->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606136012 (578h27m11.490090201s) [noise=true , address=79.127.219.38:4820 , piece_id=DDBMTKBRXR7DCD5YNOWWD4NANY6H2MAARBME5JRMGDC5O55ZTFPA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection; write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection Feb 8 18:22:33.606166109 (578h27m11.490120322s) [noise=true , address=77.90.31.21:4880 , piece_id=USK3WG27XI5BWWHW4KD6PKF5QZFF2WC55LLDQ6DYICTR7RL4FEQA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb, address:77.90.31.21:4880): protocol: read tcp 139.59.144.22:60158->77.90.31.21:4880: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606403948 (578h27m11.490358158s) [noise=true , address=77.90.31.16:4736 , piece_id=I3YMRQLJRC6AGZCS3X24NPS4ZMY6V2RUGMSYVQKA6CQCDP74Y6YA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: read tcp 139.59.144.22:41548->77.90.31.16:4736: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606474964 (578h27m11.490429174s) [noise=true , address=77.90.31.11:4556 , piece_id=BBBH26EPDCSQIHDGRXAK5R6B5P7LS2KINZJ4PX23X5ND4A4MEHIQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1QNr5B8kdrSa59rHAb82TcvSYpru7m7zbdxXqqxw3FpcFyfpks, address:77.90.31.11:4556): protocol: read tcp 139.59.144.22:43432->77.90.31.11:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606659904 (578h27m11.490614092s) [noise=true , address=77.90.31.15:4697 , piece_id=BSVS5EKTGONBHXQSSCIIEWSKKHJCZPU57I6HA6JOLVDCK2THAPEA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:49004->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606692396 (578h27m11.490646597s) [seg_pos={0 0}, upload=509178]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 8 18:22:33.717090428 (578h27m11.601044639s) [upload=509178]: Done uploading segments... Feb 8 18:22:33.717136942 (578h27m11.601091151s) [upload=509178]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.548778946s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.615851463s trace: https://jaeger.dev.storj.io/trace/4dcbf2bdf7405449 FAIL (2026-02-08 18:59:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.615877194s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [........X...................................................] duration: 1.609954622s trace: https://jaeger.dev.storj.io/trace/42fce211b8a1e546 FAIL (2026-02-08 18:59:18 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.610003942s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.771174275s trace: https://jaeger.dev.storj.io/trace/4dcbf2bdf7405449 FAIL (2026-02-08 18:58:31 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.771200495s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........XX................................................] duration: 2.30883597s trace: https://jaeger.dev.storj.io/trace/6d7de065855c854f FAIL (2026-02-08 18:58:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== oad=509178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 18:22:03.960927132 (578h26m41.84488134s) [upload=509178]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 18:22:04.110748788 (578h26m41.994702997s) [seg_pos={0 0}, upload=509178]: Begin upload segment... Feb 8 18:22:04.110820336 (578h26m41.994774543s) [seg_pos={0 0}, upload=509178]: Done begin upload segment. Feb 8 18:22:04.110856501 (578h26m41.994810703s) [noise=true , address=77.90.31.21:4880 , piece_id=USK3WG27XI5BWWHW4KD6PKF5QZFF2WC55LLDQ6DYICTR7RL4FEQA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.115693397 (578h26m41.999647587s) [noise=true , address=45.91.116.12:4244 , piece_id=677ZBCVMYCFHEHZXDZLMDNH7CAEH54SYWJTE5AVWFNFH4WGW3TVQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.116499874 (578h26m42.000454086s) [noise=true , address=145.79.227.36:4518 , piece_id=X6IT5WDM5GGJEUTBYRCU7JJT6E6SDR43J7MY25KWSHMENNBDZJOA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.118777725 (578h26m42.002731938s) [noise=true , address=77.90.31.16:4736 , piece_id=I3YMRQLJRC6AGZCS3X24NPS4ZMY6V2RUGMSYVQKA6CQCDP74Y6YA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.119400779 (578h26m42.003354998s) [noise=true , address=77.90.31.11:4556 , piece_id=BBBH26EPDCSQIHDGRXAK5R6B5P7LS2KINZJ4PX23X5ND4A4MEHIQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.119963979 (578h26m42.003918195s) [noise=true , address=45.91.116.7:4012 , piece_id=TQWEGKVB4YKOQQ5JUPDOUB3NJKXT7SJ3MN2HULE3KSDA6EEKG5KQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.120514589 (578h26m42.004468803s) [noise=true , address=45.91.116.9:4262 , piece_id=W4IKJMAXYTG3GMYNSRTWHHJFODGL6O23I74EIBWPHZN2EIYSUGZA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.121035040 (578h26m42.004989257s) [noise=true , address=77.90.31.19:4844 , piece_id=YQ4QWJRT22Y7FZ2PSZSYADSBYCIG2RW2J6AGVPJBUWF7RWAQRXGA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.121549635 (578h26m42.00550385s) [noise=true , address=79.127.219.38:4820 , piece_id=DDBMTKBRXR7DCD5YNOWWD4NANY6H2MAARBME5JRMGDC5O55ZTFPA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.122136143 (578h26m42.006090357s) [noise=true , address=45.91.116.12:4228 , piece_id=J5PHXEAUTYO3L2SCOWJV5DG4HSSCCRDXSU4FRQZPZGUAQNYCUCSA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.122700058 (578h26m42.006654279s) [noise=true , address=77.90.31.10:4520 , piece_id=GVEUY3LEGLLZOHGUHZJ342W77346FB5OIJGHYWL6RFWAPN6NJBEQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.123269841 (578h26m42.007224055s) [noise=true , address=79.127.219.38:4818 , piece_id=HBQ65EPXPLTY3RRBDJKOJWJOOEAHV2CDQPKSXJG2JJ4WVWIBGEBA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.123822811 (578h26m42.007777028s) [noise=true , address=77.90.31.13:4629 , piece_id=HOYQBJTPUN3ZJT24DYY4KPKNP3WC3PY7L5CUSGNMJZH3LZPVYMQQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.125362061 (578h26m42.009316274s) [noise=true , address=79.127.219.46:4894 , piece_id=Y4X54TAT6YVVCN7CBMZBBMTQJHMLPUB2CFOBPP3SEPDAXOE4MIFA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.126626714 (578h26m42.010580926s) [noise=true , address=45.91.116.11:4152 , piece_id=E2JT4VPQLPITKBG7VX3DGLHW3C75DKSXRFSDP4FTSMWJTCE2WNYQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.128551993 (578h26m42.012506207s) [noise=true , address=77.90.31.15:4697 , piece_id=BSVS5EKTGONBHXQSSCIIEWSKKHJCZPU57I6HA6JOLVDCK2THAPEA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.749709963 (578h26m42.633664174s) [upload=509178]: Next returned nil segment Feb 8 18:22:04.749726686 (578h26m42.633680894s) [upload=509178]: Waiting for error group managing segments... Feb 8 18:22:04.892514286 (578h26m42.776468499s) [noise=true , address=45.91.116.12:4228 , piece_id=J5PHXEAUTYO3L2SCOWJV5DG4HSSCCRDXSU4FRQZPZGUAQNYCUCSA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.892834641 (578h26m42.776788835s) [noise=true , address=45.91.116.9:4262 , piece_id=W4IKJMAXYTG3GMYNSRTWHHJFODGL6O23I74EIBWPHZN2EIYSUGZA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.895637894 (578h26m42.7795921s) [noise=true , address=45.91.116.11:4152 , piece_id=E2JT4VPQLPITKBG7VX3DGLHW3C75DKSXRFSDP4FTSMWJTCE2WNYQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.911053197 (578h26m42.795007406s) [noise=true , address=45.91.116.12:4244 , piece_id=677ZBCVMYCFHEHZXDZLMDNH7CAEH54SYWJTE5AVWFNFH4WGW3TVQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.913091544 (578h26m42.797045758s) [noise=true , address=45.91.116.7:4012 , piece_id=TQWEGKVB4YKOQQ5JUPDOUB3NJKXT7SJ3MN2HULE3KSDA6EEKG5KQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:08.025526151 (578h26m45.909480356s) [noise=true , address=79.127.219.38:4818 , piece_id=HBQ65EPXPLTY3RRBDJKOJWJOOEAHV2CDQPKSXJG2JJ4WVWIBGEBA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:10.693673801 (578h26m48.577628002s) [noise=true , address=145.79.227.36:4518 , piece_id=X6IT5WDM5GGJEUTBYRCU7JJT6E6SDR43J7MY25KWSHMENNBDZJOA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:12.731005984 (578h26m50.614960184s) [noise=true , address=79.127.219.46:4894 , piece_id=Y4X54TAT6YVVCN7CBMZBBMTQJHMLPUB2CFOBPP3SEPDAXOE4MIFA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:33.605468726 (578h27m11.489422938s) [noise=true , address=77.90.31.19:4844 , piece_id=YQ4QWJRT22Y7FZ2PSZSYADSBYCIG2RW2J6AGVPJBUWF7RWAQRXGA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: rpc: dial tcp 77.90.31.19:4844: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.605738489 (578h27m11.489692708s) [noise=true , address=77.90.31.10:4520 , piece_id=GVEUY3LEGLLZOHGUHZJ342W77346FB5OIJGHYWL6RFWAPN6NJBEQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: read tcp 139.59.144.22:58478->77.90.31.10:4520: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.605844639 (578h27m11.489798909s) [noise=true , address=77.90.31.13:4629 , piece_id=HOYQBJTPUN3ZJT24DYY4KPKNP3WC3PY7L5CUSGNMJZH3LZPVYMQQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:60068->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606136012 (578h27m11.490090201s) [noise=true , address=79.127.219.38:4820 , piece_id=DDBMTKBRXR7DCD5YNOWWD4NANY6H2MAARBME5JRMGDC5O55ZTFPA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection; write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection Feb 8 18:22:33.606166109 (578h27m11.490120322s) [noise=true , address=77.90.31.21:4880 , piece_id=USK3WG27XI5BWWHW4KD6PKF5QZFF2WC55LLDQ6DYICTR7RL4FEQA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb, address:77.90.31.21:4880): protocol: read tcp 139.59.144.22:60158->77.90.31.21:4880: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606403948 (578h27m11.490358158s) [noise=true , address=77.90.31.16:4736 , piece_id=I3YMRQLJRC6AGZCS3X24NPS4ZMY6V2RUGMSYVQKA6CQCDP74Y6YA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: read tcp 139.59.144.22:41548->77.90.31.16:4736: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606474964 (578h27m11.490429174s) [noise=true , address=77.90.31.11:4556 , piece_id=BBBH26EPDCSQIHDGRXAK5R6B5P7LS2KINZJ4PX23X5ND4A4MEHIQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1QNr5B8kdrSa59rHAb82TcvSYpru7m7zbdxXqqxw3FpcFyfpks, address:77.90.31.11:4556): protocol: read tcp 139.59.144.22:43432->77.90.31.11:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606659904 (578h27m11.490614092s) [noise=true , address=77.90.31.15:4697 , piece_id=BSVS5EKTGONBHXQSSCIIEWSKKHJCZPU57I6HA6JOLVDCK2THAPEA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:49004->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606692396 (578h27m11.490646597s) [seg_pos={0 0}, upload=509178]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 8 18:22:33.717090428 (578h27m11.601044639s) [upload=509178]: Done uploading segments... Feb 8 18:22:33.717136942 (578h27m11.601091151s) [upload=509178]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.308863986s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.........X..................................................] duration: 1.700665663s trace: https://jaeger.dev.storj.io/trace/42fce211b8a1e546 FAIL (2026-02-08 18:58:05 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.700694077s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.698509099s trace: https://jaeger.dev.storj.io/trace/4dcbf2bdf7405449 FAIL (2026-02-08 18:57:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.698532271s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..........X.................................................] duration: 1.583232031s trace: https://jaeger.dev.storj.io/trace/42fce211b8a1e546 FAIL (2026-02-08 18:57:33 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.583271563s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........XX...............................................] duration: 2.331941385s trace: https://jaeger.dev.storj.io/trace/6d7de065855c854f FAIL (2026-02-08 18:57:28 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== oad=509178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 18:22:03.960927132 (578h26m41.84488134s) [upload=509178]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 18:22:04.110748788 (578h26m41.994702997s) [seg_pos={0 0}, upload=509178]: Begin upload segment... Feb 8 18:22:04.110820336 (578h26m41.994774543s) [seg_pos={0 0}, upload=509178]: Done begin upload segment. Feb 8 18:22:04.110856501 (578h26m41.994810703s) [noise=true , address=77.90.31.21:4880 , piece_id=USK3WG27XI5BWWHW4KD6PKF5QZFF2WC55LLDQ6DYICTR7RL4FEQA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.115693397 (578h26m41.999647587s) [noise=true , address=45.91.116.12:4244 , piece_id=677ZBCVMYCFHEHZXDZLMDNH7CAEH54SYWJTE5AVWFNFH4WGW3TVQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.116499874 (578h26m42.000454086s) [noise=true , address=145.79.227.36:4518 , piece_id=X6IT5WDM5GGJEUTBYRCU7JJT6E6SDR43J7MY25KWSHMENNBDZJOA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.118777725 (578h26m42.002731938s) [noise=true , address=77.90.31.16:4736 , piece_id=I3YMRQLJRC6AGZCS3X24NPS4ZMY6V2RUGMSYVQKA6CQCDP74Y6YA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.119400779 (578h26m42.003354998s) [noise=true , address=77.90.31.11:4556 , piece_id=BBBH26EPDCSQIHDGRXAK5R6B5P7LS2KINZJ4PX23X5ND4A4MEHIQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.119963979 (578h26m42.003918195s) [noise=true , address=45.91.116.7:4012 , piece_id=TQWEGKVB4YKOQQ5JUPDOUB3NJKXT7SJ3MN2HULE3KSDA6EEKG5KQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.120514589 (578h26m42.004468803s) [noise=true , address=45.91.116.9:4262 , piece_id=W4IKJMAXYTG3GMYNSRTWHHJFODGL6O23I74EIBWPHZN2EIYSUGZA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.121035040 (578h26m42.004989257s) [noise=true , address=77.90.31.19:4844 , piece_id=YQ4QWJRT22Y7FZ2PSZSYADSBYCIG2RW2J6AGVPJBUWF7RWAQRXGA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.121549635 (578h26m42.00550385s) [noise=true , address=79.127.219.38:4820 , piece_id=DDBMTKBRXR7DCD5YNOWWD4NANY6H2MAARBME5JRMGDC5O55ZTFPA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.122136143 (578h26m42.006090357s) [noise=true , address=45.91.116.12:4228 , piece_id=J5PHXEAUTYO3L2SCOWJV5DG4HSSCCRDXSU4FRQZPZGUAQNYCUCSA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.122700058 (578h26m42.006654279s) [noise=true , address=77.90.31.10:4520 , piece_id=GVEUY3LEGLLZOHGUHZJ342W77346FB5OIJGHYWL6RFWAPN6NJBEQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.123269841 (578h26m42.007224055s) [noise=true , address=79.127.219.38:4818 , piece_id=HBQ65EPXPLTY3RRBDJKOJWJOOEAHV2CDQPKSXJG2JJ4WVWIBGEBA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.123822811 (578h26m42.007777028s) [noise=true , address=77.90.31.13:4629 , piece_id=HOYQBJTPUN3ZJT24DYY4KPKNP3WC3PY7L5CUSGNMJZH3LZPVYMQQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.125362061 (578h26m42.009316274s) [noise=true , address=79.127.219.46:4894 , piece_id=Y4X54TAT6YVVCN7CBMZBBMTQJHMLPUB2CFOBPP3SEPDAXOE4MIFA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.126626714 (578h26m42.010580926s) [noise=true , address=45.91.116.11:4152 , piece_id=E2JT4VPQLPITKBG7VX3DGLHW3C75DKSXRFSDP4FTSMWJTCE2WNYQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.128551993 (578h26m42.012506207s) [noise=true , address=77.90.31.15:4697 , piece_id=BSVS5EKTGONBHXQSSCIIEWSKKHJCZPU57I6HA6JOLVDCK2THAPEA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.749709963 (578h26m42.633664174s) [upload=509178]: Next returned nil segment Feb 8 18:22:04.749726686 (578h26m42.633680894s) [upload=509178]: Waiting for error group managing segments... Feb 8 18:22:04.892514286 (578h26m42.776468499s) [noise=true , address=45.91.116.12:4228 , piece_id=J5PHXEAUTYO3L2SCOWJV5DG4HSSCCRDXSU4FRQZPZGUAQNYCUCSA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.892834641 (578h26m42.776788835s) [noise=true , address=45.91.116.9:4262 , piece_id=W4IKJMAXYTG3GMYNSRTWHHJFODGL6O23I74EIBWPHZN2EIYSUGZA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.895637894 (578h26m42.7795921s) [noise=true , address=45.91.116.11:4152 , piece_id=E2JT4VPQLPITKBG7VX3DGLHW3C75DKSXRFSDP4FTSMWJTCE2WNYQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.911053197 (578h26m42.795007406s) [noise=true , address=45.91.116.12:4244 , piece_id=677ZBCVMYCFHEHZXDZLMDNH7CAEH54SYWJTE5AVWFNFH4WGW3TVQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.913091544 (578h26m42.797045758s) [noise=true , address=45.91.116.7:4012 , piece_id=TQWEGKVB4YKOQQ5JUPDOUB3NJKXT7SJ3MN2HULE3KSDA6EEKG5KQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:08.025526151 (578h26m45.909480356s) [noise=true , address=79.127.219.38:4818 , piece_id=HBQ65EPXPLTY3RRBDJKOJWJOOEAHV2CDQPKSXJG2JJ4WVWIBGEBA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:10.693673801 (578h26m48.577628002s) [noise=true , address=145.79.227.36:4518 , piece_id=X6IT5WDM5GGJEUTBYRCU7JJT6E6SDR43J7MY25KWSHMENNBDZJOA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:12.731005984 (578h26m50.614960184s) [noise=true , address=79.127.219.46:4894 , piece_id=Y4X54TAT6YVVCN7CBMZBBMTQJHMLPUB2CFOBPP3SEPDAXOE4MIFA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:33.605468726 (578h27m11.489422938s) [noise=true , address=77.90.31.19:4844 , piece_id=YQ4QWJRT22Y7FZ2PSZSYADSBYCIG2RW2J6AGVPJBUWF7RWAQRXGA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: rpc: dial tcp 77.90.31.19:4844: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.605738489 (578h27m11.489692708s) [noise=true , address=77.90.31.10:4520 , piece_id=GVEUY3LEGLLZOHGUHZJ342W77346FB5OIJGHYWL6RFWAPN6NJBEQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: read tcp 139.59.144.22:58478->77.90.31.10:4520: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.605844639 (578h27m11.489798909s) [noise=true , address=77.90.31.13:4629 , piece_id=HOYQBJTPUN3ZJT24DYY4KPKNP3WC3PY7L5CUSGNMJZH3LZPVYMQQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:60068->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606136012 (578h27m11.490090201s) [noise=true , address=79.127.219.38:4820 , piece_id=DDBMTKBRXR7DCD5YNOWWD4NANY6H2MAARBME5JRMGDC5O55ZTFPA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection; write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection Feb 8 18:22:33.606166109 (578h27m11.490120322s) [noise=true , address=77.90.31.21:4880 , piece_id=USK3WG27XI5BWWHW4KD6PKF5QZFF2WC55LLDQ6DYICTR7RL4FEQA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb, address:77.90.31.21:4880): protocol: read tcp 139.59.144.22:60158->77.90.31.21:4880: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606403948 (578h27m11.490358158s) [noise=true , address=77.90.31.16:4736 , piece_id=I3YMRQLJRC6AGZCS3X24NPS4ZMY6V2RUGMSYVQKA6CQCDP74Y6YA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: read tcp 139.59.144.22:41548->77.90.31.16:4736: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606474964 (578h27m11.490429174s) [noise=true , address=77.90.31.11:4556 , piece_id=BBBH26EPDCSQIHDGRXAK5R6B5P7LS2KINZJ4PX23X5ND4A4MEHIQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1QNr5B8kdrSa59rHAb82TcvSYpru7m7zbdxXqqxw3FpcFyfpks, address:77.90.31.11:4556): protocol: read tcp 139.59.144.22:43432->77.90.31.11:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606659904 (578h27m11.490614092s) [noise=true , address=77.90.31.15:4697 , piece_id=BSVS5EKTGONBHXQSSCIIEWSKKHJCZPU57I6HA6JOLVDCK2THAPEA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:49004->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606692396 (578h27m11.490646597s) [seg_pos={0 0}, upload=509178]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 8 18:22:33.717090428 (578h27m11.601044639s) [upload=509178]: Done uploading segments... Feb 8 18:22:33.717136942 (578h27m11.601091151s) [upload=509178]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.331964979s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...........X................................................] duration: 1.683526191s trace: https://jaeger.dev.storj.io/trace/42fce211b8a1e546 FAIL (2026-02-08 18:57:02 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.683557336s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [............XX..............................................] duration: 2.339828381s trace: https://jaeger.dev.storj.io/trace/6d7de065855c854f FAIL (2026-02-08 18:56:56 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== oad=509178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 18:22:03.960927132 (578h26m41.84488134s) [upload=509178]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 18:22:04.110748788 (578h26m41.994702997s) [seg_pos={0 0}, upload=509178]: Begin upload segment... Feb 8 18:22:04.110820336 (578h26m41.994774543s) [seg_pos={0 0}, upload=509178]: Done begin upload segment. Feb 8 18:22:04.110856501 (578h26m41.994810703s) [noise=true , address=77.90.31.21:4880 , piece_id=USK3WG27XI5BWWHW4KD6PKF5QZFF2WC55LLDQ6DYICTR7RL4FEQA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.115693397 (578h26m41.999647587s) [noise=true , address=45.91.116.12:4244 , piece_id=677ZBCVMYCFHEHZXDZLMDNH7CAEH54SYWJTE5AVWFNFH4WGW3TVQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.116499874 (578h26m42.000454086s) [noise=true , address=145.79.227.36:4518 , piece_id=X6IT5WDM5GGJEUTBYRCU7JJT6E6SDR43J7MY25KWSHMENNBDZJOA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.118777725 (578h26m42.002731938s) [noise=true , address=77.90.31.16:4736 , piece_id=I3YMRQLJRC6AGZCS3X24NPS4ZMY6V2RUGMSYVQKA6CQCDP74Y6YA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.119400779 (578h26m42.003354998s) [noise=true , address=77.90.31.11:4556 , piece_id=BBBH26EPDCSQIHDGRXAK5R6B5P7LS2KINZJ4PX23X5ND4A4MEHIQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.119963979 (578h26m42.003918195s) [noise=true , address=45.91.116.7:4012 , piece_id=TQWEGKVB4YKOQQ5JUPDOUB3NJKXT7SJ3MN2HULE3KSDA6EEKG5KQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.120514589 (578h26m42.004468803s) [noise=true , address=45.91.116.9:4262 , piece_id=W4IKJMAXYTG3GMYNSRTWHHJFODGL6O23I74EIBWPHZN2EIYSUGZA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.121035040 (578h26m42.004989257s) [noise=true , address=77.90.31.19:4844 , piece_id=YQ4QWJRT22Y7FZ2PSZSYADSBYCIG2RW2J6AGVPJBUWF7RWAQRXGA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.121549635 (578h26m42.00550385s) [noise=true , address=79.127.219.38:4820 , piece_id=DDBMTKBRXR7DCD5YNOWWD4NANY6H2MAARBME5JRMGDC5O55ZTFPA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.122136143 (578h26m42.006090357s) [noise=true , address=45.91.116.12:4228 , piece_id=J5PHXEAUTYO3L2SCOWJV5DG4HSSCCRDXSU4FRQZPZGUAQNYCUCSA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.122700058 (578h26m42.006654279s) [noise=true , address=77.90.31.10:4520 , piece_id=GVEUY3LEGLLZOHGUHZJ342W77346FB5OIJGHYWL6RFWAPN6NJBEQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.123269841 (578h26m42.007224055s) [noise=true , address=79.127.219.38:4818 , piece_id=HBQ65EPXPLTY3RRBDJKOJWJOOEAHV2CDQPKSXJG2JJ4WVWIBGEBA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.123822811 (578h26m42.007777028s) [noise=true , address=77.90.31.13:4629 , piece_id=HOYQBJTPUN3ZJT24DYY4KPKNP3WC3PY7L5CUSGNMJZH3LZPVYMQQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.125362061 (578h26m42.009316274s) [noise=true , address=79.127.219.46:4894 , piece_id=Y4X54TAT6YVVCN7CBMZBBMTQJHMLPUB2CFOBPP3SEPDAXOE4MIFA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.126626714 (578h26m42.010580926s) [noise=true , address=45.91.116.11:4152 , piece_id=E2JT4VPQLPITKBG7VX3DGLHW3C75DKSXRFSDP4FTSMWJTCE2WNYQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.128551993 (578h26m42.012506207s) [noise=true , address=77.90.31.15:4697 , piece_id=BSVS5EKTGONBHXQSSCIIEWSKKHJCZPU57I6HA6JOLVDCK2THAPEA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.749709963 (578h26m42.633664174s) [upload=509178]: Next returned nil segment Feb 8 18:22:04.749726686 (578h26m42.633680894s) [upload=509178]: Waiting for error group managing segments... Feb 8 18:22:04.892514286 (578h26m42.776468499s) [noise=true , address=45.91.116.12:4228 , piece_id=J5PHXEAUTYO3L2SCOWJV5DG4HSSCCRDXSU4FRQZPZGUAQNYCUCSA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.892834641 (578h26m42.776788835s) [noise=true , address=45.91.116.9:4262 , piece_id=W4IKJMAXYTG3GMYNSRTWHHJFODGL6O23I74EIBWPHZN2EIYSUGZA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.895637894 (578h26m42.7795921s) [noise=true , address=45.91.116.11:4152 , piece_id=E2JT4VPQLPITKBG7VX3DGLHW3C75DKSXRFSDP4FTSMWJTCE2WNYQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.911053197 (578h26m42.795007406s) [noise=true , address=45.91.116.12:4244 , piece_id=677ZBCVMYCFHEHZXDZLMDNH7CAEH54SYWJTE5AVWFNFH4WGW3TVQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.913091544 (578h26m42.797045758s) [noise=true , address=45.91.116.7:4012 , piece_id=TQWEGKVB4YKOQQ5JUPDOUB3NJKXT7SJ3MN2HULE3KSDA6EEKG5KQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:08.025526151 (578h26m45.909480356s) [noise=true , address=79.127.219.38:4818 , piece_id=HBQ65EPXPLTY3RRBDJKOJWJOOEAHV2CDQPKSXJG2JJ4WVWIBGEBA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:10.693673801 (578h26m48.577628002s) [noise=true , address=145.79.227.36:4518 , piece_id=X6IT5WDM5GGJEUTBYRCU7JJT6E6SDR43J7MY25KWSHMENNBDZJOA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:12.731005984 (578h26m50.614960184s) [noise=true , address=79.127.219.46:4894 , piece_id=Y4X54TAT6YVVCN7CBMZBBMTQJHMLPUB2CFOBPP3SEPDAXOE4MIFA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:33.605468726 (578h27m11.489422938s) [noise=true , address=77.90.31.19:4844 , piece_id=YQ4QWJRT22Y7FZ2PSZSYADSBYCIG2RW2J6AGVPJBUWF7RWAQRXGA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: rpc: dial tcp 77.90.31.19:4844: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.605738489 (578h27m11.489692708s) [noise=true , address=77.90.31.10:4520 , piece_id=GVEUY3LEGLLZOHGUHZJ342W77346FB5OIJGHYWL6RFWAPN6NJBEQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: read tcp 139.59.144.22:58478->77.90.31.10:4520: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.605844639 (578h27m11.489798909s) [noise=true , address=77.90.31.13:4629 , piece_id=HOYQBJTPUN3ZJT24DYY4KPKNP3WC3PY7L5CUSGNMJZH3LZPVYMQQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:60068->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606136012 (578h27m11.490090201s) [noise=true , address=79.127.219.38:4820 , piece_id=DDBMTKBRXR7DCD5YNOWWD4NANY6H2MAARBME5JRMGDC5O55ZTFPA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection; write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection Feb 8 18:22:33.606166109 (578h27m11.490120322s) [noise=true , address=77.90.31.21:4880 , piece_id=USK3WG27XI5BWWHW4KD6PKF5QZFF2WC55LLDQ6DYICTR7RL4FEQA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb, address:77.90.31.21:4880): protocol: read tcp 139.59.144.22:60158->77.90.31.21:4880: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606403948 (578h27m11.490358158s) [noise=true , address=77.90.31.16:4736 , piece_id=I3YMRQLJRC6AGZCS3X24NPS4ZMY6V2RUGMSYVQKA6CQCDP74Y6YA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: read tcp 139.59.144.22:41548->77.90.31.16:4736: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606474964 (578h27m11.490429174s) [noise=true , address=77.90.31.11:4556 , piece_id=BBBH26EPDCSQIHDGRXAK5R6B5P7LS2KINZJ4PX23X5ND4A4MEHIQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1QNr5B8kdrSa59rHAb82TcvSYpru7m7zbdxXqqxw3FpcFyfpks, address:77.90.31.11:4556): protocol: read tcp 139.59.144.22:43432->77.90.31.11:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606659904 (578h27m11.490614092s) [noise=true , address=77.90.31.15:4697 , piece_id=BSVS5EKTGONBHXQSSCIIEWSKKHJCZPU57I6HA6JOLVDCK2THAPEA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:49004->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606692396 (578h27m11.490646597s) [seg_pos={0 0}, upload=509178]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 8 18:22:33.717090428 (578h27m11.601044639s) [upload=509178]: Done uploading segments... Feb 8 18:22:33.717136942 (578h27m11.601091151s) [upload=509178]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.339925149s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.836839724s trace: https://jaeger.dev.storj.io/trace/4dcbf2bdf7405449 FAIL (2026-02-08 18:56:44 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.83694455s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [............X...............................................] duration: 1.695938547s trace: https://jaeger.dev.storj.io/trace/42fce211b8a1e546 FAIL (2026-02-08 18:56:16 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.695963498s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.723813312s trace: https://jaeger.dev.storj.io/trace/4dcbf2bdf7405449 FAIL (2026-02-08 18:55:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.723834686s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.............X..............................................] duration: 1.582205753s trace: https://jaeger.dev.storj.io/trace/42fce211b8a1e546 FAIL (2026-02-08 18:55:54 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.582232185s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............XX.............................................] duration: 2.294621135s trace: https://jaeger.dev.storj.io/trace/6d7de065855c854f FAIL (2026-02-08 18:55:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== oad=509178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 18:22:03.960927132 (578h26m41.84488134s) [upload=509178]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 18:22:04.110748788 (578h26m41.994702997s) [seg_pos={0 0}, upload=509178]: Begin upload segment... Feb 8 18:22:04.110820336 (578h26m41.994774543s) [seg_pos={0 0}, upload=509178]: Done begin upload segment. Feb 8 18:22:04.110856501 (578h26m41.994810703s) [noise=true , address=77.90.31.21:4880 , piece_id=USK3WG27XI5BWWHW4KD6PKF5QZFF2WC55LLDQ6DYICTR7RL4FEQA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.115693397 (578h26m41.999647587s) [noise=true , address=45.91.116.12:4244 , piece_id=677ZBCVMYCFHEHZXDZLMDNH7CAEH54SYWJTE5AVWFNFH4WGW3TVQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.116499874 (578h26m42.000454086s) [noise=true , address=145.79.227.36:4518 , piece_id=X6IT5WDM5GGJEUTBYRCU7JJT6E6SDR43J7MY25KWSHMENNBDZJOA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.118777725 (578h26m42.002731938s) [noise=true , address=77.90.31.16:4736 , piece_id=I3YMRQLJRC6AGZCS3X24NPS4ZMY6V2RUGMSYVQKA6CQCDP74Y6YA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.119400779 (578h26m42.003354998s) [noise=true , address=77.90.31.11:4556 , piece_id=BBBH26EPDCSQIHDGRXAK5R6B5P7LS2KINZJ4PX23X5ND4A4MEHIQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.119963979 (578h26m42.003918195s) [noise=true , address=45.91.116.7:4012 , piece_id=TQWEGKVB4YKOQQ5JUPDOUB3NJKXT7SJ3MN2HULE3KSDA6EEKG5KQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.120514589 (578h26m42.004468803s) [noise=true , address=45.91.116.9:4262 , piece_id=W4IKJMAXYTG3GMYNSRTWHHJFODGL6O23I74EIBWPHZN2EIYSUGZA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.121035040 (578h26m42.004989257s) [noise=true , address=77.90.31.19:4844 , piece_id=YQ4QWJRT22Y7FZ2PSZSYADSBYCIG2RW2J6AGVPJBUWF7RWAQRXGA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.121549635 (578h26m42.00550385s) [noise=true , address=79.127.219.38:4820 , piece_id=DDBMTKBRXR7DCD5YNOWWD4NANY6H2MAARBME5JRMGDC5O55ZTFPA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.122136143 (578h26m42.006090357s) [noise=true , address=45.91.116.12:4228 , piece_id=J5PHXEAUTYO3L2SCOWJV5DG4HSSCCRDXSU4FRQZPZGUAQNYCUCSA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.122700058 (578h26m42.006654279s) [noise=true , address=77.90.31.10:4520 , piece_id=GVEUY3LEGLLZOHGUHZJ342W77346FB5OIJGHYWL6RFWAPN6NJBEQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.123269841 (578h26m42.007224055s) [noise=true , address=79.127.219.38:4818 , piece_id=HBQ65EPXPLTY3RRBDJKOJWJOOEAHV2CDQPKSXJG2JJ4WVWIBGEBA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.123822811 (578h26m42.007777028s) [noise=true , address=77.90.31.13:4629 , piece_id=HOYQBJTPUN3ZJT24DYY4KPKNP3WC3PY7L5CUSGNMJZH3LZPVYMQQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.125362061 (578h26m42.009316274s) [noise=true , address=79.127.219.46:4894 , piece_id=Y4X54TAT6YVVCN7CBMZBBMTQJHMLPUB2CFOBPP3SEPDAXOE4MIFA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.126626714 (578h26m42.010580926s) [noise=true , address=45.91.116.11:4152 , piece_id=E2JT4VPQLPITKBG7VX3DGLHW3C75DKSXRFSDP4FTSMWJTCE2WNYQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.128551993 (578h26m42.012506207s) [noise=true , address=77.90.31.15:4697 , piece_id=BSVS5EKTGONBHXQSSCIIEWSKKHJCZPU57I6HA6JOLVDCK2THAPEA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.749709963 (578h26m42.633664174s) [upload=509178]: Next returned nil segment Feb 8 18:22:04.749726686 (578h26m42.633680894s) [upload=509178]: Waiting for error group managing segments... Feb 8 18:22:04.892514286 (578h26m42.776468499s) [noise=true , address=45.91.116.12:4228 , piece_id=J5PHXEAUTYO3L2SCOWJV5DG4HSSCCRDXSU4FRQZPZGUAQNYCUCSA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.892834641 (578h26m42.776788835s) [noise=true , address=45.91.116.9:4262 , piece_id=W4IKJMAXYTG3GMYNSRTWHHJFODGL6O23I74EIBWPHZN2EIYSUGZA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.895637894 (578h26m42.7795921s) [noise=true , address=45.91.116.11:4152 , piece_id=E2JT4VPQLPITKBG7VX3DGLHW3C75DKSXRFSDP4FTSMWJTCE2WNYQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.911053197 (578h26m42.795007406s) [noise=true , address=45.91.116.12:4244 , piece_id=677ZBCVMYCFHEHZXDZLMDNH7CAEH54SYWJTE5AVWFNFH4WGW3TVQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.913091544 (578h26m42.797045758s) [noise=true , address=45.91.116.7:4012 , piece_id=TQWEGKVB4YKOQQ5JUPDOUB3NJKXT7SJ3MN2HULE3KSDA6EEKG5KQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:08.025526151 (578h26m45.909480356s) [noise=true , address=79.127.219.38:4818 , piece_id=HBQ65EPXPLTY3RRBDJKOJWJOOEAHV2CDQPKSXJG2JJ4WVWIBGEBA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:10.693673801 (578h26m48.577628002s) [noise=true , address=145.79.227.36:4518 , piece_id=X6IT5WDM5GGJEUTBYRCU7JJT6E6SDR43J7MY25KWSHMENNBDZJOA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:12.731005984 (578h26m50.614960184s) [noise=true , address=79.127.219.46:4894 , piece_id=Y4X54TAT6YVVCN7CBMZBBMTQJHMLPUB2CFOBPP3SEPDAXOE4MIFA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:33.605468726 (578h27m11.489422938s) [noise=true , address=77.90.31.19:4844 , piece_id=YQ4QWJRT22Y7FZ2PSZSYADSBYCIG2RW2J6AGVPJBUWF7RWAQRXGA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: rpc: dial tcp 77.90.31.19:4844: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.605738489 (578h27m11.489692708s) [noise=true , address=77.90.31.10:4520 , piece_id=GVEUY3LEGLLZOHGUHZJ342W77346FB5OIJGHYWL6RFWAPN6NJBEQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: read tcp 139.59.144.22:58478->77.90.31.10:4520: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.605844639 (578h27m11.489798909s) [noise=true , address=77.90.31.13:4629 , piece_id=HOYQBJTPUN3ZJT24DYY4KPKNP3WC3PY7L5CUSGNMJZH3LZPVYMQQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:60068->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606136012 (578h27m11.490090201s) [noise=true , address=79.127.219.38:4820 , piece_id=DDBMTKBRXR7DCD5YNOWWD4NANY6H2MAARBME5JRMGDC5O55ZTFPA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection; write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection Feb 8 18:22:33.606166109 (578h27m11.490120322s) [noise=true , address=77.90.31.21:4880 , piece_id=USK3WG27XI5BWWHW4KD6PKF5QZFF2WC55LLDQ6DYICTR7RL4FEQA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb, address:77.90.31.21:4880): protocol: read tcp 139.59.144.22:60158->77.90.31.21:4880: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606403948 (578h27m11.490358158s) [noise=true , address=77.90.31.16:4736 , piece_id=I3YMRQLJRC6AGZCS3X24NPS4ZMY6V2RUGMSYVQKA6CQCDP74Y6YA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: read tcp 139.59.144.22:41548->77.90.31.16:4736: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606474964 (578h27m11.490429174s) [noise=true , address=77.90.31.11:4556 , piece_id=BBBH26EPDCSQIHDGRXAK5R6B5P7LS2KINZJ4PX23X5ND4A4MEHIQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1QNr5B8kdrSa59rHAb82TcvSYpru7m7zbdxXqqxw3FpcFyfpks, address:77.90.31.11:4556): protocol: read tcp 139.59.144.22:43432->77.90.31.11:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606659904 (578h27m11.490614092s) [noise=true , address=77.90.31.15:4697 , piece_id=BSVS5EKTGONBHXQSSCIIEWSKKHJCZPU57I6HA6JOLVDCK2THAPEA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:49004->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606692396 (578h27m11.490646597s) [seg_pos={0 0}, upload=509178]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 8 18:22:33.717090428 (578h27m11.601044639s) [upload=509178]: Done uploading segments... Feb 8 18:22:33.717136942 (578h27m11.601091151s) [upload=509178]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.294650703s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..............X.............................................] duration: 1.651324333s trace: https://jaeger.dev.storj.io/trace/42fce211b8a1e546 FAIL (2026-02-08 18:55:10 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.651347876s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............XX............................................] duration: 2.377443244s trace: https://jaeger.dev.storj.io/trace/6d7de065855c854f FAIL (2026-02-08 18:54:43 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== oad=509178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 18:22:03.960927132 (578h26m41.84488134s) [upload=509178]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 18:22:04.110748788 (578h26m41.994702997s) [seg_pos={0 0}, upload=509178]: Begin upload segment... Feb 8 18:22:04.110820336 (578h26m41.994774543s) [seg_pos={0 0}, upload=509178]: Done begin upload segment. Feb 8 18:22:04.110856501 (578h26m41.994810703s) [noise=true , address=77.90.31.21:4880 , piece_id=USK3WG27XI5BWWHW4KD6PKF5QZFF2WC55LLDQ6DYICTR7RL4FEQA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.115693397 (578h26m41.999647587s) [noise=true , address=45.91.116.12:4244 , piece_id=677ZBCVMYCFHEHZXDZLMDNH7CAEH54SYWJTE5AVWFNFH4WGW3TVQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.116499874 (578h26m42.000454086s) [noise=true , address=145.79.227.36:4518 , piece_id=X6IT5WDM5GGJEUTBYRCU7JJT6E6SDR43J7MY25KWSHMENNBDZJOA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.118777725 (578h26m42.002731938s) [noise=true , address=77.90.31.16:4736 , piece_id=I3YMRQLJRC6AGZCS3X24NPS4ZMY6V2RUGMSYVQKA6CQCDP74Y6YA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.119400779 (578h26m42.003354998s) [noise=true , address=77.90.31.11:4556 , piece_id=BBBH26EPDCSQIHDGRXAK5R6B5P7LS2KINZJ4PX23X5ND4A4MEHIQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.119963979 (578h26m42.003918195s) [noise=true , address=45.91.116.7:4012 , piece_id=TQWEGKVB4YKOQQ5JUPDOUB3NJKXT7SJ3MN2HULE3KSDA6EEKG5KQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.120514589 (578h26m42.004468803s) [noise=true , address=45.91.116.9:4262 , piece_id=W4IKJMAXYTG3GMYNSRTWHHJFODGL6O23I74EIBWPHZN2EIYSUGZA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.121035040 (578h26m42.004989257s) [noise=true , address=77.90.31.19:4844 , piece_id=YQ4QWJRT22Y7FZ2PSZSYADSBYCIG2RW2J6AGVPJBUWF7RWAQRXGA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.121549635 (578h26m42.00550385s) [noise=true , address=79.127.219.38:4820 , piece_id=DDBMTKBRXR7DCD5YNOWWD4NANY6H2MAARBME5JRMGDC5O55ZTFPA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.122136143 (578h26m42.006090357s) [noise=true , address=45.91.116.12:4228 , piece_id=J5PHXEAUTYO3L2SCOWJV5DG4HSSCCRDXSU4FRQZPZGUAQNYCUCSA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.122700058 (578h26m42.006654279s) [noise=true , address=77.90.31.10:4520 , piece_id=GVEUY3LEGLLZOHGUHZJ342W77346FB5OIJGHYWL6RFWAPN6NJBEQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.123269841 (578h26m42.007224055s) [noise=true , address=79.127.219.38:4818 , piece_id=HBQ65EPXPLTY3RRBDJKOJWJOOEAHV2CDQPKSXJG2JJ4WVWIBGEBA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.123822811 (578h26m42.007777028s) [noise=true , address=77.90.31.13:4629 , piece_id=HOYQBJTPUN3ZJT24DYY4KPKNP3WC3PY7L5CUSGNMJZH3LZPVYMQQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.125362061 (578h26m42.009316274s) [noise=true , address=79.127.219.46:4894 , piece_id=Y4X54TAT6YVVCN7CBMZBBMTQJHMLPUB2CFOBPP3SEPDAXOE4MIFA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.126626714 (578h26m42.010580926s) [noise=true , address=45.91.116.11:4152 , piece_id=E2JT4VPQLPITKBG7VX3DGLHW3C75DKSXRFSDP4FTSMWJTCE2WNYQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.128551993 (578h26m42.012506207s) [noise=true , address=77.90.31.15:4697 , piece_id=BSVS5EKTGONBHXQSSCIIEWSKKHJCZPU57I6HA6JOLVDCK2THAPEA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.749709963 (578h26m42.633664174s) [upload=509178]: Next returned nil segment Feb 8 18:22:04.749726686 (578h26m42.633680894s) [upload=509178]: Waiting for error group managing segments... Feb 8 18:22:04.892514286 (578h26m42.776468499s) [noise=true , address=45.91.116.12:4228 , piece_id=J5PHXEAUTYO3L2SCOWJV5DG4HSSCCRDXSU4FRQZPZGUAQNYCUCSA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.892834641 (578h26m42.776788835s) [noise=true , address=45.91.116.9:4262 , piece_id=W4IKJMAXYTG3GMYNSRTWHHJFODGL6O23I74EIBWPHZN2EIYSUGZA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.895637894 (578h26m42.7795921s) [noise=true , address=45.91.116.11:4152 , piece_id=E2JT4VPQLPITKBG7VX3DGLHW3C75DKSXRFSDP4FTSMWJTCE2WNYQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.911053197 (578h26m42.795007406s) [noise=true , address=45.91.116.12:4244 , piece_id=677ZBCVMYCFHEHZXDZLMDNH7CAEH54SYWJTE5AVWFNFH4WGW3TVQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.913091544 (578h26m42.797045758s) [noise=true , address=45.91.116.7:4012 , piece_id=TQWEGKVB4YKOQQ5JUPDOUB3NJKXT7SJ3MN2HULE3KSDA6EEKG5KQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:08.025526151 (578h26m45.909480356s) [noise=true , address=79.127.219.38:4818 , piece_id=HBQ65EPXPLTY3RRBDJKOJWJOOEAHV2CDQPKSXJG2JJ4WVWIBGEBA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:10.693673801 (578h26m48.577628002s) [noise=true , address=145.79.227.36:4518 , piece_id=X6IT5WDM5GGJEUTBYRCU7JJT6E6SDR43J7MY25KWSHMENNBDZJOA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:12.731005984 (578h26m50.614960184s) [noise=true , address=79.127.219.46:4894 , piece_id=Y4X54TAT6YVVCN7CBMZBBMTQJHMLPUB2CFOBPP3SEPDAXOE4MIFA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:33.605468726 (578h27m11.489422938s) [noise=true , address=77.90.31.19:4844 , piece_id=YQ4QWJRT22Y7FZ2PSZSYADSBYCIG2RW2J6AGVPJBUWF7RWAQRXGA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: rpc: dial tcp 77.90.31.19:4844: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.605738489 (578h27m11.489692708s) [noise=true , address=77.90.31.10:4520 , piece_id=GVEUY3LEGLLZOHGUHZJ342W77346FB5OIJGHYWL6RFWAPN6NJBEQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: read tcp 139.59.144.22:58478->77.90.31.10:4520: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.605844639 (578h27m11.489798909s) [noise=true , address=77.90.31.13:4629 , piece_id=HOYQBJTPUN3ZJT24DYY4KPKNP3WC3PY7L5CUSGNMJZH3LZPVYMQQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:60068->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606136012 (578h27m11.490090201s) [noise=true , address=79.127.219.38:4820 , piece_id=DDBMTKBRXR7DCD5YNOWWD4NANY6H2MAARBME5JRMGDC5O55ZTFPA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection; write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection Feb 8 18:22:33.606166109 (578h27m11.490120322s) [noise=true , address=77.90.31.21:4880 , piece_id=USK3WG27XI5BWWHW4KD6PKF5QZFF2WC55LLDQ6DYICTR7RL4FEQA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb, address:77.90.31.21:4880): protocol: read tcp 139.59.144.22:60158->77.90.31.21:4880: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606403948 (578h27m11.490358158s) [noise=true , address=77.90.31.16:4736 , piece_id=I3YMRQLJRC6AGZCS3X24NPS4ZMY6V2RUGMSYVQKA6CQCDP74Y6YA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: read tcp 139.59.144.22:41548->77.90.31.16:4736: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606474964 (578h27m11.490429174s) [noise=true , address=77.90.31.11:4556 , piece_id=BBBH26EPDCSQIHDGRXAK5R6B5P7LS2KINZJ4PX23X5ND4A4MEHIQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1QNr5B8kdrSa59rHAb82TcvSYpru7m7zbdxXqqxw3FpcFyfpks, address:77.90.31.11:4556): protocol: read tcp 139.59.144.22:43432->77.90.31.11:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606659904 (578h27m11.490614092s) [noise=true , address=77.90.31.15:4697 , piece_id=BSVS5EKTGONBHXQSSCIIEWSKKHJCZPU57I6HA6JOLVDCK2THAPEA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:49004->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606692396 (578h27m11.490646597s) [seg_pos={0 0}, upload=509178]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 8 18:22:33.717090428 (578h27m11.601044639s) [upload=509178]: Done uploading segments... Feb 8 18:22:33.717136942 (578h27m11.601091151s) [upload=509178]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.377471323s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 2.860805014s trace: https://jaeger.dev.storj.io/trace/4dcbf2bdf7405449 FAIL (2026-02-08 18:54:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.860930246s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...............X............................................] duration: 1.638758731s trace: https://jaeger.dev.storj.io/trace/42fce211b8a1e546 FAIL (2026-02-08 18:54:42 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.63877388s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............XX...........................................] duration: 2.379156272s trace: https://jaeger.dev.storj.io/trace/6d7de065855c854f FAIL (2026-02-08 18:54:21 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== oad=509178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 18:22:03.960927132 (578h26m41.84488134s) [upload=509178]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 18:22:04.110748788 (578h26m41.994702997s) [seg_pos={0 0}, upload=509178]: Begin upload segment... Feb 8 18:22:04.110820336 (578h26m41.994774543s) [seg_pos={0 0}, upload=509178]: Done begin upload segment. Feb 8 18:22:04.110856501 (578h26m41.994810703s) [noise=true , address=77.90.31.21:4880 , piece_id=USK3WG27XI5BWWHW4KD6PKF5QZFF2WC55LLDQ6DYICTR7RL4FEQA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.115693397 (578h26m41.999647587s) [noise=true , address=45.91.116.12:4244 , piece_id=677ZBCVMYCFHEHZXDZLMDNH7CAEH54SYWJTE5AVWFNFH4WGW3TVQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.116499874 (578h26m42.000454086s) [noise=true , address=145.79.227.36:4518 , piece_id=X6IT5WDM5GGJEUTBYRCU7JJT6E6SDR43J7MY25KWSHMENNBDZJOA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.118777725 (578h26m42.002731938s) [noise=true , address=77.90.31.16:4736 , piece_id=I3YMRQLJRC6AGZCS3X24NPS4ZMY6V2RUGMSYVQKA6CQCDP74Y6YA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.119400779 (578h26m42.003354998s) [noise=true , address=77.90.31.11:4556 , piece_id=BBBH26EPDCSQIHDGRXAK5R6B5P7LS2KINZJ4PX23X5ND4A4MEHIQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.119963979 (578h26m42.003918195s) [noise=true , address=45.91.116.7:4012 , piece_id=TQWEGKVB4YKOQQ5JUPDOUB3NJKXT7SJ3MN2HULE3KSDA6EEKG5KQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.120514589 (578h26m42.004468803s) [noise=true , address=45.91.116.9:4262 , piece_id=W4IKJMAXYTG3GMYNSRTWHHJFODGL6O23I74EIBWPHZN2EIYSUGZA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.121035040 (578h26m42.004989257s) [noise=true , address=77.90.31.19:4844 , piece_id=YQ4QWJRT22Y7FZ2PSZSYADSBYCIG2RW2J6AGVPJBUWF7RWAQRXGA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.121549635 (578h26m42.00550385s) [noise=true , address=79.127.219.38:4820 , piece_id=DDBMTKBRXR7DCD5YNOWWD4NANY6H2MAARBME5JRMGDC5O55ZTFPA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.122136143 (578h26m42.006090357s) [noise=true , address=45.91.116.12:4228 , piece_id=J5PHXEAUTYO3L2SCOWJV5DG4HSSCCRDXSU4FRQZPZGUAQNYCUCSA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.122700058 (578h26m42.006654279s) [noise=true , address=77.90.31.10:4520 , piece_id=GVEUY3LEGLLZOHGUHZJ342W77346FB5OIJGHYWL6RFWAPN6NJBEQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.123269841 (578h26m42.007224055s) [noise=true , address=79.127.219.38:4818 , piece_id=HBQ65EPXPLTY3RRBDJKOJWJOOEAHV2CDQPKSXJG2JJ4WVWIBGEBA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.123822811 (578h26m42.007777028s) [noise=true , address=77.90.31.13:4629 , piece_id=HOYQBJTPUN3ZJT24DYY4KPKNP3WC3PY7L5CUSGNMJZH3LZPVYMQQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.125362061 (578h26m42.009316274s) [noise=true , address=79.127.219.46:4894 , piece_id=Y4X54TAT6YVVCN7CBMZBBMTQJHMLPUB2CFOBPP3SEPDAXOE4MIFA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.126626714 (578h26m42.010580926s) [noise=true , address=45.91.116.11:4152 , piece_id=E2JT4VPQLPITKBG7VX3DGLHW3C75DKSXRFSDP4FTSMWJTCE2WNYQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.128551993 (578h26m42.012506207s) [noise=true , address=77.90.31.15:4697 , piece_id=BSVS5EKTGONBHXQSSCIIEWSKKHJCZPU57I6HA6JOLVDCK2THAPEA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.749709963 (578h26m42.633664174s) [upload=509178]: Next returned nil segment Feb 8 18:22:04.749726686 (578h26m42.633680894s) [upload=509178]: Waiting for error group managing segments... Feb 8 18:22:04.892514286 (578h26m42.776468499s) [noise=true , address=45.91.116.12:4228 , piece_id=J5PHXEAUTYO3L2SCOWJV5DG4HSSCCRDXSU4FRQZPZGUAQNYCUCSA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.892834641 (578h26m42.776788835s) [noise=true , address=45.91.116.9:4262 , piece_id=W4IKJMAXYTG3GMYNSRTWHHJFODGL6O23I74EIBWPHZN2EIYSUGZA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.895637894 (578h26m42.7795921s) [noise=true , address=45.91.116.11:4152 , piece_id=E2JT4VPQLPITKBG7VX3DGLHW3C75DKSXRFSDP4FTSMWJTCE2WNYQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.911053197 (578h26m42.795007406s) [noise=true , address=45.91.116.12:4244 , piece_id=677ZBCVMYCFHEHZXDZLMDNH7CAEH54SYWJTE5AVWFNFH4WGW3TVQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.913091544 (578h26m42.797045758s) [noise=true , address=45.91.116.7:4012 , piece_id=TQWEGKVB4YKOQQ5JUPDOUB3NJKXT7SJ3MN2HULE3KSDA6EEKG5KQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:08.025526151 (578h26m45.909480356s) [noise=true , address=79.127.219.38:4818 , piece_id=HBQ65EPXPLTY3RRBDJKOJWJOOEAHV2CDQPKSXJG2JJ4WVWIBGEBA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:10.693673801 (578h26m48.577628002s) [noise=true , address=145.79.227.36:4518 , piece_id=X6IT5WDM5GGJEUTBYRCU7JJT6E6SDR43J7MY25KWSHMENNBDZJOA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:12.731005984 (578h26m50.614960184s) [noise=true , address=79.127.219.46:4894 , piece_id=Y4X54TAT6YVVCN7CBMZBBMTQJHMLPUB2CFOBPP3SEPDAXOE4MIFA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:33.605468726 (578h27m11.489422938s) [noise=true , address=77.90.31.19:4844 , piece_id=YQ4QWJRT22Y7FZ2PSZSYADSBYCIG2RW2J6AGVPJBUWF7RWAQRXGA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: rpc: dial tcp 77.90.31.19:4844: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.605738489 (578h27m11.489692708s) [noise=true , address=77.90.31.10:4520 , piece_id=GVEUY3LEGLLZOHGUHZJ342W77346FB5OIJGHYWL6RFWAPN6NJBEQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: read tcp 139.59.144.22:58478->77.90.31.10:4520: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.605844639 (578h27m11.489798909s) [noise=true , address=77.90.31.13:4629 , piece_id=HOYQBJTPUN3ZJT24DYY4KPKNP3WC3PY7L5CUSGNMJZH3LZPVYMQQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:60068->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606136012 (578h27m11.490090201s) [noise=true , address=79.127.219.38:4820 , piece_id=DDBMTKBRXR7DCD5YNOWWD4NANY6H2MAARBME5JRMGDC5O55ZTFPA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection; write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection Feb 8 18:22:33.606166109 (578h27m11.490120322s) [noise=true , address=77.90.31.21:4880 , piece_id=USK3WG27XI5BWWHW4KD6PKF5QZFF2WC55LLDQ6DYICTR7RL4FEQA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb, address:77.90.31.21:4880): protocol: read tcp 139.59.144.22:60158->77.90.31.21:4880: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606403948 (578h27m11.490358158s) [noise=true , address=77.90.31.16:4736 , piece_id=I3YMRQLJRC6AGZCS3X24NPS4ZMY6V2RUGMSYVQKA6CQCDP74Y6YA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: read tcp 139.59.144.22:41548->77.90.31.16:4736: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606474964 (578h27m11.490429174s) [noise=true , address=77.90.31.11:4556 , piece_id=BBBH26EPDCSQIHDGRXAK5R6B5P7LS2KINZJ4PX23X5ND4A4MEHIQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1QNr5B8kdrSa59rHAb82TcvSYpru7m7zbdxXqqxw3FpcFyfpks, address:77.90.31.11:4556): protocol: read tcp 139.59.144.22:43432->77.90.31.11:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606659904 (578h27m11.490614092s) [noise=true , address=77.90.31.15:4697 , piece_id=BSVS5EKTGONBHXQSSCIIEWSKKHJCZPU57I6HA6JOLVDCK2THAPEA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:49004->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606692396 (578h27m11.490646597s) [seg_pos={0 0}, upload=509178]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 8 18:22:33.717090428 (578h27m11.601044639s) [upload=509178]: Done uploading segments... Feb 8 18:22:33.717136942 (578h27m11.601091151s) [upload=509178]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.37918042s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [................X...........................................] duration: 1.653972323s trace: https://jaeger.dev.storj.io/trace/42fce211b8a1e546 FAIL (2026-02-08 18:53:52 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.654001314s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 2.623839795s trace: https://jaeger.dev.storj.io/trace/4dcbf2bdf7405449 FAIL (2026-02-08 18:53:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.623868665s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [................XX..........................................] duration: 2.33749183s trace: https://jaeger.dev.storj.io/trace/6d7de065855c854f FAIL (2026-02-08 18:53:08 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== oad=509178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 18:22:03.960927132 (578h26m41.84488134s) [upload=509178]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 18:22:04.110748788 (578h26m41.994702997s) [seg_pos={0 0}, upload=509178]: Begin upload segment... Feb 8 18:22:04.110820336 (578h26m41.994774543s) [seg_pos={0 0}, upload=509178]: Done begin upload segment. Feb 8 18:22:04.110856501 (578h26m41.994810703s) [noise=true , address=77.90.31.21:4880 , piece_id=USK3WG27XI5BWWHW4KD6PKF5QZFF2WC55LLDQ6DYICTR7RL4FEQA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.115693397 (578h26m41.999647587s) [noise=true , address=45.91.116.12:4244 , piece_id=677ZBCVMYCFHEHZXDZLMDNH7CAEH54SYWJTE5AVWFNFH4WGW3TVQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.116499874 (578h26m42.000454086s) [noise=true , address=145.79.227.36:4518 , piece_id=X6IT5WDM5GGJEUTBYRCU7JJT6E6SDR43J7MY25KWSHMENNBDZJOA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.118777725 (578h26m42.002731938s) [noise=true , address=77.90.31.16:4736 , piece_id=I3YMRQLJRC6AGZCS3X24NPS4ZMY6V2RUGMSYVQKA6CQCDP74Y6YA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.119400779 (578h26m42.003354998s) [noise=true , address=77.90.31.11:4556 , piece_id=BBBH26EPDCSQIHDGRXAK5R6B5P7LS2KINZJ4PX23X5ND4A4MEHIQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.119963979 (578h26m42.003918195s) [noise=true , address=45.91.116.7:4012 , piece_id=TQWEGKVB4YKOQQ5JUPDOUB3NJKXT7SJ3MN2HULE3KSDA6EEKG5KQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.120514589 (578h26m42.004468803s) [noise=true , address=45.91.116.9:4262 , piece_id=W4IKJMAXYTG3GMYNSRTWHHJFODGL6O23I74EIBWPHZN2EIYSUGZA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.121035040 (578h26m42.004989257s) [noise=true , address=77.90.31.19:4844 , piece_id=YQ4QWJRT22Y7FZ2PSZSYADSBYCIG2RW2J6AGVPJBUWF7RWAQRXGA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.121549635 (578h26m42.00550385s) [noise=true , address=79.127.219.38:4820 , piece_id=DDBMTKBRXR7DCD5YNOWWD4NANY6H2MAARBME5JRMGDC5O55ZTFPA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.122136143 (578h26m42.006090357s) [noise=true , address=45.91.116.12:4228 , piece_id=J5PHXEAUTYO3L2SCOWJV5DG4HSSCCRDXSU4FRQZPZGUAQNYCUCSA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.122700058 (578h26m42.006654279s) [noise=true , address=77.90.31.10:4520 , piece_id=GVEUY3LEGLLZOHGUHZJ342W77346FB5OIJGHYWL6RFWAPN6NJBEQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.123269841 (578h26m42.007224055s) [noise=true , address=79.127.219.38:4818 , piece_id=HBQ65EPXPLTY3RRBDJKOJWJOOEAHV2CDQPKSXJG2JJ4WVWIBGEBA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.123822811 (578h26m42.007777028s) [noise=true , address=77.90.31.13:4629 , piece_id=HOYQBJTPUN3ZJT24DYY4KPKNP3WC3PY7L5CUSGNMJZH3LZPVYMQQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.125362061 (578h26m42.009316274s) [noise=true , address=79.127.219.46:4894 , piece_id=Y4X54TAT6YVVCN7CBMZBBMTQJHMLPUB2CFOBPP3SEPDAXOE4MIFA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.126626714 (578h26m42.010580926s) [noise=true , address=45.91.116.11:4152 , piece_id=E2JT4VPQLPITKBG7VX3DGLHW3C75DKSXRFSDP4FTSMWJTCE2WNYQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.128551993 (578h26m42.012506207s) [noise=true , address=77.90.31.15:4697 , piece_id=BSVS5EKTGONBHXQSSCIIEWSKKHJCZPU57I6HA6JOLVDCK2THAPEA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.749709963 (578h26m42.633664174s) [upload=509178]: Next returned nil segment Feb 8 18:22:04.749726686 (578h26m42.633680894s) [upload=509178]: Waiting for error group managing segments... Feb 8 18:22:04.892514286 (578h26m42.776468499s) [noise=true , address=45.91.116.12:4228 , piece_id=J5PHXEAUTYO3L2SCOWJV5DG4HSSCCRDXSU4FRQZPZGUAQNYCUCSA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.892834641 (578h26m42.776788835s) [noise=true , address=45.91.116.9:4262 , piece_id=W4IKJMAXYTG3GMYNSRTWHHJFODGL6O23I74EIBWPHZN2EIYSUGZA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.895637894 (578h26m42.7795921s) [noise=true , address=45.91.116.11:4152 , piece_id=E2JT4VPQLPITKBG7VX3DGLHW3C75DKSXRFSDP4FTSMWJTCE2WNYQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.911053197 (578h26m42.795007406s) [noise=true , address=45.91.116.12:4244 , piece_id=677ZBCVMYCFHEHZXDZLMDNH7CAEH54SYWJTE5AVWFNFH4WGW3TVQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.913091544 (578h26m42.797045758s) [noise=true , address=45.91.116.7:4012 , piece_id=TQWEGKVB4YKOQQ5JUPDOUB3NJKXT7SJ3MN2HULE3KSDA6EEKG5KQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:08.025526151 (578h26m45.909480356s) [noise=true , address=79.127.219.38:4818 , piece_id=HBQ65EPXPLTY3RRBDJKOJWJOOEAHV2CDQPKSXJG2JJ4WVWIBGEBA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:10.693673801 (578h26m48.577628002s) [noise=true , address=145.79.227.36:4518 , piece_id=X6IT5WDM5GGJEUTBYRCU7JJT6E6SDR43J7MY25KWSHMENNBDZJOA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:12.731005984 (578h26m50.614960184s) [noise=true , address=79.127.219.46:4894 , piece_id=Y4X54TAT6YVVCN7CBMZBBMTQJHMLPUB2CFOBPP3SEPDAXOE4MIFA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:33.605468726 (578h27m11.489422938s) [noise=true , address=77.90.31.19:4844 , piece_id=YQ4QWJRT22Y7FZ2PSZSYADSBYCIG2RW2J6AGVPJBUWF7RWAQRXGA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: rpc: dial tcp 77.90.31.19:4844: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.605738489 (578h27m11.489692708s) [noise=true , address=77.90.31.10:4520 , piece_id=GVEUY3LEGLLZOHGUHZJ342W77346FB5OIJGHYWL6RFWAPN6NJBEQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: read tcp 139.59.144.22:58478->77.90.31.10:4520: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.605844639 (578h27m11.489798909s) [noise=true , address=77.90.31.13:4629 , piece_id=HOYQBJTPUN3ZJT24DYY4KPKNP3WC3PY7L5CUSGNMJZH3LZPVYMQQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:60068->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606136012 (578h27m11.490090201s) [noise=true , address=79.127.219.38:4820 , piece_id=DDBMTKBRXR7DCD5YNOWWD4NANY6H2MAARBME5JRMGDC5O55ZTFPA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection; write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection Feb 8 18:22:33.606166109 (578h27m11.490120322s) [noise=true , address=77.90.31.21:4880 , piece_id=USK3WG27XI5BWWHW4KD6PKF5QZFF2WC55LLDQ6DYICTR7RL4FEQA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb, address:77.90.31.21:4880): protocol: read tcp 139.59.144.22:60158->77.90.31.21:4880: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606403948 (578h27m11.490358158s) [noise=true , address=77.90.31.16:4736 , piece_id=I3YMRQLJRC6AGZCS3X24NPS4ZMY6V2RUGMSYVQKA6CQCDP74Y6YA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: read tcp 139.59.144.22:41548->77.90.31.16:4736: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606474964 (578h27m11.490429174s) [noise=true , address=77.90.31.11:4556 , piece_id=BBBH26EPDCSQIHDGRXAK5R6B5P7LS2KINZJ4PX23X5ND4A4MEHIQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1QNr5B8kdrSa59rHAb82TcvSYpru7m7zbdxXqqxw3FpcFyfpks, address:77.90.31.11:4556): protocol: read tcp 139.59.144.22:43432->77.90.31.11:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606659904 (578h27m11.490614092s) [noise=true , address=77.90.31.15:4697 , piece_id=BSVS5EKTGONBHXQSSCIIEWSKKHJCZPU57I6HA6JOLVDCK2THAPEA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:49004->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606692396 (578h27m11.490646597s) [seg_pos={0 0}, upload=509178]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 8 18:22:33.717090428 (578h27m11.601044639s) [upload=509178]: Done uploading segments... Feb 8 18:22:33.717136942 (578h27m11.601091151s) [upload=509178]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.337526413s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.................X..........................................] duration: 1.635610155s trace: https://jaeger.dev.storj.io/trace/42fce211b8a1e546 FAIL (2026-02-08 18:53:07 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.635638124s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 2.837447106s trace: https://jaeger.dev.storj.io/trace/4dcbf2bdf7405449 FAIL (2026-02-08 18:52:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.837490699s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................XX.........................................] duration: 2.412719145s trace: https://jaeger.dev.storj.io/trace/6d7de065855c854f FAIL (2026-02-08 18:52:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== oad=509178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 18:22:03.960927132 (578h26m41.84488134s) [upload=509178]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 18:22:04.110748788 (578h26m41.994702997s) [seg_pos={0 0}, upload=509178]: Begin upload segment... Feb 8 18:22:04.110820336 (578h26m41.994774543s) [seg_pos={0 0}, upload=509178]: Done begin upload segment. Feb 8 18:22:04.110856501 (578h26m41.994810703s) [noise=true , address=77.90.31.21:4880 , piece_id=USK3WG27XI5BWWHW4KD6PKF5QZFF2WC55LLDQ6DYICTR7RL4FEQA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.115693397 (578h26m41.999647587s) [noise=true , address=45.91.116.12:4244 , piece_id=677ZBCVMYCFHEHZXDZLMDNH7CAEH54SYWJTE5AVWFNFH4WGW3TVQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.116499874 (578h26m42.000454086s) [noise=true , address=145.79.227.36:4518 , piece_id=X6IT5WDM5GGJEUTBYRCU7JJT6E6SDR43J7MY25KWSHMENNBDZJOA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.118777725 (578h26m42.002731938s) [noise=true , address=77.90.31.16:4736 , piece_id=I3YMRQLJRC6AGZCS3X24NPS4ZMY6V2RUGMSYVQKA6CQCDP74Y6YA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.119400779 (578h26m42.003354998s) [noise=true , address=77.90.31.11:4556 , piece_id=BBBH26EPDCSQIHDGRXAK5R6B5P7LS2KINZJ4PX23X5ND4A4MEHIQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.119963979 (578h26m42.003918195s) [noise=true , address=45.91.116.7:4012 , piece_id=TQWEGKVB4YKOQQ5JUPDOUB3NJKXT7SJ3MN2HULE3KSDA6EEKG5KQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.120514589 (578h26m42.004468803s) [noise=true , address=45.91.116.9:4262 , piece_id=W4IKJMAXYTG3GMYNSRTWHHJFODGL6O23I74EIBWPHZN2EIYSUGZA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.121035040 (578h26m42.004989257s) [noise=true , address=77.90.31.19:4844 , piece_id=YQ4QWJRT22Y7FZ2PSZSYADSBYCIG2RW2J6AGVPJBUWF7RWAQRXGA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.121549635 (578h26m42.00550385s) [noise=true , address=79.127.219.38:4820 , piece_id=DDBMTKBRXR7DCD5YNOWWD4NANY6H2MAARBME5JRMGDC5O55ZTFPA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.122136143 (578h26m42.006090357s) [noise=true , address=45.91.116.12:4228 , piece_id=J5PHXEAUTYO3L2SCOWJV5DG4HSSCCRDXSU4FRQZPZGUAQNYCUCSA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.122700058 (578h26m42.006654279s) [noise=true , address=77.90.31.10:4520 , piece_id=GVEUY3LEGLLZOHGUHZJ342W77346FB5OIJGHYWL6RFWAPN6NJBEQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.123269841 (578h26m42.007224055s) [noise=true , address=79.127.219.38:4818 , piece_id=HBQ65EPXPLTY3RRBDJKOJWJOOEAHV2CDQPKSXJG2JJ4WVWIBGEBA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.123822811 (578h26m42.007777028s) [noise=true , address=77.90.31.13:4629 , piece_id=HOYQBJTPUN3ZJT24DYY4KPKNP3WC3PY7L5CUSGNMJZH3LZPVYMQQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.125362061 (578h26m42.009316274s) [noise=true , address=79.127.219.46:4894 , piece_id=Y4X54TAT6YVVCN7CBMZBBMTQJHMLPUB2CFOBPP3SEPDAXOE4MIFA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.126626714 (578h26m42.010580926s) [noise=true , address=45.91.116.11:4152 , piece_id=E2JT4VPQLPITKBG7VX3DGLHW3C75DKSXRFSDP4FTSMWJTCE2WNYQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.128551993 (578h26m42.012506207s) [noise=true , address=77.90.31.15:4697 , piece_id=BSVS5EKTGONBHXQSSCIIEWSKKHJCZPU57I6HA6JOLVDCK2THAPEA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.749709963 (578h26m42.633664174s) [upload=509178]: Next returned nil segment Feb 8 18:22:04.749726686 (578h26m42.633680894s) [upload=509178]: Waiting for error group managing segments... Feb 8 18:22:04.892514286 (578h26m42.776468499s) [noise=true , address=45.91.116.12:4228 , piece_id=J5PHXEAUTYO3L2SCOWJV5DG4HSSCCRDXSU4FRQZPZGUAQNYCUCSA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.892834641 (578h26m42.776788835s) [noise=true , address=45.91.116.9:4262 , piece_id=W4IKJMAXYTG3GMYNSRTWHHJFODGL6O23I74EIBWPHZN2EIYSUGZA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.895637894 (578h26m42.7795921s) [noise=true , address=45.91.116.11:4152 , piece_id=E2JT4VPQLPITKBG7VX3DGLHW3C75DKSXRFSDP4FTSMWJTCE2WNYQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.911053197 (578h26m42.795007406s) [noise=true , address=45.91.116.12:4244 , piece_id=677ZBCVMYCFHEHZXDZLMDNH7CAEH54SYWJTE5AVWFNFH4WGW3TVQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.913091544 (578h26m42.797045758s) [noise=true , address=45.91.116.7:4012 , piece_id=TQWEGKVB4YKOQQ5JUPDOUB3NJKXT7SJ3MN2HULE3KSDA6EEKG5KQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:08.025526151 (578h26m45.909480356s) [noise=true , address=79.127.219.38:4818 , piece_id=HBQ65EPXPLTY3RRBDJKOJWJOOEAHV2CDQPKSXJG2JJ4WVWIBGEBA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:10.693673801 (578h26m48.577628002s) [noise=true , address=145.79.227.36:4518 , piece_id=X6IT5WDM5GGJEUTBYRCU7JJT6E6SDR43J7MY25KWSHMENNBDZJOA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:12.731005984 (578h26m50.614960184s) [noise=true , address=79.127.219.46:4894 , piece_id=Y4X54TAT6YVVCN7CBMZBBMTQJHMLPUB2CFOBPP3SEPDAXOE4MIFA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:33.605468726 (578h27m11.489422938s) [noise=true , address=77.90.31.19:4844 , piece_id=YQ4QWJRT22Y7FZ2PSZSYADSBYCIG2RW2J6AGVPJBUWF7RWAQRXGA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: rpc: dial tcp 77.90.31.19:4844: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.605738489 (578h27m11.489692708s) [noise=true , address=77.90.31.10:4520 , piece_id=GVEUY3LEGLLZOHGUHZJ342W77346FB5OIJGHYWL6RFWAPN6NJBEQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: read tcp 139.59.144.22:58478->77.90.31.10:4520: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.605844639 (578h27m11.489798909s) [noise=true , address=77.90.31.13:4629 , piece_id=HOYQBJTPUN3ZJT24DYY4KPKNP3WC3PY7L5CUSGNMJZH3LZPVYMQQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:60068->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606136012 (578h27m11.490090201s) [noise=true , address=79.127.219.38:4820 , piece_id=DDBMTKBRXR7DCD5YNOWWD4NANY6H2MAARBME5JRMGDC5O55ZTFPA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection; write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection Feb 8 18:22:33.606166109 (578h27m11.490120322s) [noise=true , address=77.90.31.21:4880 , piece_id=USK3WG27XI5BWWHW4KD6PKF5QZFF2WC55LLDQ6DYICTR7RL4FEQA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb, address:77.90.31.21:4880): protocol: read tcp 139.59.144.22:60158->77.90.31.21:4880: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606403948 (578h27m11.490358158s) [noise=true , address=77.90.31.16:4736 , piece_id=I3YMRQLJRC6AGZCS3X24NPS4ZMY6V2RUGMSYVQKA6CQCDP74Y6YA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: read tcp 139.59.144.22:41548->77.90.31.16:4736: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606474964 (578h27m11.490429174s) [noise=true , address=77.90.31.11:4556 , piece_id=BBBH26EPDCSQIHDGRXAK5R6B5P7LS2KINZJ4PX23X5ND4A4MEHIQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1QNr5B8kdrSa59rHAb82TcvSYpru7m7zbdxXqqxw3FpcFyfpks, address:77.90.31.11:4556): protocol: read tcp 139.59.144.22:43432->77.90.31.11:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606659904 (578h27m11.490614092s) [noise=true , address=77.90.31.15:4697 , piece_id=BSVS5EKTGONBHXQSSCIIEWSKKHJCZPU57I6HA6JOLVDCK2THAPEA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:49004->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606692396 (578h27m11.490646597s) [seg_pos={0 0}, upload=509178]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 8 18:22:33.717090428 (578h27m11.601044639s) [upload=509178]: Done uploading segments... Feb 8 18:22:33.717136942 (578h27m11.601091151s) [upload=509178]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.412748775s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..................X.........................................] duration: 1.605989019s trace: https://jaeger.dev.storj.io/trace/42fce211b8a1e546 FAIL (2026-02-08 18:52:07 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.60601662s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 2.712934043s trace: https://jaeger.dev.storj.io/trace/4dcbf2bdf7405449 FAIL (2026-02-08 18:51:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.712962738s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...................X........................................] duration: 1.624503893s trace: https://jaeger.dev.storj.io/trace/42fce211b8a1e546 FAIL (2026-02-08 18:51:36 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.624534026s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................XX........................................] duration: 2.366524755s trace: https://jaeger.dev.storj.io/trace/6d7de065855c854f FAIL (2026-02-08 18:51:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== oad=509178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 18:22:03.960927132 (578h26m41.84488134s) [upload=509178]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 18:22:04.110748788 (578h26m41.994702997s) [seg_pos={0 0}, upload=509178]: Begin upload segment... Feb 8 18:22:04.110820336 (578h26m41.994774543s) [seg_pos={0 0}, upload=509178]: Done begin upload segment. Feb 8 18:22:04.110856501 (578h26m41.994810703s) [noise=true , address=77.90.31.21:4880 , piece_id=USK3WG27XI5BWWHW4KD6PKF5QZFF2WC55LLDQ6DYICTR7RL4FEQA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.115693397 (578h26m41.999647587s) [noise=true , address=45.91.116.12:4244 , piece_id=677ZBCVMYCFHEHZXDZLMDNH7CAEH54SYWJTE5AVWFNFH4WGW3TVQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.116499874 (578h26m42.000454086s) [noise=true , address=145.79.227.36:4518 , piece_id=X6IT5WDM5GGJEUTBYRCU7JJT6E6SDR43J7MY25KWSHMENNBDZJOA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.118777725 (578h26m42.002731938s) [noise=true , address=77.90.31.16:4736 , piece_id=I3YMRQLJRC6AGZCS3X24NPS4ZMY6V2RUGMSYVQKA6CQCDP74Y6YA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.119400779 (578h26m42.003354998s) [noise=true , address=77.90.31.11:4556 , piece_id=BBBH26EPDCSQIHDGRXAK5R6B5P7LS2KINZJ4PX23X5ND4A4MEHIQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.119963979 (578h26m42.003918195s) [noise=true , address=45.91.116.7:4012 , piece_id=TQWEGKVB4YKOQQ5JUPDOUB3NJKXT7SJ3MN2HULE3KSDA6EEKG5KQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.120514589 (578h26m42.004468803s) [noise=true , address=45.91.116.9:4262 , piece_id=W4IKJMAXYTG3GMYNSRTWHHJFODGL6O23I74EIBWPHZN2EIYSUGZA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.121035040 (578h26m42.004989257s) [noise=true , address=77.90.31.19:4844 , piece_id=YQ4QWJRT22Y7FZ2PSZSYADSBYCIG2RW2J6AGVPJBUWF7RWAQRXGA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.121549635 (578h26m42.00550385s) [noise=true , address=79.127.219.38:4820 , piece_id=DDBMTKBRXR7DCD5YNOWWD4NANY6H2MAARBME5JRMGDC5O55ZTFPA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.122136143 (578h26m42.006090357s) [noise=true , address=45.91.116.12:4228 , piece_id=J5PHXEAUTYO3L2SCOWJV5DG4HSSCCRDXSU4FRQZPZGUAQNYCUCSA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.122700058 (578h26m42.006654279s) [noise=true , address=77.90.31.10:4520 , piece_id=GVEUY3LEGLLZOHGUHZJ342W77346FB5OIJGHYWL6RFWAPN6NJBEQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.123269841 (578h26m42.007224055s) [noise=true , address=79.127.219.38:4818 , piece_id=HBQ65EPXPLTY3RRBDJKOJWJOOEAHV2CDQPKSXJG2JJ4WVWIBGEBA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.123822811 (578h26m42.007777028s) [noise=true , address=77.90.31.13:4629 , piece_id=HOYQBJTPUN3ZJT24DYY4KPKNP3WC3PY7L5CUSGNMJZH3LZPVYMQQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.125362061 (578h26m42.009316274s) [noise=true , address=79.127.219.46:4894 , piece_id=Y4X54TAT6YVVCN7CBMZBBMTQJHMLPUB2CFOBPP3SEPDAXOE4MIFA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.126626714 (578h26m42.010580926s) [noise=true , address=45.91.116.11:4152 , piece_id=E2JT4VPQLPITKBG7VX3DGLHW3C75DKSXRFSDP4FTSMWJTCE2WNYQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.128551993 (578h26m42.012506207s) [noise=true , address=77.90.31.15:4697 , piece_id=BSVS5EKTGONBHXQSSCIIEWSKKHJCZPU57I6HA6JOLVDCK2THAPEA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.749709963 (578h26m42.633664174s) [upload=509178]: Next returned nil segment Feb 8 18:22:04.749726686 (578h26m42.633680894s) [upload=509178]: Waiting for error group managing segments... Feb 8 18:22:04.892514286 (578h26m42.776468499s) [noise=true , address=45.91.116.12:4228 , piece_id=J5PHXEAUTYO3L2SCOWJV5DG4HSSCCRDXSU4FRQZPZGUAQNYCUCSA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.892834641 (578h26m42.776788835s) [noise=true , address=45.91.116.9:4262 , piece_id=W4IKJMAXYTG3GMYNSRTWHHJFODGL6O23I74EIBWPHZN2EIYSUGZA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.895637894 (578h26m42.7795921s) [noise=true , address=45.91.116.11:4152 , piece_id=E2JT4VPQLPITKBG7VX3DGLHW3C75DKSXRFSDP4FTSMWJTCE2WNYQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.911053197 (578h26m42.795007406s) [noise=true , address=45.91.116.12:4244 , piece_id=677ZBCVMYCFHEHZXDZLMDNH7CAEH54SYWJTE5AVWFNFH4WGW3TVQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.913091544 (578h26m42.797045758s) [noise=true , address=45.91.116.7:4012 , piece_id=TQWEGKVB4YKOQQ5JUPDOUB3NJKXT7SJ3MN2HULE3KSDA6EEKG5KQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:08.025526151 (578h26m45.909480356s) [noise=true , address=79.127.219.38:4818 , piece_id=HBQ65EPXPLTY3RRBDJKOJWJOOEAHV2CDQPKSXJG2JJ4WVWIBGEBA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:10.693673801 (578h26m48.577628002s) [noise=true , address=145.79.227.36:4518 , piece_id=X6IT5WDM5GGJEUTBYRCU7JJT6E6SDR43J7MY25KWSHMENNBDZJOA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:12.731005984 (578h26m50.614960184s) [noise=true , address=79.127.219.46:4894 , piece_id=Y4X54TAT6YVVCN7CBMZBBMTQJHMLPUB2CFOBPP3SEPDAXOE4MIFA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:33.605468726 (578h27m11.489422938s) [noise=true , address=77.90.31.19:4844 , piece_id=YQ4QWJRT22Y7FZ2PSZSYADSBYCIG2RW2J6AGVPJBUWF7RWAQRXGA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: rpc: dial tcp 77.90.31.19:4844: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.605738489 (578h27m11.489692708s) [noise=true , address=77.90.31.10:4520 , piece_id=GVEUY3LEGLLZOHGUHZJ342W77346FB5OIJGHYWL6RFWAPN6NJBEQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: read tcp 139.59.144.22:58478->77.90.31.10:4520: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.605844639 (578h27m11.489798909s) [noise=true , address=77.90.31.13:4629 , piece_id=HOYQBJTPUN3ZJT24DYY4KPKNP3WC3PY7L5CUSGNMJZH3LZPVYMQQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:60068->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606136012 (578h27m11.490090201s) [noise=true , address=79.127.219.38:4820 , piece_id=DDBMTKBRXR7DCD5YNOWWD4NANY6H2MAARBME5JRMGDC5O55ZTFPA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection; write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection Feb 8 18:22:33.606166109 (578h27m11.490120322s) [noise=true , address=77.90.31.21:4880 , piece_id=USK3WG27XI5BWWHW4KD6PKF5QZFF2WC55LLDQ6DYICTR7RL4FEQA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb, address:77.90.31.21:4880): protocol: read tcp 139.59.144.22:60158->77.90.31.21:4880: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606403948 (578h27m11.490358158s) [noise=true , address=77.90.31.16:4736 , piece_id=I3YMRQLJRC6AGZCS3X24NPS4ZMY6V2RUGMSYVQKA6CQCDP74Y6YA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: read tcp 139.59.144.22:41548->77.90.31.16:4736: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606474964 (578h27m11.490429174s) [noise=true , address=77.90.31.11:4556 , piece_id=BBBH26EPDCSQIHDGRXAK5R6B5P7LS2KINZJ4PX23X5ND4A4MEHIQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1QNr5B8kdrSa59rHAb82TcvSYpru7m7zbdxXqqxw3FpcFyfpks, address:77.90.31.11:4556): protocol: read tcp 139.59.144.22:43432->77.90.31.11:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606659904 (578h27m11.490614092s) [noise=true , address=77.90.31.15:4697 , piece_id=BSVS5EKTGONBHXQSSCIIEWSKKHJCZPU57I6HA6JOLVDCK2THAPEA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:49004->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606692396 (578h27m11.490646597s) [seg_pos={0 0}, upload=509178]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 8 18:22:33.717090428 (578h27m11.601044639s) [upload=509178]: Done uploading segments... Feb 8 18:22:33.717136942 (578h27m11.601091151s) [upload=509178]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.366548768s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 2.662101s trace: https://jaeger.dev.storj.io/trace/4dcbf2bdf7405449 FAIL (2026-02-08 18:50:39 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.662162165s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................XX.......................................] duration: 2.384236855s trace: https://jaeger.dev.storj.io/trace/6d7de065855c854f FAIL (2026-02-08 18:50:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== oad=509178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 18:22:03.960927132 (578h26m41.84488134s) [upload=509178]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 18:22:04.110748788 (578h26m41.994702997s) [seg_pos={0 0}, upload=509178]: Begin upload segment... Feb 8 18:22:04.110820336 (578h26m41.994774543s) [seg_pos={0 0}, upload=509178]: Done begin upload segment. Feb 8 18:22:04.110856501 (578h26m41.994810703s) [noise=true , address=77.90.31.21:4880 , piece_id=USK3WG27XI5BWWHW4KD6PKF5QZFF2WC55LLDQ6DYICTR7RL4FEQA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.115693397 (578h26m41.999647587s) [noise=true , address=45.91.116.12:4244 , piece_id=677ZBCVMYCFHEHZXDZLMDNH7CAEH54SYWJTE5AVWFNFH4WGW3TVQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.116499874 (578h26m42.000454086s) [noise=true , address=145.79.227.36:4518 , piece_id=X6IT5WDM5GGJEUTBYRCU7JJT6E6SDR43J7MY25KWSHMENNBDZJOA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.118777725 (578h26m42.002731938s) [noise=true , address=77.90.31.16:4736 , piece_id=I3YMRQLJRC6AGZCS3X24NPS4ZMY6V2RUGMSYVQKA6CQCDP74Y6YA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.119400779 (578h26m42.003354998s) [noise=true , address=77.90.31.11:4556 , piece_id=BBBH26EPDCSQIHDGRXAK5R6B5P7LS2KINZJ4PX23X5ND4A4MEHIQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.119963979 (578h26m42.003918195s) [noise=true , address=45.91.116.7:4012 , piece_id=TQWEGKVB4YKOQQ5JUPDOUB3NJKXT7SJ3MN2HULE3KSDA6EEKG5KQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.120514589 (578h26m42.004468803s) [noise=true , address=45.91.116.9:4262 , piece_id=W4IKJMAXYTG3GMYNSRTWHHJFODGL6O23I74EIBWPHZN2EIYSUGZA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.121035040 (578h26m42.004989257s) [noise=true , address=77.90.31.19:4844 , piece_id=YQ4QWJRT22Y7FZ2PSZSYADSBYCIG2RW2J6AGVPJBUWF7RWAQRXGA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.121549635 (578h26m42.00550385s) [noise=true , address=79.127.219.38:4820 , piece_id=DDBMTKBRXR7DCD5YNOWWD4NANY6H2MAARBME5JRMGDC5O55ZTFPA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.122136143 (578h26m42.006090357s) [noise=true , address=45.91.116.12:4228 , piece_id=J5PHXEAUTYO3L2SCOWJV5DG4HSSCCRDXSU4FRQZPZGUAQNYCUCSA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.122700058 (578h26m42.006654279s) [noise=true , address=77.90.31.10:4520 , piece_id=GVEUY3LEGLLZOHGUHZJ342W77346FB5OIJGHYWL6RFWAPN6NJBEQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.123269841 (578h26m42.007224055s) [noise=true , address=79.127.219.38:4818 , piece_id=HBQ65EPXPLTY3RRBDJKOJWJOOEAHV2CDQPKSXJG2JJ4WVWIBGEBA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.123822811 (578h26m42.007777028s) [noise=true , address=77.90.31.13:4629 , piece_id=HOYQBJTPUN3ZJT24DYY4KPKNP3WC3PY7L5CUSGNMJZH3LZPVYMQQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.125362061 (578h26m42.009316274s) [noise=true , address=79.127.219.46:4894 , piece_id=Y4X54TAT6YVVCN7CBMZBBMTQJHMLPUB2CFOBPP3SEPDAXOE4MIFA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.126626714 (578h26m42.010580926s) [noise=true , address=45.91.116.11:4152 , piece_id=E2JT4VPQLPITKBG7VX3DGLHW3C75DKSXRFSDP4FTSMWJTCE2WNYQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.128551993 (578h26m42.012506207s) [noise=true , address=77.90.31.15:4697 , piece_id=BSVS5EKTGONBHXQSSCIIEWSKKHJCZPU57I6HA6JOLVDCK2THAPEA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.749709963 (578h26m42.633664174s) [upload=509178]: Next returned nil segment Feb 8 18:22:04.749726686 (578h26m42.633680894s) [upload=509178]: Waiting for error group managing segments... Feb 8 18:22:04.892514286 (578h26m42.776468499s) [noise=true , address=45.91.116.12:4228 , piece_id=J5PHXEAUTYO3L2SCOWJV5DG4HSSCCRDXSU4FRQZPZGUAQNYCUCSA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.892834641 (578h26m42.776788835s) [noise=true , address=45.91.116.9:4262 , piece_id=W4IKJMAXYTG3GMYNSRTWHHJFODGL6O23I74EIBWPHZN2EIYSUGZA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.895637894 (578h26m42.7795921s) [noise=true , address=45.91.116.11:4152 , piece_id=E2JT4VPQLPITKBG7VX3DGLHW3C75DKSXRFSDP4FTSMWJTCE2WNYQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.911053197 (578h26m42.795007406s) [noise=true , address=45.91.116.12:4244 , piece_id=677ZBCVMYCFHEHZXDZLMDNH7CAEH54SYWJTE5AVWFNFH4WGW3TVQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.913091544 (578h26m42.797045758s) [noise=true , address=45.91.116.7:4012 , piece_id=TQWEGKVB4YKOQQ5JUPDOUB3NJKXT7SJ3MN2HULE3KSDA6EEKG5KQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:08.025526151 (578h26m45.909480356s) [noise=true , address=79.127.219.38:4818 , piece_id=HBQ65EPXPLTY3RRBDJKOJWJOOEAHV2CDQPKSXJG2JJ4WVWIBGEBA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:10.693673801 (578h26m48.577628002s) [noise=true , address=145.79.227.36:4518 , piece_id=X6IT5WDM5GGJEUTBYRCU7JJT6E6SDR43J7MY25KWSHMENNBDZJOA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:12.731005984 (578h26m50.614960184s) [noise=true , address=79.127.219.46:4894 , piece_id=Y4X54TAT6YVVCN7CBMZBBMTQJHMLPUB2CFOBPP3SEPDAXOE4MIFA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:33.605468726 (578h27m11.489422938s) [noise=true , address=77.90.31.19:4844 , piece_id=YQ4QWJRT22Y7FZ2PSZSYADSBYCIG2RW2J6AGVPJBUWF7RWAQRXGA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: rpc: dial tcp 77.90.31.19:4844: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.605738489 (578h27m11.489692708s) [noise=true , address=77.90.31.10:4520 , piece_id=GVEUY3LEGLLZOHGUHZJ342W77346FB5OIJGHYWL6RFWAPN6NJBEQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: read tcp 139.59.144.22:58478->77.90.31.10:4520: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.605844639 (578h27m11.489798909s) [noise=true , address=77.90.31.13:4629 , piece_id=HOYQBJTPUN3ZJT24DYY4KPKNP3WC3PY7L5CUSGNMJZH3LZPVYMQQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:60068->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606136012 (578h27m11.490090201s) [noise=true , address=79.127.219.38:4820 , piece_id=DDBMTKBRXR7DCD5YNOWWD4NANY6H2MAARBME5JRMGDC5O55ZTFPA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection; write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection Feb 8 18:22:33.606166109 (578h27m11.490120322s) [noise=true , address=77.90.31.21:4880 , piece_id=USK3WG27XI5BWWHW4KD6PKF5QZFF2WC55LLDQ6DYICTR7RL4FEQA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb, address:77.90.31.21:4880): protocol: read tcp 139.59.144.22:60158->77.90.31.21:4880: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606403948 (578h27m11.490358158s) [noise=true , address=77.90.31.16:4736 , piece_id=I3YMRQLJRC6AGZCS3X24NPS4ZMY6V2RUGMSYVQKA6CQCDP74Y6YA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: read tcp 139.59.144.22:41548->77.90.31.16:4736: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606474964 (578h27m11.490429174s) [noise=true , address=77.90.31.11:4556 , piece_id=BBBH26EPDCSQIHDGRXAK5R6B5P7LS2KINZJ4PX23X5ND4A4MEHIQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1QNr5B8kdrSa59rHAb82TcvSYpru7m7zbdxXqqxw3FpcFyfpks, address:77.90.31.11:4556): protocol: read tcp 139.59.144.22:43432->77.90.31.11:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606659904 (578h27m11.490614092s) [noise=true , address=77.90.31.15:4697 , piece_id=BSVS5EKTGONBHXQSSCIIEWSKKHJCZPU57I6HA6JOLVDCK2THAPEA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:49004->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606692396 (578h27m11.490646597s) [seg_pos={0 0}, upload=509178]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 8 18:22:33.717090428 (578h27m11.601044639s) [upload=509178]: Done uploading segments... Feb 8 18:22:33.717136942 (578h27m11.601091151s) [upload=509178]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.384270495s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [....................X.......................................] duration: 1.708686166s trace: https://jaeger.dev.storj.io/trace/42fce211b8a1e546 FAIL (2026-02-08 18:50:32 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.708792114s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 3.138310926s trace: https://jaeger.dev.storj.io/trace/4dcbf2bdf7405449 FAIL (2026-02-08 18:50:05 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.138337432s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 2.752539655s trace: https://jaeger.dev.storj.io/trace/4dcbf2bdf7405449 FAIL (2026-02-08 18:49:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.752565975s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....................XX......................................] duration: 2.423205387s trace: https://jaeger.dev.storj.io/trace/6d7de065855c854f FAIL (2026-02-08 18:49:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 8) ======LOGS====== oad=509178]: Flush batch item: pb.BatchRequestItem_ObjectBegin Feb 8 18:22:03.960927132 (578h26m41.84488134s) [upload=509178]: Flush batch item: pb.BatchRequestItem_SegmentBegin Feb 8 18:22:04.110748788 (578h26m41.994702997s) [seg_pos={0 0}, upload=509178]: Begin upload segment... Feb 8 18:22:04.110820336 (578h26m41.994774543s) [seg_pos={0 0}, upload=509178]: Done begin upload segment. Feb 8 18:22:04.110856501 (578h26m41.994810703s) [noise=true , address=77.90.31.21:4880 , piece_id=USK3WG27XI5BWWHW4KD6PKF5QZFF2WC55LLDQ6DYICTR7RL4FEQA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.115693397 (578h26m41.999647587s) [noise=true , address=45.91.116.12:4244 , piece_id=677ZBCVMYCFHEHZXDZLMDNH7CAEH54SYWJTE5AVWFNFH4WGW3TVQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.116499874 (578h26m42.000454086s) [noise=true , address=145.79.227.36:4518 , piece_id=X6IT5WDM5GGJEUTBYRCU7JJT6E6SDR43J7MY25KWSHMENNBDZJOA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.118777725 (578h26m42.002731938s) [noise=true , address=77.90.31.16:4736 , piece_id=I3YMRQLJRC6AGZCS3X24NPS4ZMY6V2RUGMSYVQKA6CQCDP74Y6YA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.119400779 (578h26m42.003354998s) [noise=true , address=77.90.31.11:4556 , piece_id=BBBH26EPDCSQIHDGRXAK5R6B5P7LS2KINZJ4PX23X5ND4A4MEHIQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.119963979 (578h26m42.003918195s) [noise=true , address=45.91.116.7:4012 , piece_id=TQWEGKVB4YKOQQ5JUPDOUB3NJKXT7SJ3MN2HULE3KSDA6EEKG5KQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.120514589 (578h26m42.004468803s) [noise=true , address=45.91.116.9:4262 , piece_id=W4IKJMAXYTG3GMYNSRTWHHJFODGL6O23I74EIBWPHZN2EIYSUGZA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.121035040 (578h26m42.004989257s) [noise=true , address=77.90.31.19:4844 , piece_id=YQ4QWJRT22Y7FZ2PSZSYADSBYCIG2RW2J6AGVPJBUWF7RWAQRXGA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.121549635 (578h26m42.00550385s) [noise=true , address=79.127.219.38:4820 , piece_id=DDBMTKBRXR7DCD5YNOWWD4NANY6H2MAARBME5JRMGDC5O55ZTFPA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.122136143 (578h26m42.006090357s) [noise=true , address=45.91.116.12:4228 , piece_id=J5PHXEAUTYO3L2SCOWJV5DG4HSSCCRDXSU4FRQZPZGUAQNYCUCSA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.122700058 (578h26m42.006654279s) [noise=true , address=77.90.31.10:4520 , piece_id=GVEUY3LEGLLZOHGUHZJ342W77346FB5OIJGHYWL6RFWAPN6NJBEQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.123269841 (578h26m42.007224055s) [noise=true , address=79.127.219.38:4818 , piece_id=HBQ65EPXPLTY3RRBDJKOJWJOOEAHV2CDQPKSXJG2JJ4WVWIBGEBA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.123822811 (578h26m42.007777028s) [noise=true , address=77.90.31.13:4629 , piece_id=HOYQBJTPUN3ZJT24DYY4KPKNP3WC3PY7L5CUSGNMJZH3LZPVYMQQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.125362061 (578h26m42.009316274s) [noise=true , address=79.127.219.46:4894 , piece_id=Y4X54TAT6YVVCN7CBMZBBMTQJHMLPUB2CFOBPP3SEPDAXOE4MIFA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.126626714 (578h26m42.010580926s) [noise=true , address=45.91.116.11:4152 , piece_id=E2JT4VPQLPITKBG7VX3DGLHW3C75DKSXRFSDP4FTSMWJTCE2WNYQ, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.128551993 (578h26m42.012506207s) [noise=true , address=77.90.31.15:4697 , piece_id=BSVS5EKTGONBHXQSSCIIEWSKKHJCZPU57I6HA6JOLVDCK2THAPEA, seg_pos={0 0}, upload=509178]: Uploading piece... Feb 8 18:22:04.749709963 (578h26m42.633664174s) [upload=509178]: Next returned nil segment Feb 8 18:22:04.749726686 (578h26m42.633680894s) [upload=509178]: Waiting for error group managing segments... Feb 8 18:22:04.892514286 (578h26m42.776468499s) [noise=true , address=45.91.116.12:4228 , piece_id=J5PHXEAUTYO3L2SCOWJV5DG4HSSCCRDXSU4FRQZPZGUAQNYCUCSA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.892834641 (578h26m42.776788835s) [noise=true , address=45.91.116.9:4262 , piece_id=W4IKJMAXYTG3GMYNSRTWHHJFODGL6O23I74EIBWPHZN2EIYSUGZA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.895637894 (578h26m42.7795921s) [noise=true , address=45.91.116.11:4152 , piece_id=E2JT4VPQLPITKBG7VX3DGLHW3C75DKSXRFSDP4FTSMWJTCE2WNYQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.911053197 (578h26m42.795007406s) [noise=true , address=45.91.116.12:4244 , piece_id=677ZBCVMYCFHEHZXDZLMDNH7CAEH54SYWJTE5AVWFNFH4WGW3TVQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:04.913091544 (578h26m42.797045758s) [noise=true , address=45.91.116.7:4012 , piece_id=TQWEGKVB4YKOQQ5JUPDOUB3NJKXT7SJ3MN2HULE3KSDA6EEKG5KQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:08.025526151 (578h26m45.909480356s) [noise=true , address=79.127.219.38:4818 , piece_id=HBQ65EPXPLTY3RRBDJKOJWJOOEAHV2CDQPKSXJG2JJ4WVWIBGEBA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:10.693673801 (578h26m48.577628002s) [noise=true , address=145.79.227.36:4518 , piece_id=X6IT5WDM5GGJEUTBYRCU7JJT6E6SDR43J7MY25KWSHMENNBDZJOA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:12.731005984 (578h26m50.614960184s) [noise=true , address=79.127.219.46:4894 , piece_id=Y4X54TAT6YVVCN7CBMZBBMTQJHMLPUB2CFOBPP3SEPDAXOE4MIFA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: <nil> Feb 8 18:22:33.605468726 (578h27m11.489422938s) [noise=true , address=77.90.31.19:4844 , piece_id=YQ4QWJRT22Y7FZ2PSZSYADSBYCIG2RW2J6AGVPJBUWF7RWAQRXGA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1rJArRXLFnyoegSL7XGNequq3wd1c14uzeumaR1HAkd5NdQB1t, address:77.90.31.19:4844): protocol: rpc: dial tcp 77.90.31.19:4844: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.605738489 (578h27m11.489692708s) [noise=true , address=77.90.31.10:4520 , piece_id=GVEUY3LEGLLZOHGUHZJ342W77346FB5OIJGHYWL6RFWAPN6NJBEQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1ehpG3YwRKWB8Z4qw9MZofFC4K8XNm16p27HJ2fZzvLYJTgtEp, address:77.90.31.10:4520): protocol: read tcp 139.59.144.22:58478->77.90.31.10:4520: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.605844639 (578h27m11.489798909s) [noise=true , address=77.90.31.13:4629 , piece_id=HOYQBJTPUN3ZJT24DYY4KPKNP3WC3PY7L5CUSGNMJZH3LZPVYMQQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12GZtxLCqqDT4EXE2oCWjynZwboY9wBq4BtbkisCeTdCcCncT9f, address:77.90.31.13:4629): protocol: read tcp 139.59.144.22:60068->77.90.31.13:4629: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606136012 (578h27m11.490090201s) [noise=true , address=79.127.219.38:4820 , piece_id=DDBMTKBRXR7DCD5YNOWWD4NANY6H2MAARBME5JRMGDC5O55ZTFPA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12ZvmVWpER8Z5N2RtEYx7dpBYnCX8GRsU4nvy5HRi11Hyk7GGf7, address:79.127.219.38:4820): protocol: write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection; write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55526->79.127.219.38:4820: use of closed network connection Feb 8 18:22:33.606166109 (578h27m11.490120322s) [noise=true , address=77.90.31.21:4880 , piece_id=USK3WG27XI5BWWHW4KD6PKF5QZFF2WC55LLDQ6DYICTR7RL4FEQA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb, address:77.90.31.21:4880): protocol: read tcp 139.59.144.22:60158->77.90.31.21:4880: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606403948 (578h27m11.490358158s) [noise=true , address=77.90.31.16:4736 , piece_id=I3YMRQLJRC6AGZCS3X24NPS4ZMY6V2RUGMSYVQKA6CQCDP74Y6YA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1DqyGgLKeQEoD6e4TLmUJ6kQYPsZkKe9WNJf3HxWn3erAargYk, address:77.90.31.16:4736): protocol: read tcp 139.59.144.22:41548->77.90.31.16:4736: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606474964 (578h27m11.490429174s) [noise=true , address=77.90.31.11:4556 , piece_id=BBBH26EPDCSQIHDGRXAK5R6B5P7LS2KINZJ4PX23X5ND4A4MEHIQ, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:1QNr5B8kdrSa59rHAb82TcvSYpru7m7zbdxXqqxw3FpcFyfpks, address:77.90.31.11:4556): protocol: read tcp 139.59.144.22:43432->77.90.31.11:4556: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606659904 (578h27m11.490614092s) [noise=true , address=77.90.31.15:4697 , piece_id=BSVS5EKTGONBHXQSSCIIEWSKKHJCZPU57I6HA6JOLVDCK2THAPEA, seg_pos={0 0}, upload=509178]: Done uploading piece. err: ecclient: upload failed (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5, address:77.90.31.15:4697): protocol: read tcp 139.59.144.22:49004->77.90.31.15:4697: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Feb 8 18:22:33.606692396 (578h27m11.490646597s) [seg_pos={0 0}, upload=509178]: Done waiting for segment. successful: 8 optimal: 13 errs: <nil> Feb 8 18:22:33.717090428 (578h27m11.601044639s) [upload=509178]: Done uploading segments... Feb 8 18:22:33.717136942 (578h27m11.601091151s) [upload=509178]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 8) Duration: 2.423230323s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.....................X......................................] duration: 1.570165464s trace: https://jaeger.dev.storj.io/trace/42fce211b8a1e546 FAIL (2026-02-08 18:49:27 UTC) orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1.570278737s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)