Orbiter History

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 2 out of 60 is failed (threshold=3) [...........................................XX...............] duration: 335.952067ms target: https://version.storj.io/ FAIL (2025-09-11 05:14:28 UTC) orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: i/o timeout Duration: 335.991544ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 2.543503582s FAIL (2025-09-11 05:14:14 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== 6387]: Got next segment. Inline: false Sep 11 05:01:47.070094760 (302h54m7.562527201s) [upload=266387]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 05:01:47.070100812 (302h54m7.562533255s) [upload=266387]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 05:01:47.282517324 (302h54m7.774949756s) [seg_pos={0 0}, upload=266387]: Begin upload segment... Sep 11 05:01:47.282586917 (302h54m7.775019351s) [seg_pos={0 0}, upload=266387]: Done begin upload segment. Sep 11 05:01:47.282630874 (302h54m7.775063319s) [noise=true , address=145.79.227.2:4121 , piece_id=KUVJMQVN5VOZCGW5W4DY5BMLI5IH23GSC2IFN6PH6XEA4OT3VUMA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283078686 (302h54m7.775511133s) [noise=true , address=45.91.116.8:4051 , piece_id=PPCINK7K25XXRN3JQPMWVBQVPXXP7UPVSILUGIKWO3OI7EEI42FQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283596723 (302h54m7.776029168s) [noise=true , address=45.91.116.11:4147 , piece_id=BPNZTKMMEXM5B6UQSOLWZTZVVT5UOV2QHPSZL742DHQ3AQ3O6ESA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283956314 (302h54m7.776388767s) [noise=true , address=45.91.116.6:4984 , piece_id=GQV5UTDPDAYNRXXQH7FL427GSQ5W5BLLOVQIN7NUIQIIIV7AJ4RQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284193911 (302h54m7.776626359s) [noise=true , address=145.79.227.13:4815 , piece_id=GBLGYGVE3WCY27XULJK6UYLUUZFPID33MA7X6N62TWHAMVRH3JBQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284732917 (302h54m7.777165362s) [noise=true , address=77.90.31.11:4556 , piece_id=QCYMCO46JRT2K6H46FYCDTZH6RTTL2Q46HOC2VW44IPTZ2W2KQRQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284833471 (302h54m7.77726592s) [noise=true , address=145.79.227.33:4884 , piece_id=ZTHSKPCM7ZF5BKF26VRUXLJ2N3KGZYFK6HJTKOHYDUJFFYRR7HDA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.285523649 (302h54m7.777956091s) [noise=true , address=145.79.227.32:4854 , piece_id=2YLGSMO4KJ4OTLCQLTFWB6SFEEUPT3X5XKWE7KDQSX7W5LO7FO5Q, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.285585257 (302h54m7.778017699s) [noise=true , address=145.79.227.12:4770 , piece_id=NYBMVQLHBRCGAK2QQHSZ2BRZN3XAMMJKCRYKS4QWI7ZFH64XEGEA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.286297044 (302h54m7.778729499s) [noise=true , address=145.79.227.30:4771 , piece_id=SKXNQMX4RW3KCWKY5TMDPUI5QZJXYROJBMV5Y4P7MAUZUGCSUIEA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.286526017 (302h54m7.778958471s) [noise=true , address=145.79.227.5:4240 , piece_id=Q4PEISD7R7IO4BYBWLADEXE6JBUGQ5AY4J3IPX4P3Q6HZBUSYN7Q, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287104751 (302h54m7.779537193s) [noise=true , address=45.91.116.6:4008 , piece_id=PWJH5FFOUVPV64I4FLTGTBCMYLMIYBEZBZBUCI2WJQBKOPR4KABA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287470770 (302h54m7.779903218s) [noise=true , address=145.79.227.17:4984 , piece_id=ARCUIGNVITSNKFJYAJQEP24HJVBBBDOZ3FRLUQASEZFN2IXGMPLQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287613969 (302h54m7.780046423s) [noise=true , address=145.79.227.14:4843 , piece_id=IXNCU3WCMDYAVT6IE4ETEMTKQROPHV4V77VO5TNNZP5ASMW3WJQQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287960566 (302h54m7.780393019s) [noise=true , address=77.90.31.17:4795 , piece_id=2GUT5J77OOFK3OU6DG5IVXAXCBSV7SZRCXX3TPYZIRMCKGX3JUOQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289210694 (302h54m7.781643146s) [noise=true , address=145.79.227.11:4733 , piece_id=FPN5NMMTUYQHWRQOOYB5RPDKTWHEEWA3CX2OMH233YHTID6MWIFQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289586052 (302h54m7.782018502s) [noise=true , address=145.79.227.37:4589 , piece_id=K4HCLE6PM54ZXJVN5KO626R5UUP32OVEN6DDYIFUM6EYQCRVT7YQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289971344 (302h54m7.782403791s) [noise=true , address=145.79.227.36:4524 , piece_id=RSUO6BNALYS7M6W4RJ55UOD35LNCPD26PQDZBCNY6HHVDFQTRVRQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.849451002 (302h54m8.341883437s) [upload=266387]: Next returned nil segment Sep 11 05:01:47.850308233 (302h54m8.342740675s) [upload=266387]: Waiting for error group managing segments... Sep 11 05:01:47.994127497 (302h54m8.486559926s) [noise=true , address=145.79.227.14:4843 , piece_id=IXNCU3WCMDYAVT6IE4ETEMTKQROPHV4V77VO5TNNZP5ASMW3WJQQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.995677280 (302h54m8.488109717s) [noise=true , address=145.79.227.11:4733 , piece_id=FPN5NMMTUYQHWRQOOYB5RPDKTWHEEWA3CX2OMH233YHTID6MWIFQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.996836577 (302h54m8.489269006s) [noise=true , address=145.79.227.30:4771 , piece_id=SKXNQMX4RW3KCWKY5TMDPUI5QZJXYROJBMV5Y4P7MAUZUGCSUIEA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.997314105 (302h54m8.489746535s) [noise=true , address=145.79.227.13:4815 , piece_id=GBLGYGVE3WCY27XULJK6UYLUUZFPID33MA7X6N62TWHAMVRH3JBQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.997716103 (302h54m8.490148547s) [noise=true , address=145.79.227.36:4524 , piece_id=RSUO6BNALYS7M6W4RJ55UOD35LNCPD26PQDZBCNY6HHVDFQTRVRQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.998369140 (302h54m8.490801569s) [noise=true , address=145.79.227.17:4984 , piece_id=ARCUIGNVITSNKFJYAJQEP24HJVBBBDOZ3FRLUQASEZFN2IXGMPLQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.998606161 (302h54m8.491038597s) [noise=true , address=77.90.31.11:4556 , piece_id=QCYMCO46JRT2K6H46FYCDTZH6RTTL2Q46HOC2VW44IPTZ2W2KQRQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.002273466 (302h54m8.494705902s) [noise=true , address=77.90.31.17:4795 , piece_id=2GUT5J77OOFK3OU6DG5IVXAXCBSV7SZRCXX3TPYZIRMCKGX3JUOQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.006810730 (302h54m8.499243159s) [noise=true , address=145.79.227.12:4770 , piece_id=NYBMVQLHBRCGAK2QQHSZ2BRZN3XAMMJKCRYKS4QWI7ZFH64XEGEA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.011564887 (302h54m8.503997331s) [noise=true , address=145.79.227.33:4884 , piece_id=ZTHSKPCM7ZF5BKF26VRUXLJ2N3KGZYFK6HJTKOHYDUJFFYRR7HDA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.023440869 (302h54m8.515873298s) [noise=true , address=45.91.116.11:4147 , piece_id=BPNZTKMMEXM5B6UQSOLWZTZVVT5UOV2QHPSZL742DHQ3AQ3O6ESA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.085368080 (302h54m8.577800508s) [noise=true , address=145.79.227.37:4589 , piece_id=K4HCLE6PM54ZXJVN5KO626R5UUP32OVEN6DDYIFUM6EYQCRVT7YQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:02:46.754779889 (302h55m7.247212318s) [noise=true , address=145.79.227.5:4240 , piece_id=Q4PEISD7R7IO4BYBWLADEXE6JBUGQ5AY4J3IPX4P3Q6HZBUSYN7Q, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:13SaC5StbguPT3abAT9oTX3mZAyGhJcpAA6b7ueyiDFHa8CCEo, address:145.79.227.5:4240): protocol: rpc: dial tcp 145.79.227.5:4240: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.754831971 (302h55m7.247264401s) [noise=true , address=145.79.227.2:4121 , piece_id=KUVJMQVN5VOZCGW5W4DY5BMLI5IH23GSC2IFN6PH6XEA4OT3VUMA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:1Fq1JNvrZLTFTQLVF8jzyavJ6dU1xX96FTGcyxfaHiPdCLu4pB, address:145.79.227.2:4121): protocol: context deadline exceeded; context deadline exceeded Sep 11 05:02:46.754895261 (302h55m7.247327705s) [noise=true , address=45.91.116.8:4051 , piece_id=PPCINK7K25XXRN3JQPMWVBQVPXXP7UPVSILUGIKWO3OI7EEI42FQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3, address:45.91.116.8:4051): protocol: write tcp 139.59.144.22:38826->45.91.116.8:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.754988069 (302h55m7.247420503s) [noise=true , address=45.91.116.6:4008 , piece_id=PWJH5FFOUVPV64I4FLTGTBCMYLMIYBEZBZBUCI2WJQBKOPR4KABA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:16KXs6ZXZyroRJibAYU5bsga1RFSpmf7yEtaNG7tamaX7QKvng, address:45.91.116.6:4008): protocol: context deadline exceeded; context deadline exceeded Sep 11 05:02:46.755109851 (302h55m7.24754228s) [noise=true , address=45.91.116.6:4984 , piece_id=GQV5UTDPDAYNRXXQH7FL427GSQ5W5BLLOVQIN7NUIQIIIV7AJ4RQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:12VQKskrBadKVwYpngNNeSJPn3knJs7WXtfz9D6syskCDz9EVSt, address:45.91.116.6:4984): protocol: rpc: dial tcp 45.91.116.6:4984: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.755262600 (302h55m7.247695031s) [noise=true , address=145.79.227.32:4854 , piece_id=2YLGSMO4KJ4OTLCQLTFWB6SFEEUPT3X5XKWE7KDQSX7W5LO7FO5Q, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:12eitcwvcNX2GyMiv4GdfDD8wmgb6a1d3ggaGVxbpyKAjPjshmV, address:145.79.227.32:4854): protocol: rpc: dial tcp 145.79.227.32:4854: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.755312278 (302h55m7.247744733s) [seg_pos={0 0}, upload=266387]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Sep 11 05:02:46.866353400 (302h55m7.358785843s) [upload=266387]: Done uploading segments... Sep 11 05:02:46.866397083 (302h55m7.358829529s) [upload=266387]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 2.543535314s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 928.615341ms FAIL (2025-09-11 05:14:06 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 928.662024ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........................................XX...............] duration: 2.551679971s FAIL (2025-09-11 05:14:05 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.551717038s core uplink us-select-1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 525.272037ms target: https://ap1.storj.io/login FAIL (2025-09-11 05:13:50 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: i/o timeout Duration: 525.313271ms core satellite ap1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 2 out of 60 is failed (threshold=3) [............................................XX..............] duration: 332.818132ms target: https://version.storj.io/ FAIL (2025-09-11 05:13:27 UTC) orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: i/o timeout Duration: 332.844027ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 2.359860772s FAIL (2025-09-11 05:13:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== 6387]: Got next segment. Inline: false Sep 11 05:01:47.070094760 (302h54m7.562527201s) [upload=266387]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 05:01:47.070100812 (302h54m7.562533255s) [upload=266387]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 05:01:47.282517324 (302h54m7.774949756s) [seg_pos={0 0}, upload=266387]: Begin upload segment... Sep 11 05:01:47.282586917 (302h54m7.775019351s) [seg_pos={0 0}, upload=266387]: Done begin upload segment. Sep 11 05:01:47.282630874 (302h54m7.775063319s) [noise=true , address=145.79.227.2:4121 , piece_id=KUVJMQVN5VOZCGW5W4DY5BMLI5IH23GSC2IFN6PH6XEA4OT3VUMA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283078686 (302h54m7.775511133s) [noise=true , address=45.91.116.8:4051 , piece_id=PPCINK7K25XXRN3JQPMWVBQVPXXP7UPVSILUGIKWO3OI7EEI42FQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283596723 (302h54m7.776029168s) [noise=true , address=45.91.116.11:4147 , piece_id=BPNZTKMMEXM5B6UQSOLWZTZVVT5UOV2QHPSZL742DHQ3AQ3O6ESA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283956314 (302h54m7.776388767s) [noise=true , address=45.91.116.6:4984 , piece_id=GQV5UTDPDAYNRXXQH7FL427GSQ5W5BLLOVQIN7NUIQIIIV7AJ4RQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284193911 (302h54m7.776626359s) [noise=true , address=145.79.227.13:4815 , piece_id=GBLGYGVE3WCY27XULJK6UYLUUZFPID33MA7X6N62TWHAMVRH3JBQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284732917 (302h54m7.777165362s) [noise=true , address=77.90.31.11:4556 , piece_id=QCYMCO46JRT2K6H46FYCDTZH6RTTL2Q46HOC2VW44IPTZ2W2KQRQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284833471 (302h54m7.77726592s) [noise=true , address=145.79.227.33:4884 , piece_id=ZTHSKPCM7ZF5BKF26VRUXLJ2N3KGZYFK6HJTKOHYDUJFFYRR7HDA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.285523649 (302h54m7.777956091s) [noise=true , address=145.79.227.32:4854 , piece_id=2YLGSMO4KJ4OTLCQLTFWB6SFEEUPT3X5XKWE7KDQSX7W5LO7FO5Q, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.285585257 (302h54m7.778017699s) [noise=true , address=145.79.227.12:4770 , piece_id=NYBMVQLHBRCGAK2QQHSZ2BRZN3XAMMJKCRYKS4QWI7ZFH64XEGEA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.286297044 (302h54m7.778729499s) [noise=true , address=145.79.227.30:4771 , piece_id=SKXNQMX4RW3KCWKY5TMDPUI5QZJXYROJBMV5Y4P7MAUZUGCSUIEA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.286526017 (302h54m7.778958471s) [noise=true , address=145.79.227.5:4240 , piece_id=Q4PEISD7R7IO4BYBWLADEXE6JBUGQ5AY4J3IPX4P3Q6HZBUSYN7Q, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287104751 (302h54m7.779537193s) [noise=true , address=45.91.116.6:4008 , piece_id=PWJH5FFOUVPV64I4FLTGTBCMYLMIYBEZBZBUCI2WJQBKOPR4KABA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287470770 (302h54m7.779903218s) [noise=true , address=145.79.227.17:4984 , piece_id=ARCUIGNVITSNKFJYAJQEP24HJVBBBDOZ3FRLUQASEZFN2IXGMPLQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287613969 (302h54m7.780046423s) [noise=true , address=145.79.227.14:4843 , piece_id=IXNCU3WCMDYAVT6IE4ETEMTKQROPHV4V77VO5TNNZP5ASMW3WJQQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287960566 (302h54m7.780393019s) [noise=true , address=77.90.31.17:4795 , piece_id=2GUT5J77OOFK3OU6DG5IVXAXCBSV7SZRCXX3TPYZIRMCKGX3JUOQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289210694 (302h54m7.781643146s) [noise=true , address=145.79.227.11:4733 , piece_id=FPN5NMMTUYQHWRQOOYB5RPDKTWHEEWA3CX2OMH233YHTID6MWIFQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289586052 (302h54m7.782018502s) [noise=true , address=145.79.227.37:4589 , piece_id=K4HCLE6PM54ZXJVN5KO626R5UUP32OVEN6DDYIFUM6EYQCRVT7YQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289971344 (302h54m7.782403791s) [noise=true , address=145.79.227.36:4524 , piece_id=RSUO6BNALYS7M6W4RJ55UOD35LNCPD26PQDZBCNY6HHVDFQTRVRQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.849451002 (302h54m8.341883437s) [upload=266387]: Next returned nil segment Sep 11 05:01:47.850308233 (302h54m8.342740675s) [upload=266387]: Waiting for error group managing segments... Sep 11 05:01:47.994127497 (302h54m8.486559926s) [noise=true , address=145.79.227.14:4843 , piece_id=IXNCU3WCMDYAVT6IE4ETEMTKQROPHV4V77VO5TNNZP5ASMW3WJQQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.995677280 (302h54m8.488109717s) [noise=true , address=145.79.227.11:4733 , piece_id=FPN5NMMTUYQHWRQOOYB5RPDKTWHEEWA3CX2OMH233YHTID6MWIFQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.996836577 (302h54m8.489269006s) [noise=true , address=145.79.227.30:4771 , piece_id=SKXNQMX4RW3KCWKY5TMDPUI5QZJXYROJBMV5Y4P7MAUZUGCSUIEA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.997314105 (302h54m8.489746535s) [noise=true , address=145.79.227.13:4815 , piece_id=GBLGYGVE3WCY27XULJK6UYLUUZFPID33MA7X6N62TWHAMVRH3JBQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.997716103 (302h54m8.490148547s) [noise=true , address=145.79.227.36:4524 , piece_id=RSUO6BNALYS7M6W4RJ55UOD35LNCPD26PQDZBCNY6HHVDFQTRVRQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.998369140 (302h54m8.490801569s) [noise=true , address=145.79.227.17:4984 , piece_id=ARCUIGNVITSNKFJYAJQEP24HJVBBBDOZ3FRLUQASEZFN2IXGMPLQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.998606161 (302h54m8.491038597s) [noise=true , address=77.90.31.11:4556 , piece_id=QCYMCO46JRT2K6H46FYCDTZH6RTTL2Q46HOC2VW44IPTZ2W2KQRQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.002273466 (302h54m8.494705902s) [noise=true , address=77.90.31.17:4795 , piece_id=2GUT5J77OOFK3OU6DG5IVXAXCBSV7SZRCXX3TPYZIRMCKGX3JUOQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.006810730 (302h54m8.499243159s) [noise=true , address=145.79.227.12:4770 , piece_id=NYBMVQLHBRCGAK2QQHSZ2BRZN3XAMMJKCRYKS4QWI7ZFH64XEGEA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.011564887 (302h54m8.503997331s) [noise=true , address=145.79.227.33:4884 , piece_id=ZTHSKPCM7ZF5BKF26VRUXLJ2N3KGZYFK6HJTKOHYDUJFFYRR7HDA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.023440869 (302h54m8.515873298s) [noise=true , address=45.91.116.11:4147 , piece_id=BPNZTKMMEXM5B6UQSOLWZTZVVT5UOV2QHPSZL742DHQ3AQ3O6ESA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.085368080 (302h54m8.577800508s) [noise=true , address=145.79.227.37:4589 , piece_id=K4HCLE6PM54ZXJVN5KO626R5UUP32OVEN6DDYIFUM6EYQCRVT7YQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:02:46.754779889 (302h55m7.247212318s) [noise=true , address=145.79.227.5:4240 , piece_id=Q4PEISD7R7IO4BYBWLADEXE6JBUGQ5AY4J3IPX4P3Q6HZBUSYN7Q, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:13SaC5StbguPT3abAT9oTX3mZAyGhJcpAA6b7ueyiDFHa8CCEo, address:145.79.227.5:4240): protocol: rpc: dial tcp 145.79.227.5:4240: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.754831971 (302h55m7.247264401s) [noise=true , address=145.79.227.2:4121 , piece_id=KUVJMQVN5VOZCGW5W4DY5BMLI5IH23GSC2IFN6PH6XEA4OT3VUMA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:1Fq1JNvrZLTFTQLVF8jzyavJ6dU1xX96FTGcyxfaHiPdCLu4pB, address:145.79.227.2:4121): protocol: context deadline exceeded; context deadline exceeded Sep 11 05:02:46.754895261 (302h55m7.247327705s) [noise=true , address=45.91.116.8:4051 , piece_id=PPCINK7K25XXRN3JQPMWVBQVPXXP7UPVSILUGIKWO3OI7EEI42FQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3, address:45.91.116.8:4051): protocol: write tcp 139.59.144.22:38826->45.91.116.8:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.754988069 (302h55m7.247420503s) [noise=true , address=45.91.116.6:4008 , piece_id=PWJH5FFOUVPV64I4FLTGTBCMYLMIYBEZBZBUCI2WJQBKOPR4KABA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:16KXs6ZXZyroRJibAYU5bsga1RFSpmf7yEtaNG7tamaX7QKvng, address:45.91.116.6:4008): protocol: context deadline exceeded; context deadline exceeded Sep 11 05:02:46.755109851 (302h55m7.24754228s) [noise=true , address=45.91.116.6:4984 , piece_id=GQV5UTDPDAYNRXXQH7FL427GSQ5W5BLLOVQIN7NUIQIIIV7AJ4RQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:12VQKskrBadKVwYpngNNeSJPn3knJs7WXtfz9D6syskCDz9EVSt, address:45.91.116.6:4984): protocol: rpc: dial tcp 45.91.116.6:4984: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.755262600 (302h55m7.247695031s) [noise=true , address=145.79.227.32:4854 , piece_id=2YLGSMO4KJ4OTLCQLTFWB6SFEEUPT3X5XKWE7KDQSX7W5LO7FO5Q, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:12eitcwvcNX2GyMiv4GdfDD8wmgb6a1d3ggaGVxbpyKAjPjshmV, address:145.79.227.32:4854): protocol: rpc: dial tcp 145.79.227.32:4854: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.755312278 (302h55m7.247744733s) [seg_pos={0 0}, upload=266387]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Sep 11 05:02:46.866353400 (302h55m7.358785843s) [upload=266387]: Done uploading segments... Sep 11 05:02:46.866397083 (302h55m7.358829529s) [upload=266387]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 2.359892173s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [............................................XX..............] duration: 2.469871331s FAIL (2025-09-11 05:13:06 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.469912071s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 1.008207711s FAIL (2025-09-11 05:13:00 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.008233317s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 2.319377676s FAIL (2025-09-11 05:12:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== 6387]: Got next segment. Inline: false Sep 11 05:01:47.070094760 (302h54m7.562527201s) [upload=266387]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 05:01:47.070100812 (302h54m7.562533255s) [upload=266387]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 05:01:47.282517324 (302h54m7.774949756s) [seg_pos={0 0}, upload=266387]: Begin upload segment... Sep 11 05:01:47.282586917 (302h54m7.775019351s) [seg_pos={0 0}, upload=266387]: Done begin upload segment. Sep 11 05:01:47.282630874 (302h54m7.775063319s) [noise=true , address=145.79.227.2:4121 , piece_id=KUVJMQVN5VOZCGW5W4DY5BMLI5IH23GSC2IFN6PH6XEA4OT3VUMA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283078686 (302h54m7.775511133s) [noise=true , address=45.91.116.8:4051 , piece_id=PPCINK7K25XXRN3JQPMWVBQVPXXP7UPVSILUGIKWO3OI7EEI42FQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283596723 (302h54m7.776029168s) [noise=true , address=45.91.116.11:4147 , piece_id=BPNZTKMMEXM5B6UQSOLWZTZVVT5UOV2QHPSZL742DHQ3AQ3O6ESA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283956314 (302h54m7.776388767s) [noise=true , address=45.91.116.6:4984 , piece_id=GQV5UTDPDAYNRXXQH7FL427GSQ5W5BLLOVQIN7NUIQIIIV7AJ4RQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284193911 (302h54m7.776626359s) [noise=true , address=145.79.227.13:4815 , piece_id=GBLGYGVE3WCY27XULJK6UYLUUZFPID33MA7X6N62TWHAMVRH3JBQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284732917 (302h54m7.777165362s) [noise=true , address=77.90.31.11:4556 , piece_id=QCYMCO46JRT2K6H46FYCDTZH6RTTL2Q46HOC2VW44IPTZ2W2KQRQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284833471 (302h54m7.77726592s) [noise=true , address=145.79.227.33:4884 , piece_id=ZTHSKPCM7ZF5BKF26VRUXLJ2N3KGZYFK6HJTKOHYDUJFFYRR7HDA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.285523649 (302h54m7.777956091s) [noise=true , address=145.79.227.32:4854 , piece_id=2YLGSMO4KJ4OTLCQLTFWB6SFEEUPT3X5XKWE7KDQSX7W5LO7FO5Q, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.285585257 (302h54m7.778017699s) [noise=true , address=145.79.227.12:4770 , piece_id=NYBMVQLHBRCGAK2QQHSZ2BRZN3XAMMJKCRYKS4QWI7ZFH64XEGEA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.286297044 (302h54m7.778729499s) [noise=true , address=145.79.227.30:4771 , piece_id=SKXNQMX4RW3KCWKY5TMDPUI5QZJXYROJBMV5Y4P7MAUZUGCSUIEA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.286526017 (302h54m7.778958471s) [noise=true , address=145.79.227.5:4240 , piece_id=Q4PEISD7R7IO4BYBWLADEXE6JBUGQ5AY4J3IPX4P3Q6HZBUSYN7Q, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287104751 (302h54m7.779537193s) [noise=true , address=45.91.116.6:4008 , piece_id=PWJH5FFOUVPV64I4FLTGTBCMYLMIYBEZBZBUCI2WJQBKOPR4KABA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287470770 (302h54m7.779903218s) [noise=true , address=145.79.227.17:4984 , piece_id=ARCUIGNVITSNKFJYAJQEP24HJVBBBDOZ3FRLUQASEZFN2IXGMPLQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287613969 (302h54m7.780046423s) [noise=true , address=145.79.227.14:4843 , piece_id=IXNCU3WCMDYAVT6IE4ETEMTKQROPHV4V77VO5TNNZP5ASMW3WJQQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287960566 (302h54m7.780393019s) [noise=true , address=77.90.31.17:4795 , piece_id=2GUT5J77OOFK3OU6DG5IVXAXCBSV7SZRCXX3TPYZIRMCKGX3JUOQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289210694 (302h54m7.781643146s) [noise=true , address=145.79.227.11:4733 , piece_id=FPN5NMMTUYQHWRQOOYB5RPDKTWHEEWA3CX2OMH233YHTID6MWIFQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289586052 (302h54m7.782018502s) [noise=true , address=145.79.227.37:4589 , piece_id=K4HCLE6PM54ZXJVN5KO626R5UUP32OVEN6DDYIFUM6EYQCRVT7YQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289971344 (302h54m7.782403791s) [noise=true , address=145.79.227.36:4524 , piece_id=RSUO6BNALYS7M6W4RJ55UOD35LNCPD26PQDZBCNY6HHVDFQTRVRQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.849451002 (302h54m8.341883437s) [upload=266387]: Next returned nil segment Sep 11 05:01:47.850308233 (302h54m8.342740675s) [upload=266387]: Waiting for error group managing segments... Sep 11 05:01:47.994127497 (302h54m8.486559926s) [noise=true , address=145.79.227.14:4843 , piece_id=IXNCU3WCMDYAVT6IE4ETEMTKQROPHV4V77VO5TNNZP5ASMW3WJQQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.995677280 (302h54m8.488109717s) [noise=true , address=145.79.227.11:4733 , piece_id=FPN5NMMTUYQHWRQOOYB5RPDKTWHEEWA3CX2OMH233YHTID6MWIFQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.996836577 (302h54m8.489269006s) [noise=true , address=145.79.227.30:4771 , piece_id=SKXNQMX4RW3KCWKY5TMDPUI5QZJXYROJBMV5Y4P7MAUZUGCSUIEA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.997314105 (302h54m8.489746535s) [noise=true , address=145.79.227.13:4815 , piece_id=GBLGYGVE3WCY27XULJK6UYLUUZFPID33MA7X6N62TWHAMVRH3JBQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.997716103 (302h54m8.490148547s) [noise=true , address=145.79.227.36:4524 , piece_id=RSUO6BNALYS7M6W4RJ55UOD35LNCPD26PQDZBCNY6HHVDFQTRVRQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.998369140 (302h54m8.490801569s) [noise=true , address=145.79.227.17:4984 , piece_id=ARCUIGNVITSNKFJYAJQEP24HJVBBBDOZ3FRLUQASEZFN2IXGMPLQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.998606161 (302h54m8.491038597s) [noise=true , address=77.90.31.11:4556 , piece_id=QCYMCO46JRT2K6H46FYCDTZH6RTTL2Q46HOC2VW44IPTZ2W2KQRQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.002273466 (302h54m8.494705902s) [noise=true , address=77.90.31.17:4795 , piece_id=2GUT5J77OOFK3OU6DG5IVXAXCBSV7SZRCXX3TPYZIRMCKGX3JUOQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.006810730 (302h54m8.499243159s) [noise=true , address=145.79.227.12:4770 , piece_id=NYBMVQLHBRCGAK2QQHSZ2BRZN3XAMMJKCRYKS4QWI7ZFH64XEGEA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.011564887 (302h54m8.503997331s) [noise=true , address=145.79.227.33:4884 , piece_id=ZTHSKPCM7ZF5BKF26VRUXLJ2N3KGZYFK6HJTKOHYDUJFFYRR7HDA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.023440869 (302h54m8.515873298s) [noise=true , address=45.91.116.11:4147 , piece_id=BPNZTKMMEXM5B6UQSOLWZTZVVT5UOV2QHPSZL742DHQ3AQ3O6ESA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.085368080 (302h54m8.577800508s) [noise=true , address=145.79.227.37:4589 , piece_id=K4HCLE6PM54ZXJVN5KO626R5UUP32OVEN6DDYIFUM6EYQCRVT7YQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:02:46.754779889 (302h55m7.247212318s) [noise=true , address=145.79.227.5:4240 , piece_id=Q4PEISD7R7IO4BYBWLADEXE6JBUGQ5AY4J3IPX4P3Q6HZBUSYN7Q, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:13SaC5StbguPT3abAT9oTX3mZAyGhJcpAA6b7ueyiDFHa8CCEo, address:145.79.227.5:4240): protocol: rpc: dial tcp 145.79.227.5:4240: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.754831971 (302h55m7.247264401s) [noise=true , address=145.79.227.2:4121 , piece_id=KUVJMQVN5VOZCGW5W4DY5BMLI5IH23GSC2IFN6PH6XEA4OT3VUMA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:1Fq1JNvrZLTFTQLVF8jzyavJ6dU1xX96FTGcyxfaHiPdCLu4pB, address:145.79.227.2:4121): protocol: context deadline exceeded; context deadline exceeded Sep 11 05:02:46.754895261 (302h55m7.247327705s) [noise=true , address=45.91.116.8:4051 , piece_id=PPCINK7K25XXRN3JQPMWVBQVPXXP7UPVSILUGIKWO3OI7EEI42FQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3, address:45.91.116.8:4051): protocol: write tcp 139.59.144.22:38826->45.91.116.8:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.754988069 (302h55m7.247420503s) [noise=true , address=45.91.116.6:4008 , piece_id=PWJH5FFOUVPV64I4FLTGTBCMYLMIYBEZBZBUCI2WJQBKOPR4KABA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:16KXs6ZXZyroRJibAYU5bsga1RFSpmf7yEtaNG7tamaX7QKvng, address:45.91.116.6:4008): protocol: context deadline exceeded; context deadline exceeded Sep 11 05:02:46.755109851 (302h55m7.24754228s) [noise=true , address=45.91.116.6:4984 , piece_id=GQV5UTDPDAYNRXXQH7FL427GSQ5W5BLLOVQIN7NUIQIIIV7AJ4RQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:12VQKskrBadKVwYpngNNeSJPn3knJs7WXtfz9D6syskCDz9EVSt, address:45.91.116.6:4984): protocol: rpc: dial tcp 45.91.116.6:4984: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.755262600 (302h55m7.247695031s) [noise=true , address=145.79.227.32:4854 , piece_id=2YLGSMO4KJ4OTLCQLTFWB6SFEEUPT3X5XKWE7KDQSX7W5LO7FO5Q, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:12eitcwvcNX2GyMiv4GdfDD8wmgb6a1d3ggaGVxbpyKAjPjshmV, address:145.79.227.32:4854): protocol: rpc: dial tcp 145.79.227.32:4854: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.755312278 (302h55m7.247744733s) [seg_pos={0 0}, upload=266387]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Sep 11 05:02:46.866353400 (302h55m7.358785843s) [upload=266387]: Done uploading segments... Sep 11 05:02:46.866397083 (302h55m7.358829529s) [upload=266387]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 2.319409145s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 522.127937ms target: https://ap1.storj.io/login FAIL (2025-09-11 05:12:42 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: i/o timeout Duration: 522.146962ms core satellite ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............................................XX.............] duration: 2.715952575s FAIL (2025-09-11 05:12:29 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.715982534s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 2 out of 60 is failed (threshold=3) [.............................................XX.............] duration: 332.4185ms target: https://version.storj.io/ FAIL (2025-09-11 05:12:18 UTC) orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: i/o timeout Duration: 332.450725ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 947.459436ms FAIL (2025-09-11 05:12:16 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 947.502517ms core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 523.890991ms target: https://ap1.storj.io/login FAIL (2025-09-11 05:12:01 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: i/o timeout Duration: 523.924644ms core satellite ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.499409246s FAIL (2025-09-11 05:11:49 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== 6387]: Got next segment. Inline: false Sep 11 05:01:47.070094760 (302h54m7.562527201s) [upload=266387]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 05:01:47.070100812 (302h54m7.562533255s) [upload=266387]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 05:01:47.282517324 (302h54m7.774949756s) [seg_pos={0 0}, upload=266387]: Begin upload segment... Sep 11 05:01:47.282586917 (302h54m7.775019351s) [seg_pos={0 0}, upload=266387]: Done begin upload segment. Sep 11 05:01:47.282630874 (302h54m7.775063319s) [noise=true , address=145.79.227.2:4121 , piece_id=KUVJMQVN5VOZCGW5W4DY5BMLI5IH23GSC2IFN6PH6XEA4OT3VUMA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283078686 (302h54m7.775511133s) [noise=true , address=45.91.116.8:4051 , piece_id=PPCINK7K25XXRN3JQPMWVBQVPXXP7UPVSILUGIKWO3OI7EEI42FQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283596723 (302h54m7.776029168s) [noise=true , address=45.91.116.11:4147 , piece_id=BPNZTKMMEXM5B6UQSOLWZTZVVT5UOV2QHPSZL742DHQ3AQ3O6ESA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283956314 (302h54m7.776388767s) [noise=true , address=45.91.116.6:4984 , piece_id=GQV5UTDPDAYNRXXQH7FL427GSQ5W5BLLOVQIN7NUIQIIIV7AJ4RQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284193911 (302h54m7.776626359s) [noise=true , address=145.79.227.13:4815 , piece_id=GBLGYGVE3WCY27XULJK6UYLUUZFPID33MA7X6N62TWHAMVRH3JBQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284732917 (302h54m7.777165362s) [noise=true , address=77.90.31.11:4556 , piece_id=QCYMCO46JRT2K6H46FYCDTZH6RTTL2Q46HOC2VW44IPTZ2W2KQRQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284833471 (302h54m7.77726592s) [noise=true , address=145.79.227.33:4884 , piece_id=ZTHSKPCM7ZF5BKF26VRUXLJ2N3KGZYFK6HJTKOHYDUJFFYRR7HDA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.285523649 (302h54m7.777956091s) [noise=true , address=145.79.227.32:4854 , piece_id=2YLGSMO4KJ4OTLCQLTFWB6SFEEUPT3X5XKWE7KDQSX7W5LO7FO5Q, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.285585257 (302h54m7.778017699s) [noise=true , address=145.79.227.12:4770 , piece_id=NYBMVQLHBRCGAK2QQHSZ2BRZN3XAMMJKCRYKS4QWI7ZFH64XEGEA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.286297044 (302h54m7.778729499s) [noise=true , address=145.79.227.30:4771 , piece_id=SKXNQMX4RW3KCWKY5TMDPUI5QZJXYROJBMV5Y4P7MAUZUGCSUIEA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.286526017 (302h54m7.778958471s) [noise=true , address=145.79.227.5:4240 , piece_id=Q4PEISD7R7IO4BYBWLADEXE6JBUGQ5AY4J3IPX4P3Q6HZBUSYN7Q, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287104751 (302h54m7.779537193s) [noise=true , address=45.91.116.6:4008 , piece_id=PWJH5FFOUVPV64I4FLTGTBCMYLMIYBEZBZBUCI2WJQBKOPR4KABA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287470770 (302h54m7.779903218s) [noise=true , address=145.79.227.17:4984 , piece_id=ARCUIGNVITSNKFJYAJQEP24HJVBBBDOZ3FRLUQASEZFN2IXGMPLQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287613969 (302h54m7.780046423s) [noise=true , address=145.79.227.14:4843 , piece_id=IXNCU3WCMDYAVT6IE4ETEMTKQROPHV4V77VO5TNNZP5ASMW3WJQQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287960566 (302h54m7.780393019s) [noise=true , address=77.90.31.17:4795 , piece_id=2GUT5J77OOFK3OU6DG5IVXAXCBSV7SZRCXX3TPYZIRMCKGX3JUOQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289210694 (302h54m7.781643146s) [noise=true , address=145.79.227.11:4733 , piece_id=FPN5NMMTUYQHWRQOOYB5RPDKTWHEEWA3CX2OMH233YHTID6MWIFQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289586052 (302h54m7.782018502s) [noise=true , address=145.79.227.37:4589 , piece_id=K4HCLE6PM54ZXJVN5KO626R5UUP32OVEN6DDYIFUM6EYQCRVT7YQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289971344 (302h54m7.782403791s) [noise=true , address=145.79.227.36:4524 , piece_id=RSUO6BNALYS7M6W4RJ55UOD35LNCPD26PQDZBCNY6HHVDFQTRVRQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.849451002 (302h54m8.341883437s) [upload=266387]: Next returned nil segment Sep 11 05:01:47.850308233 (302h54m8.342740675s) [upload=266387]: Waiting for error group managing segments... Sep 11 05:01:47.994127497 (302h54m8.486559926s) [noise=true , address=145.79.227.14:4843 , piece_id=IXNCU3WCMDYAVT6IE4ETEMTKQROPHV4V77VO5TNNZP5ASMW3WJQQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.995677280 (302h54m8.488109717s) [noise=true , address=145.79.227.11:4733 , piece_id=FPN5NMMTUYQHWRQOOYB5RPDKTWHEEWA3CX2OMH233YHTID6MWIFQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.996836577 (302h54m8.489269006s) [noise=true , address=145.79.227.30:4771 , piece_id=SKXNQMX4RW3KCWKY5TMDPUI5QZJXYROJBMV5Y4P7MAUZUGCSUIEA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.997314105 (302h54m8.489746535s) [noise=true , address=145.79.227.13:4815 , piece_id=GBLGYGVE3WCY27XULJK6UYLUUZFPID33MA7X6N62TWHAMVRH3JBQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.997716103 (302h54m8.490148547s) [noise=true , address=145.79.227.36:4524 , piece_id=RSUO6BNALYS7M6W4RJ55UOD35LNCPD26PQDZBCNY6HHVDFQTRVRQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.998369140 (302h54m8.490801569s) [noise=true , address=145.79.227.17:4984 , piece_id=ARCUIGNVITSNKFJYAJQEP24HJVBBBDOZ3FRLUQASEZFN2IXGMPLQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.998606161 (302h54m8.491038597s) [noise=true , address=77.90.31.11:4556 , piece_id=QCYMCO46JRT2K6H46FYCDTZH6RTTL2Q46HOC2VW44IPTZ2W2KQRQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.002273466 (302h54m8.494705902s) [noise=true , address=77.90.31.17:4795 , piece_id=2GUT5J77OOFK3OU6DG5IVXAXCBSV7SZRCXX3TPYZIRMCKGX3JUOQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.006810730 (302h54m8.499243159s) [noise=true , address=145.79.227.12:4770 , piece_id=NYBMVQLHBRCGAK2QQHSZ2BRZN3XAMMJKCRYKS4QWI7ZFH64XEGEA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.011564887 (302h54m8.503997331s) [noise=true , address=145.79.227.33:4884 , piece_id=ZTHSKPCM7ZF5BKF26VRUXLJ2N3KGZYFK6HJTKOHYDUJFFYRR7HDA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.023440869 (302h54m8.515873298s) [noise=true , address=45.91.116.11:4147 , piece_id=BPNZTKMMEXM5B6UQSOLWZTZVVT5UOV2QHPSZL742DHQ3AQ3O6ESA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.085368080 (302h54m8.577800508s) [noise=true , address=145.79.227.37:4589 , piece_id=K4HCLE6PM54ZXJVN5KO626R5UUP32OVEN6DDYIFUM6EYQCRVT7YQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:02:46.754779889 (302h55m7.247212318s) [noise=true , address=145.79.227.5:4240 , piece_id=Q4PEISD7R7IO4BYBWLADEXE6JBUGQ5AY4J3IPX4P3Q6HZBUSYN7Q, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:13SaC5StbguPT3abAT9oTX3mZAyGhJcpAA6b7ueyiDFHa8CCEo, address:145.79.227.5:4240): protocol: rpc: dial tcp 145.79.227.5:4240: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.754831971 (302h55m7.247264401s) [noise=true , address=145.79.227.2:4121 , piece_id=KUVJMQVN5VOZCGW5W4DY5BMLI5IH23GSC2IFN6PH6XEA4OT3VUMA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:1Fq1JNvrZLTFTQLVF8jzyavJ6dU1xX96FTGcyxfaHiPdCLu4pB, address:145.79.227.2:4121): protocol: context deadline exceeded; context deadline exceeded Sep 11 05:02:46.754895261 (302h55m7.247327705s) [noise=true , address=45.91.116.8:4051 , piece_id=PPCINK7K25XXRN3JQPMWVBQVPXXP7UPVSILUGIKWO3OI7EEI42FQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3, address:45.91.116.8:4051): protocol: write tcp 139.59.144.22:38826->45.91.116.8:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.754988069 (302h55m7.247420503s) [noise=true , address=45.91.116.6:4008 , piece_id=PWJH5FFOUVPV64I4FLTGTBCMYLMIYBEZBZBUCI2WJQBKOPR4KABA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:16KXs6ZXZyroRJibAYU5bsga1RFSpmf7yEtaNG7tamaX7QKvng, address:45.91.116.6:4008): protocol: context deadline exceeded; context deadline exceeded Sep 11 05:02:46.755109851 (302h55m7.24754228s) [noise=true , address=45.91.116.6:4984 , piece_id=GQV5UTDPDAYNRXXQH7FL427GSQ5W5BLLOVQIN7NUIQIIIV7AJ4RQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:12VQKskrBadKVwYpngNNeSJPn3knJs7WXtfz9D6syskCDz9EVSt, address:45.91.116.6:4984): protocol: rpc: dial tcp 45.91.116.6:4984: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.755262600 (302h55m7.247695031s) [noise=true , address=145.79.227.32:4854 , piece_id=2YLGSMO4KJ4OTLCQLTFWB6SFEEUPT3X5XKWE7KDQSX7W5LO7FO5Q, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:12eitcwvcNX2GyMiv4GdfDD8wmgb6a1d3ggaGVxbpyKAjPjshmV, address:145.79.227.32:4854): protocol: rpc: dial tcp 145.79.227.32:4854: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.755312278 (302h55m7.247744733s) [seg_pos={0 0}, upload=266387]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Sep 11 05:02:46.866353400 (302h55m7.358785843s) [upload=266387]: Done uploading segments... Sep 11 05:02:46.866397083 (302h55m7.358829529s) [upload=266387]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 2.499466693s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............................................XX............] duration: 2.439718885s FAIL (2025-09-11 05:11:34 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.439753614s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 2 out of 60 is failed (threshold=3) [..............................................XX............] duration: 336.432942ms target: https://version.storj.io/ FAIL (2025-09-11 05:11:30 UTC) orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: i/o timeout Duration: 336.459361ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 2.501973466s FAIL (2025-09-11 05:11:17 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== 6387]: Got next segment. Inline: false Sep 11 05:01:47.070094760 (302h54m7.562527201s) [upload=266387]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 05:01:47.070100812 (302h54m7.562533255s) [upload=266387]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 05:01:47.282517324 (302h54m7.774949756s) [seg_pos={0 0}, upload=266387]: Begin upload segment... Sep 11 05:01:47.282586917 (302h54m7.775019351s) [seg_pos={0 0}, upload=266387]: Done begin upload segment. Sep 11 05:01:47.282630874 (302h54m7.775063319s) [noise=true , address=145.79.227.2:4121 , piece_id=KUVJMQVN5VOZCGW5W4DY5BMLI5IH23GSC2IFN6PH6XEA4OT3VUMA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283078686 (302h54m7.775511133s) [noise=true , address=45.91.116.8:4051 , piece_id=PPCINK7K25XXRN3JQPMWVBQVPXXP7UPVSILUGIKWO3OI7EEI42FQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283596723 (302h54m7.776029168s) [noise=true , address=45.91.116.11:4147 , piece_id=BPNZTKMMEXM5B6UQSOLWZTZVVT5UOV2QHPSZL742DHQ3AQ3O6ESA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283956314 (302h54m7.776388767s) [noise=true , address=45.91.116.6:4984 , piece_id=GQV5UTDPDAYNRXXQH7FL427GSQ5W5BLLOVQIN7NUIQIIIV7AJ4RQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284193911 (302h54m7.776626359s) [noise=true , address=145.79.227.13:4815 , piece_id=GBLGYGVE3WCY27XULJK6UYLUUZFPID33MA7X6N62TWHAMVRH3JBQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284732917 (302h54m7.777165362s) [noise=true , address=77.90.31.11:4556 , piece_id=QCYMCO46JRT2K6H46FYCDTZH6RTTL2Q46HOC2VW44IPTZ2W2KQRQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284833471 (302h54m7.77726592s) [noise=true , address=145.79.227.33:4884 , piece_id=ZTHSKPCM7ZF5BKF26VRUXLJ2N3KGZYFK6HJTKOHYDUJFFYRR7HDA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.285523649 (302h54m7.777956091s) [noise=true , address=145.79.227.32:4854 , piece_id=2YLGSMO4KJ4OTLCQLTFWB6SFEEUPT3X5XKWE7KDQSX7W5LO7FO5Q, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.285585257 (302h54m7.778017699s) [noise=true , address=145.79.227.12:4770 , piece_id=NYBMVQLHBRCGAK2QQHSZ2BRZN3XAMMJKCRYKS4QWI7ZFH64XEGEA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.286297044 (302h54m7.778729499s) [noise=true , address=145.79.227.30:4771 , piece_id=SKXNQMX4RW3KCWKY5TMDPUI5QZJXYROJBMV5Y4P7MAUZUGCSUIEA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.286526017 (302h54m7.778958471s) [noise=true , address=145.79.227.5:4240 , piece_id=Q4PEISD7R7IO4BYBWLADEXE6JBUGQ5AY4J3IPX4P3Q6HZBUSYN7Q, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287104751 (302h54m7.779537193s) [noise=true , address=45.91.116.6:4008 , piece_id=PWJH5FFOUVPV64I4FLTGTBCMYLMIYBEZBZBUCI2WJQBKOPR4KABA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287470770 (302h54m7.779903218s) [noise=true , address=145.79.227.17:4984 , piece_id=ARCUIGNVITSNKFJYAJQEP24HJVBBBDOZ3FRLUQASEZFN2IXGMPLQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287613969 (302h54m7.780046423s) [noise=true , address=145.79.227.14:4843 , piece_id=IXNCU3WCMDYAVT6IE4ETEMTKQROPHV4V77VO5TNNZP5ASMW3WJQQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287960566 (302h54m7.780393019s) [noise=true , address=77.90.31.17:4795 , piece_id=2GUT5J77OOFK3OU6DG5IVXAXCBSV7SZRCXX3TPYZIRMCKGX3JUOQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289210694 (302h54m7.781643146s) [noise=true , address=145.79.227.11:4733 , piece_id=FPN5NMMTUYQHWRQOOYB5RPDKTWHEEWA3CX2OMH233YHTID6MWIFQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289586052 (302h54m7.782018502s) [noise=true , address=145.79.227.37:4589 , piece_id=K4HCLE6PM54ZXJVN5KO626R5UUP32OVEN6DDYIFUM6EYQCRVT7YQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289971344 (302h54m7.782403791s) [noise=true , address=145.79.227.36:4524 , piece_id=RSUO6BNALYS7M6W4RJ55UOD35LNCPD26PQDZBCNY6HHVDFQTRVRQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.849451002 (302h54m8.341883437s) [upload=266387]: Next returned nil segment Sep 11 05:01:47.850308233 (302h54m8.342740675s) [upload=266387]: Waiting for error group managing segments... Sep 11 05:01:47.994127497 (302h54m8.486559926s) [noise=true , address=145.79.227.14:4843 , piece_id=IXNCU3WCMDYAVT6IE4ETEMTKQROPHV4V77VO5TNNZP5ASMW3WJQQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.995677280 (302h54m8.488109717s) [noise=true , address=145.79.227.11:4733 , piece_id=FPN5NMMTUYQHWRQOOYB5RPDKTWHEEWA3CX2OMH233YHTID6MWIFQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.996836577 (302h54m8.489269006s) [noise=true , address=145.79.227.30:4771 , piece_id=SKXNQMX4RW3KCWKY5TMDPUI5QZJXYROJBMV5Y4P7MAUZUGCSUIEA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.997314105 (302h54m8.489746535s) [noise=true , address=145.79.227.13:4815 , piece_id=GBLGYGVE3WCY27XULJK6UYLUUZFPID33MA7X6N62TWHAMVRH3JBQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.997716103 (302h54m8.490148547s) [noise=true , address=145.79.227.36:4524 , piece_id=RSUO6BNALYS7M6W4RJ55UOD35LNCPD26PQDZBCNY6HHVDFQTRVRQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.998369140 (302h54m8.490801569s) [noise=true , address=145.79.227.17:4984 , piece_id=ARCUIGNVITSNKFJYAJQEP24HJVBBBDOZ3FRLUQASEZFN2IXGMPLQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.998606161 (302h54m8.491038597s) [noise=true , address=77.90.31.11:4556 , piece_id=QCYMCO46JRT2K6H46FYCDTZH6RTTL2Q46HOC2VW44IPTZ2W2KQRQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.002273466 (302h54m8.494705902s) [noise=true , address=77.90.31.17:4795 , piece_id=2GUT5J77OOFK3OU6DG5IVXAXCBSV7SZRCXX3TPYZIRMCKGX3JUOQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.006810730 (302h54m8.499243159s) [noise=true , address=145.79.227.12:4770 , piece_id=NYBMVQLHBRCGAK2QQHSZ2BRZN3XAMMJKCRYKS4QWI7ZFH64XEGEA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.011564887 (302h54m8.503997331s) [noise=true , address=145.79.227.33:4884 , piece_id=ZTHSKPCM7ZF5BKF26VRUXLJ2N3KGZYFK6HJTKOHYDUJFFYRR7HDA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.023440869 (302h54m8.515873298s) [noise=true , address=45.91.116.11:4147 , piece_id=BPNZTKMMEXM5B6UQSOLWZTZVVT5UOV2QHPSZL742DHQ3AQ3O6ESA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.085368080 (302h54m8.577800508s) [noise=true , address=145.79.227.37:4589 , piece_id=K4HCLE6PM54ZXJVN5KO626R5UUP32OVEN6DDYIFUM6EYQCRVT7YQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:02:46.754779889 (302h55m7.247212318s) [noise=true , address=145.79.227.5:4240 , piece_id=Q4PEISD7R7IO4BYBWLADEXE6JBUGQ5AY4J3IPX4P3Q6HZBUSYN7Q, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:13SaC5StbguPT3abAT9oTX3mZAyGhJcpAA6b7ueyiDFHa8CCEo, address:145.79.227.5:4240): protocol: rpc: dial tcp 145.79.227.5:4240: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.754831971 (302h55m7.247264401s) [noise=true , address=145.79.227.2:4121 , piece_id=KUVJMQVN5VOZCGW5W4DY5BMLI5IH23GSC2IFN6PH6XEA4OT3VUMA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:1Fq1JNvrZLTFTQLVF8jzyavJ6dU1xX96FTGcyxfaHiPdCLu4pB, address:145.79.227.2:4121): protocol: context deadline exceeded; context deadline exceeded Sep 11 05:02:46.754895261 (302h55m7.247327705s) [noise=true , address=45.91.116.8:4051 , piece_id=PPCINK7K25XXRN3JQPMWVBQVPXXP7UPVSILUGIKWO3OI7EEI42FQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3, address:45.91.116.8:4051): protocol: write tcp 139.59.144.22:38826->45.91.116.8:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.754988069 (302h55m7.247420503s) [noise=true , address=45.91.116.6:4008 , piece_id=PWJH5FFOUVPV64I4FLTGTBCMYLMIYBEZBZBUCI2WJQBKOPR4KABA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:16KXs6ZXZyroRJibAYU5bsga1RFSpmf7yEtaNG7tamaX7QKvng, address:45.91.116.6:4008): protocol: context deadline exceeded; context deadline exceeded Sep 11 05:02:46.755109851 (302h55m7.24754228s) [noise=true , address=45.91.116.6:4984 , piece_id=GQV5UTDPDAYNRXXQH7FL427GSQ5W5BLLOVQIN7NUIQIIIV7AJ4RQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:12VQKskrBadKVwYpngNNeSJPn3knJs7WXtfz9D6syskCDz9EVSt, address:45.91.116.6:4984): protocol: rpc: dial tcp 45.91.116.6:4984: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.755262600 (302h55m7.247695031s) [noise=true , address=145.79.227.32:4854 , piece_id=2YLGSMO4KJ4OTLCQLTFWB6SFEEUPT3X5XKWE7KDQSX7W5LO7FO5Q, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:12eitcwvcNX2GyMiv4GdfDD8wmgb6a1d3ggaGVxbpyKAjPjshmV, address:145.79.227.32:4854): protocol: rpc: dial tcp 145.79.227.32:4854: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.755312278 (302h55m7.247744733s) [seg_pos={0 0}, upload=266387]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Sep 11 05:02:46.866353400 (302h55m7.358785843s) [upload=266387]: Done uploading segments... Sep 11 05:02:46.866397083 (302h55m7.358829529s) [upload=266387]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 2.502009639s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 522.693584ms target: https://ap1.storj.io/login FAIL (2025-09-11 05:11:03 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: i/o timeout Duration: 522.755352ms core satellite ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 975.416501ms FAIL (2025-09-11 05:11:02 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 975.445454ms core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 2 out of 60 is failed (threshold=3) [...............................................XX...........] duration: 338.778433ms target: https://version.storj.io/ FAIL (2025-09-11 05:10:56 UTC) orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: i/o timeout Duration: 338.804943ms core website
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 487.417874ms target: https://ap1.storj.io/login FAIL (2025-09-11 05:10:30 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: i/o timeout Duration: 487.446492ms core satellite ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............................................XX...........] duration: 2.524181937s FAIL (2025-09-11 05:10:20 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.524216993s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 1.130754017s FAIL (2025-09-11 05:10:20 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.130783407s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.611006227s FAIL (2025-09-11 05:10:06 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== 6387]: Got next segment. Inline: false Sep 11 05:01:47.070094760 (302h54m7.562527201s) [upload=266387]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 05:01:47.070100812 (302h54m7.562533255s) [upload=266387]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 05:01:47.282517324 (302h54m7.774949756s) [seg_pos={0 0}, upload=266387]: Begin upload segment... Sep 11 05:01:47.282586917 (302h54m7.775019351s) [seg_pos={0 0}, upload=266387]: Done begin upload segment. Sep 11 05:01:47.282630874 (302h54m7.775063319s) [noise=true , address=145.79.227.2:4121 , piece_id=KUVJMQVN5VOZCGW5W4DY5BMLI5IH23GSC2IFN6PH6XEA4OT3VUMA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283078686 (302h54m7.775511133s) [noise=true , address=45.91.116.8:4051 , piece_id=PPCINK7K25XXRN3JQPMWVBQVPXXP7UPVSILUGIKWO3OI7EEI42FQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283596723 (302h54m7.776029168s) [noise=true , address=45.91.116.11:4147 , piece_id=BPNZTKMMEXM5B6UQSOLWZTZVVT5UOV2QHPSZL742DHQ3AQ3O6ESA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283956314 (302h54m7.776388767s) [noise=true , address=45.91.116.6:4984 , piece_id=GQV5UTDPDAYNRXXQH7FL427GSQ5W5BLLOVQIN7NUIQIIIV7AJ4RQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284193911 (302h54m7.776626359s) [noise=true , address=145.79.227.13:4815 , piece_id=GBLGYGVE3WCY27XULJK6UYLUUZFPID33MA7X6N62TWHAMVRH3JBQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284732917 (302h54m7.777165362s) [noise=true , address=77.90.31.11:4556 , piece_id=QCYMCO46JRT2K6H46FYCDTZH6RTTL2Q46HOC2VW44IPTZ2W2KQRQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284833471 (302h54m7.77726592s) [noise=true , address=145.79.227.33:4884 , piece_id=ZTHSKPCM7ZF5BKF26VRUXLJ2N3KGZYFK6HJTKOHYDUJFFYRR7HDA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.285523649 (302h54m7.777956091s) [noise=true , address=145.79.227.32:4854 , piece_id=2YLGSMO4KJ4OTLCQLTFWB6SFEEUPT3X5XKWE7KDQSX7W5LO7FO5Q, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.285585257 (302h54m7.778017699s) [noise=true , address=145.79.227.12:4770 , piece_id=NYBMVQLHBRCGAK2QQHSZ2BRZN3XAMMJKCRYKS4QWI7ZFH64XEGEA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.286297044 (302h54m7.778729499s) [noise=true , address=145.79.227.30:4771 , piece_id=SKXNQMX4RW3KCWKY5TMDPUI5QZJXYROJBMV5Y4P7MAUZUGCSUIEA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.286526017 (302h54m7.778958471s) [noise=true , address=145.79.227.5:4240 , piece_id=Q4PEISD7R7IO4BYBWLADEXE6JBUGQ5AY4J3IPX4P3Q6HZBUSYN7Q, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287104751 (302h54m7.779537193s) [noise=true , address=45.91.116.6:4008 , piece_id=PWJH5FFOUVPV64I4FLTGTBCMYLMIYBEZBZBUCI2WJQBKOPR4KABA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287470770 (302h54m7.779903218s) [noise=true , address=145.79.227.17:4984 , piece_id=ARCUIGNVITSNKFJYAJQEP24HJVBBBDOZ3FRLUQASEZFN2IXGMPLQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287613969 (302h54m7.780046423s) [noise=true , address=145.79.227.14:4843 , piece_id=IXNCU3WCMDYAVT6IE4ETEMTKQROPHV4V77VO5TNNZP5ASMW3WJQQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287960566 (302h54m7.780393019s) [noise=true , address=77.90.31.17:4795 , piece_id=2GUT5J77OOFK3OU6DG5IVXAXCBSV7SZRCXX3TPYZIRMCKGX3JUOQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289210694 (302h54m7.781643146s) [noise=true , address=145.79.227.11:4733 , piece_id=FPN5NMMTUYQHWRQOOYB5RPDKTWHEEWA3CX2OMH233YHTID6MWIFQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289586052 (302h54m7.782018502s) [noise=true , address=145.79.227.37:4589 , piece_id=K4HCLE6PM54ZXJVN5KO626R5UUP32OVEN6DDYIFUM6EYQCRVT7YQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289971344 (302h54m7.782403791s) [noise=true , address=145.79.227.36:4524 , piece_id=RSUO6BNALYS7M6W4RJ55UOD35LNCPD26PQDZBCNY6HHVDFQTRVRQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.849451002 (302h54m8.341883437s) [upload=266387]: Next returned nil segment Sep 11 05:01:47.850308233 (302h54m8.342740675s) [upload=266387]: Waiting for error group managing segments... Sep 11 05:01:47.994127497 (302h54m8.486559926s) [noise=true , address=145.79.227.14:4843 , piece_id=IXNCU3WCMDYAVT6IE4ETEMTKQROPHV4V77VO5TNNZP5ASMW3WJQQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.995677280 (302h54m8.488109717s) [noise=true , address=145.79.227.11:4733 , piece_id=FPN5NMMTUYQHWRQOOYB5RPDKTWHEEWA3CX2OMH233YHTID6MWIFQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.996836577 (302h54m8.489269006s) [noise=true , address=145.79.227.30:4771 , piece_id=SKXNQMX4RW3KCWKY5TMDPUI5QZJXYROJBMV5Y4P7MAUZUGCSUIEA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.997314105 (302h54m8.489746535s) [noise=true , address=145.79.227.13:4815 , piece_id=GBLGYGVE3WCY27XULJK6UYLUUZFPID33MA7X6N62TWHAMVRH3JBQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.997716103 (302h54m8.490148547s) [noise=true , address=145.79.227.36:4524 , piece_id=RSUO6BNALYS7M6W4RJ55UOD35LNCPD26PQDZBCNY6HHVDFQTRVRQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.998369140 (302h54m8.490801569s) [noise=true , address=145.79.227.17:4984 , piece_id=ARCUIGNVITSNKFJYAJQEP24HJVBBBDOZ3FRLUQASEZFN2IXGMPLQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.998606161 (302h54m8.491038597s) [noise=true , address=77.90.31.11:4556 , piece_id=QCYMCO46JRT2K6H46FYCDTZH6RTTL2Q46HOC2VW44IPTZ2W2KQRQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.002273466 (302h54m8.494705902s) [noise=true , address=77.90.31.17:4795 , piece_id=2GUT5J77OOFK3OU6DG5IVXAXCBSV7SZRCXX3TPYZIRMCKGX3JUOQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.006810730 (302h54m8.499243159s) [noise=true , address=145.79.227.12:4770 , piece_id=NYBMVQLHBRCGAK2QQHSZ2BRZN3XAMMJKCRYKS4QWI7ZFH64XEGEA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.011564887 (302h54m8.503997331s) [noise=true , address=145.79.227.33:4884 , piece_id=ZTHSKPCM7ZF5BKF26VRUXLJ2N3KGZYFK6HJTKOHYDUJFFYRR7HDA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.023440869 (302h54m8.515873298s) [noise=true , address=45.91.116.11:4147 , piece_id=BPNZTKMMEXM5B6UQSOLWZTZVVT5UOV2QHPSZL742DHQ3AQ3O6ESA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.085368080 (302h54m8.577800508s) [noise=true , address=145.79.227.37:4589 , piece_id=K4HCLE6PM54ZXJVN5KO626R5UUP32OVEN6DDYIFUM6EYQCRVT7YQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:02:46.754779889 (302h55m7.247212318s) [noise=true , address=145.79.227.5:4240 , piece_id=Q4PEISD7R7IO4BYBWLADEXE6JBUGQ5AY4J3IPX4P3Q6HZBUSYN7Q, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:13SaC5StbguPT3abAT9oTX3mZAyGhJcpAA6b7ueyiDFHa8CCEo, address:145.79.227.5:4240): protocol: rpc: dial tcp 145.79.227.5:4240: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.754831971 (302h55m7.247264401s) [noise=true , address=145.79.227.2:4121 , piece_id=KUVJMQVN5VOZCGW5W4DY5BMLI5IH23GSC2IFN6PH6XEA4OT3VUMA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:1Fq1JNvrZLTFTQLVF8jzyavJ6dU1xX96FTGcyxfaHiPdCLu4pB, address:145.79.227.2:4121): protocol: context deadline exceeded; context deadline exceeded Sep 11 05:02:46.754895261 (302h55m7.247327705s) [noise=true , address=45.91.116.8:4051 , piece_id=PPCINK7K25XXRN3JQPMWVBQVPXXP7UPVSILUGIKWO3OI7EEI42FQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3, address:45.91.116.8:4051): protocol: write tcp 139.59.144.22:38826->45.91.116.8:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.754988069 (302h55m7.247420503s) [noise=true , address=45.91.116.6:4008 , piece_id=PWJH5FFOUVPV64I4FLTGTBCMYLMIYBEZBZBUCI2WJQBKOPR4KABA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:16KXs6ZXZyroRJibAYU5bsga1RFSpmf7yEtaNG7tamaX7QKvng, address:45.91.116.6:4008): protocol: context deadline exceeded; context deadline exceeded Sep 11 05:02:46.755109851 (302h55m7.24754228s) [noise=true , address=45.91.116.6:4984 , piece_id=GQV5UTDPDAYNRXXQH7FL427GSQ5W5BLLOVQIN7NUIQIIIV7AJ4RQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:12VQKskrBadKVwYpngNNeSJPn3knJs7WXtfz9D6syskCDz9EVSt, address:45.91.116.6:4984): protocol: rpc: dial tcp 45.91.116.6:4984: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.755262600 (302h55m7.247695031s) [noise=true , address=145.79.227.32:4854 , piece_id=2YLGSMO4KJ4OTLCQLTFWB6SFEEUPT3X5XKWE7KDQSX7W5LO7FO5Q, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:12eitcwvcNX2GyMiv4GdfDD8wmgb6a1d3ggaGVxbpyKAjPjshmV, address:145.79.227.32:4854): protocol: rpc: dial tcp 145.79.227.32:4854: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.755312278 (302h55m7.247744733s) [seg_pos={0 0}, upload=266387]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Sep 11 05:02:46.866353400 (302h55m7.358785843s) [upload=266387]: Done uploading segments... Sep 11 05:02:46.866397083 (302h55m7.358829529s) [upload=266387]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 2.61107013s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 2 out of 60 is failed (threshold=3) [................................................XX..........] duration: 369.7893ms target: https://version.storj.io/ FAIL (2025-09-11 05:10:04 UTC) orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: i/o timeout Duration: 369.876426ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 931.257267ms FAIL (2025-09-11 05:09:57 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 931.286996ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 990.080503ms FAIL (2025-09-11 05:09:42 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 990.115223ms core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 512.262228ms target: https://ap1.storj.io/login FAIL (2025-09-11 05:09:36 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: i/o timeout Duration: 512.285273ms core satellite ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 2.466637012s FAIL (2025-09-11 05:09:33 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== 6387]: Got next segment. Inline: false Sep 11 05:01:47.070094760 (302h54m7.562527201s) [upload=266387]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 05:01:47.070100812 (302h54m7.562533255s) [upload=266387]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 05:01:47.282517324 (302h54m7.774949756s) [seg_pos={0 0}, upload=266387]: Begin upload segment... Sep 11 05:01:47.282586917 (302h54m7.775019351s) [seg_pos={0 0}, upload=266387]: Done begin upload segment. Sep 11 05:01:47.282630874 (302h54m7.775063319s) [noise=true , address=145.79.227.2:4121 , piece_id=KUVJMQVN5VOZCGW5W4DY5BMLI5IH23GSC2IFN6PH6XEA4OT3VUMA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283078686 (302h54m7.775511133s) [noise=true , address=45.91.116.8:4051 , piece_id=PPCINK7K25XXRN3JQPMWVBQVPXXP7UPVSILUGIKWO3OI7EEI42FQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283596723 (302h54m7.776029168s) [noise=true , address=45.91.116.11:4147 , piece_id=BPNZTKMMEXM5B6UQSOLWZTZVVT5UOV2QHPSZL742DHQ3AQ3O6ESA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283956314 (302h54m7.776388767s) [noise=true , address=45.91.116.6:4984 , piece_id=GQV5UTDPDAYNRXXQH7FL427GSQ5W5BLLOVQIN7NUIQIIIV7AJ4RQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284193911 (302h54m7.776626359s) [noise=true , address=145.79.227.13:4815 , piece_id=GBLGYGVE3WCY27XULJK6UYLUUZFPID33MA7X6N62TWHAMVRH3JBQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284732917 (302h54m7.777165362s) [noise=true , address=77.90.31.11:4556 , piece_id=QCYMCO46JRT2K6H46FYCDTZH6RTTL2Q46HOC2VW44IPTZ2W2KQRQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284833471 (302h54m7.77726592s) [noise=true , address=145.79.227.33:4884 , piece_id=ZTHSKPCM7ZF5BKF26VRUXLJ2N3KGZYFK6HJTKOHYDUJFFYRR7HDA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.285523649 (302h54m7.777956091s) [noise=true , address=145.79.227.32:4854 , piece_id=2YLGSMO4KJ4OTLCQLTFWB6SFEEUPT3X5XKWE7KDQSX7W5LO7FO5Q, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.285585257 (302h54m7.778017699s) [noise=true , address=145.79.227.12:4770 , piece_id=NYBMVQLHBRCGAK2QQHSZ2BRZN3XAMMJKCRYKS4QWI7ZFH64XEGEA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.286297044 (302h54m7.778729499s) [noise=true , address=145.79.227.30:4771 , piece_id=SKXNQMX4RW3KCWKY5TMDPUI5QZJXYROJBMV5Y4P7MAUZUGCSUIEA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.286526017 (302h54m7.778958471s) [noise=true , address=145.79.227.5:4240 , piece_id=Q4PEISD7R7IO4BYBWLADEXE6JBUGQ5AY4J3IPX4P3Q6HZBUSYN7Q, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287104751 (302h54m7.779537193s) [noise=true , address=45.91.116.6:4008 , piece_id=PWJH5FFOUVPV64I4FLTGTBCMYLMIYBEZBZBUCI2WJQBKOPR4KABA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287470770 (302h54m7.779903218s) [noise=true , address=145.79.227.17:4984 , piece_id=ARCUIGNVITSNKFJYAJQEP24HJVBBBDOZ3FRLUQASEZFN2IXGMPLQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287613969 (302h54m7.780046423s) [noise=true , address=145.79.227.14:4843 , piece_id=IXNCU3WCMDYAVT6IE4ETEMTKQROPHV4V77VO5TNNZP5ASMW3WJQQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287960566 (302h54m7.780393019s) [noise=true , address=77.90.31.17:4795 , piece_id=2GUT5J77OOFK3OU6DG5IVXAXCBSV7SZRCXX3TPYZIRMCKGX3JUOQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289210694 (302h54m7.781643146s) [noise=true , address=145.79.227.11:4733 , piece_id=FPN5NMMTUYQHWRQOOYB5RPDKTWHEEWA3CX2OMH233YHTID6MWIFQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289586052 (302h54m7.782018502s) [noise=true , address=145.79.227.37:4589 , piece_id=K4HCLE6PM54ZXJVN5KO626R5UUP32OVEN6DDYIFUM6EYQCRVT7YQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289971344 (302h54m7.782403791s) [noise=true , address=145.79.227.36:4524 , piece_id=RSUO6BNALYS7M6W4RJ55UOD35LNCPD26PQDZBCNY6HHVDFQTRVRQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.849451002 (302h54m8.341883437s) [upload=266387]: Next returned nil segment Sep 11 05:01:47.850308233 (302h54m8.342740675s) [upload=266387]: Waiting for error group managing segments... Sep 11 05:01:47.994127497 (302h54m8.486559926s) [noise=true , address=145.79.227.14:4843 , piece_id=IXNCU3WCMDYAVT6IE4ETEMTKQROPHV4V77VO5TNNZP5ASMW3WJQQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.995677280 (302h54m8.488109717s) [noise=true , address=145.79.227.11:4733 , piece_id=FPN5NMMTUYQHWRQOOYB5RPDKTWHEEWA3CX2OMH233YHTID6MWIFQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.996836577 (302h54m8.489269006s) [noise=true , address=145.79.227.30:4771 , piece_id=SKXNQMX4RW3KCWKY5TMDPUI5QZJXYROJBMV5Y4P7MAUZUGCSUIEA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.997314105 (302h54m8.489746535s) [noise=true , address=145.79.227.13:4815 , piece_id=GBLGYGVE3WCY27XULJK6UYLUUZFPID33MA7X6N62TWHAMVRH3JBQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.997716103 (302h54m8.490148547s) [noise=true , address=145.79.227.36:4524 , piece_id=RSUO6BNALYS7M6W4RJ55UOD35LNCPD26PQDZBCNY6HHVDFQTRVRQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.998369140 (302h54m8.490801569s) [noise=true , address=145.79.227.17:4984 , piece_id=ARCUIGNVITSNKFJYAJQEP24HJVBBBDOZ3FRLUQASEZFN2IXGMPLQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.998606161 (302h54m8.491038597s) [noise=true , address=77.90.31.11:4556 , piece_id=QCYMCO46JRT2K6H46FYCDTZH6RTTL2Q46HOC2VW44IPTZ2W2KQRQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.002273466 (302h54m8.494705902s) [noise=true , address=77.90.31.17:4795 , piece_id=2GUT5J77OOFK3OU6DG5IVXAXCBSV7SZRCXX3TPYZIRMCKGX3JUOQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.006810730 (302h54m8.499243159s) [noise=true , address=145.79.227.12:4770 , piece_id=NYBMVQLHBRCGAK2QQHSZ2BRZN3XAMMJKCRYKS4QWI7ZFH64XEGEA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.011564887 (302h54m8.503997331s) [noise=true , address=145.79.227.33:4884 , piece_id=ZTHSKPCM7ZF5BKF26VRUXLJ2N3KGZYFK6HJTKOHYDUJFFYRR7HDA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.023440869 (302h54m8.515873298s) [noise=true , address=45.91.116.11:4147 , piece_id=BPNZTKMMEXM5B6UQSOLWZTZVVT5UOV2QHPSZL742DHQ3AQ3O6ESA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.085368080 (302h54m8.577800508s) [noise=true , address=145.79.227.37:4589 , piece_id=K4HCLE6PM54ZXJVN5KO626R5UUP32OVEN6DDYIFUM6EYQCRVT7YQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:02:46.754779889 (302h55m7.247212318s) [noise=true , address=145.79.227.5:4240 , piece_id=Q4PEISD7R7IO4BYBWLADEXE6JBUGQ5AY4J3IPX4P3Q6HZBUSYN7Q, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:13SaC5StbguPT3abAT9oTX3mZAyGhJcpAA6b7ueyiDFHa8CCEo, address:145.79.227.5:4240): protocol: rpc: dial tcp 145.79.227.5:4240: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.754831971 (302h55m7.247264401s) [noise=true , address=145.79.227.2:4121 , piece_id=KUVJMQVN5VOZCGW5W4DY5BMLI5IH23GSC2IFN6PH6XEA4OT3VUMA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:1Fq1JNvrZLTFTQLVF8jzyavJ6dU1xX96FTGcyxfaHiPdCLu4pB, address:145.79.227.2:4121): protocol: context deadline exceeded; context deadline exceeded Sep 11 05:02:46.754895261 (302h55m7.247327705s) [noise=true , address=45.91.116.8:4051 , piece_id=PPCINK7K25XXRN3JQPMWVBQVPXXP7UPVSILUGIKWO3OI7EEI42FQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3, address:45.91.116.8:4051): protocol: write tcp 139.59.144.22:38826->45.91.116.8:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.754988069 (302h55m7.247420503s) [noise=true , address=45.91.116.6:4008 , piece_id=PWJH5FFOUVPV64I4FLTGTBCMYLMIYBEZBZBUCI2WJQBKOPR4KABA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:16KXs6ZXZyroRJibAYU5bsga1RFSpmf7yEtaNG7tamaX7QKvng, address:45.91.116.6:4008): protocol: context deadline exceeded; context deadline exceeded Sep 11 05:02:46.755109851 (302h55m7.24754228s) [noise=true , address=45.91.116.6:4984 , piece_id=GQV5UTDPDAYNRXXQH7FL427GSQ5W5BLLOVQIN7NUIQIIIV7AJ4RQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:12VQKskrBadKVwYpngNNeSJPn3knJs7WXtfz9D6syskCDz9EVSt, address:45.91.116.6:4984): protocol: rpc: dial tcp 45.91.116.6:4984: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.755262600 (302h55m7.247695031s) [noise=true , address=145.79.227.32:4854 , piece_id=2YLGSMO4KJ4OTLCQLTFWB6SFEEUPT3X5XKWE7KDQSX7W5LO7FO5Q, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:12eitcwvcNX2GyMiv4GdfDD8wmgb6a1d3ggaGVxbpyKAjPjshmV, address:145.79.227.32:4854): protocol: rpc: dial tcp 145.79.227.32:4854: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.755312278 (302h55m7.247744733s) [seg_pos={0 0}, upload=266387]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Sep 11 05:02:46.866353400 (302h55m7.358785843s) [upload=266387]: Done uploading segments... Sep 11 05:02:46.866397083 (302h55m7.358829529s) [upload=266387]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 2.466682875s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [................................................XX..........] duration: 2.73618371s FAIL (2025-09-11 05:09:17 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.73621326s core uplink us-select-1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 522.943806ms target: https://ap1.storj.io/login FAIL (2025-09-11 05:09:13 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: i/o timeout Duration: 522.966736ms core satellite ap1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 2 out of 60 is failed (threshold=3) [.................................................XX.........] duration: 346.630074ms target: https://version.storj.io/ FAIL (2025-09-11 05:09:02 UTC) orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: i/o timeout Duration: 346.762146ms core website
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 2 out of 60 is failed (threshold=3) [..................................................XX........] duration: 340.363332ms target: https://version.storj.io/ FAIL (2025-09-11 05:08:43 UTC) orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: i/o timeout Duration: 340.390645ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 1.013739717s FAIL (2025-09-11 05:08:42 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.01377097s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................................................XX.........] duration: 2.293668074s FAIL (2025-09-11 05:08:21 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.293699439s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 2.389523696s FAIL (2025-09-11 05:08:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== 6387]: Got next segment. Inline: false Sep 11 05:01:47.070094760 (302h54m7.562527201s) [upload=266387]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 05:01:47.070100812 (302h54m7.562533255s) [upload=266387]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 05:01:47.282517324 (302h54m7.774949756s) [seg_pos={0 0}, upload=266387]: Begin upload segment... Sep 11 05:01:47.282586917 (302h54m7.775019351s) [seg_pos={0 0}, upload=266387]: Done begin upload segment. Sep 11 05:01:47.282630874 (302h54m7.775063319s) [noise=true , address=145.79.227.2:4121 , piece_id=KUVJMQVN5VOZCGW5W4DY5BMLI5IH23GSC2IFN6PH6XEA4OT3VUMA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283078686 (302h54m7.775511133s) [noise=true , address=45.91.116.8:4051 , piece_id=PPCINK7K25XXRN3JQPMWVBQVPXXP7UPVSILUGIKWO3OI7EEI42FQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283596723 (302h54m7.776029168s) [noise=true , address=45.91.116.11:4147 , piece_id=BPNZTKMMEXM5B6UQSOLWZTZVVT5UOV2QHPSZL742DHQ3AQ3O6ESA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283956314 (302h54m7.776388767s) [noise=true , address=45.91.116.6:4984 , piece_id=GQV5UTDPDAYNRXXQH7FL427GSQ5W5BLLOVQIN7NUIQIIIV7AJ4RQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284193911 (302h54m7.776626359s) [noise=true , address=145.79.227.13:4815 , piece_id=GBLGYGVE3WCY27XULJK6UYLUUZFPID33MA7X6N62TWHAMVRH3JBQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284732917 (302h54m7.777165362s) [noise=true , address=77.90.31.11:4556 , piece_id=QCYMCO46JRT2K6H46FYCDTZH6RTTL2Q46HOC2VW44IPTZ2W2KQRQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284833471 (302h54m7.77726592s) [noise=true , address=145.79.227.33:4884 , piece_id=ZTHSKPCM7ZF5BKF26VRUXLJ2N3KGZYFK6HJTKOHYDUJFFYRR7HDA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.285523649 (302h54m7.777956091s) [noise=true , address=145.79.227.32:4854 , piece_id=2YLGSMO4KJ4OTLCQLTFWB6SFEEUPT3X5XKWE7KDQSX7W5LO7FO5Q, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.285585257 (302h54m7.778017699s) [noise=true , address=145.79.227.12:4770 , piece_id=NYBMVQLHBRCGAK2QQHSZ2BRZN3XAMMJKCRYKS4QWI7ZFH64XEGEA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.286297044 (302h54m7.778729499s) [noise=true , address=145.79.227.30:4771 , piece_id=SKXNQMX4RW3KCWKY5TMDPUI5QZJXYROJBMV5Y4P7MAUZUGCSUIEA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.286526017 (302h54m7.778958471s) [noise=true , address=145.79.227.5:4240 , piece_id=Q4PEISD7R7IO4BYBWLADEXE6JBUGQ5AY4J3IPX4P3Q6HZBUSYN7Q, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287104751 (302h54m7.779537193s) [noise=true , address=45.91.116.6:4008 , piece_id=PWJH5FFOUVPV64I4FLTGTBCMYLMIYBEZBZBUCI2WJQBKOPR4KABA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287470770 (302h54m7.779903218s) [noise=true , address=145.79.227.17:4984 , piece_id=ARCUIGNVITSNKFJYAJQEP24HJVBBBDOZ3FRLUQASEZFN2IXGMPLQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287613969 (302h54m7.780046423s) [noise=true , address=145.79.227.14:4843 , piece_id=IXNCU3WCMDYAVT6IE4ETEMTKQROPHV4V77VO5TNNZP5ASMW3WJQQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287960566 (302h54m7.780393019s) [noise=true , address=77.90.31.17:4795 , piece_id=2GUT5J77OOFK3OU6DG5IVXAXCBSV7SZRCXX3TPYZIRMCKGX3JUOQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289210694 (302h54m7.781643146s) [noise=true , address=145.79.227.11:4733 , piece_id=FPN5NMMTUYQHWRQOOYB5RPDKTWHEEWA3CX2OMH233YHTID6MWIFQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289586052 (302h54m7.782018502s) [noise=true , address=145.79.227.37:4589 , piece_id=K4HCLE6PM54ZXJVN5KO626R5UUP32OVEN6DDYIFUM6EYQCRVT7YQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289971344 (302h54m7.782403791s) [noise=true , address=145.79.227.36:4524 , piece_id=RSUO6BNALYS7M6W4RJ55UOD35LNCPD26PQDZBCNY6HHVDFQTRVRQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.849451002 (302h54m8.341883437s) [upload=266387]: Next returned nil segment Sep 11 05:01:47.850308233 (302h54m8.342740675s) [upload=266387]: Waiting for error group managing segments... Sep 11 05:01:47.994127497 (302h54m8.486559926s) [noise=true , address=145.79.227.14:4843 , piece_id=IXNCU3WCMDYAVT6IE4ETEMTKQROPHV4V77VO5TNNZP5ASMW3WJQQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.995677280 (302h54m8.488109717s) [noise=true , address=145.79.227.11:4733 , piece_id=FPN5NMMTUYQHWRQOOYB5RPDKTWHEEWA3CX2OMH233YHTID6MWIFQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.996836577 (302h54m8.489269006s) [noise=true , address=145.79.227.30:4771 , piece_id=SKXNQMX4RW3KCWKY5TMDPUI5QZJXYROJBMV5Y4P7MAUZUGCSUIEA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.997314105 (302h54m8.489746535s) [noise=true , address=145.79.227.13:4815 , piece_id=GBLGYGVE3WCY27XULJK6UYLUUZFPID33MA7X6N62TWHAMVRH3JBQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.997716103 (302h54m8.490148547s) [noise=true , address=145.79.227.36:4524 , piece_id=RSUO6BNALYS7M6W4RJ55UOD35LNCPD26PQDZBCNY6HHVDFQTRVRQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.998369140 (302h54m8.490801569s) [noise=true , address=145.79.227.17:4984 , piece_id=ARCUIGNVITSNKFJYAJQEP24HJVBBBDOZ3FRLUQASEZFN2IXGMPLQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.998606161 (302h54m8.491038597s) [noise=true , address=77.90.31.11:4556 , piece_id=QCYMCO46JRT2K6H46FYCDTZH6RTTL2Q46HOC2VW44IPTZ2W2KQRQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.002273466 (302h54m8.494705902s) [noise=true , address=77.90.31.17:4795 , piece_id=2GUT5J77OOFK3OU6DG5IVXAXCBSV7SZRCXX3TPYZIRMCKGX3JUOQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.006810730 (302h54m8.499243159s) [noise=true , address=145.79.227.12:4770 , piece_id=NYBMVQLHBRCGAK2QQHSZ2BRZN3XAMMJKCRYKS4QWI7ZFH64XEGEA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.011564887 (302h54m8.503997331s) [noise=true , address=145.79.227.33:4884 , piece_id=ZTHSKPCM7ZF5BKF26VRUXLJ2N3KGZYFK6HJTKOHYDUJFFYRR7HDA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.023440869 (302h54m8.515873298s) [noise=true , address=45.91.116.11:4147 , piece_id=BPNZTKMMEXM5B6UQSOLWZTZVVT5UOV2QHPSZL742DHQ3AQ3O6ESA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.085368080 (302h54m8.577800508s) [noise=true , address=145.79.227.37:4589 , piece_id=K4HCLE6PM54ZXJVN5KO626R5UUP32OVEN6DDYIFUM6EYQCRVT7YQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:02:46.754779889 (302h55m7.247212318s) [noise=true , address=145.79.227.5:4240 , piece_id=Q4PEISD7R7IO4BYBWLADEXE6JBUGQ5AY4J3IPX4P3Q6HZBUSYN7Q, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:13SaC5StbguPT3abAT9oTX3mZAyGhJcpAA6b7ueyiDFHa8CCEo, address:145.79.227.5:4240): protocol: rpc: dial tcp 145.79.227.5:4240: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.754831971 (302h55m7.247264401s) [noise=true , address=145.79.227.2:4121 , piece_id=KUVJMQVN5VOZCGW5W4DY5BMLI5IH23GSC2IFN6PH6XEA4OT3VUMA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:1Fq1JNvrZLTFTQLVF8jzyavJ6dU1xX96FTGcyxfaHiPdCLu4pB, address:145.79.227.2:4121): protocol: context deadline exceeded; context deadline exceeded Sep 11 05:02:46.754895261 (302h55m7.247327705s) [noise=true , address=45.91.116.8:4051 , piece_id=PPCINK7K25XXRN3JQPMWVBQVPXXP7UPVSILUGIKWO3OI7EEI42FQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3, address:45.91.116.8:4051): protocol: write tcp 139.59.144.22:38826->45.91.116.8:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.754988069 (302h55m7.247420503s) [noise=true , address=45.91.116.6:4008 , piece_id=PWJH5FFOUVPV64I4FLTGTBCMYLMIYBEZBZBUCI2WJQBKOPR4KABA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:16KXs6ZXZyroRJibAYU5bsga1RFSpmf7yEtaNG7tamaX7QKvng, address:45.91.116.6:4008): protocol: context deadline exceeded; context deadline exceeded Sep 11 05:02:46.755109851 (302h55m7.24754228s) [noise=true , address=45.91.116.6:4984 , piece_id=GQV5UTDPDAYNRXXQH7FL427GSQ5W5BLLOVQIN7NUIQIIIV7AJ4RQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:12VQKskrBadKVwYpngNNeSJPn3knJs7WXtfz9D6syskCDz9EVSt, address:45.91.116.6:4984): protocol: rpc: dial tcp 45.91.116.6:4984: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.755262600 (302h55m7.247695031s) [noise=true , address=145.79.227.32:4854 , piece_id=2YLGSMO4KJ4OTLCQLTFWB6SFEEUPT3X5XKWE7KDQSX7W5LO7FO5Q, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:12eitcwvcNX2GyMiv4GdfDD8wmgb6a1d3ggaGVxbpyKAjPjshmV, address:145.79.227.32:4854): protocol: rpc: dial tcp 145.79.227.32:4854: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.755312278 (302h55m7.247744733s) [seg_pos={0 0}, upload=266387]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Sep 11 05:02:46.866353400 (302h55m7.358785843s) [upload=266387]: Done uploading segments... Sep 11 05:02:46.866397083 (302h55m7.358829529s) [upload=266387]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 2.389588932s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 520.884944ms target: https://ap1.storj.io/login FAIL (2025-09-11 05:08:00 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: i/o timeout Duration: 520.974973ms core satellite ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................................................XX........] duration: 2.437696749s FAIL (2025-09-11 05:07:59 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.437771471s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 2 out of 60 is failed (threshold=3) [...................................................XX.......] duration: 333.037837ms target: https://version.storj.io/ FAIL (2025-09-11 05:07:42 UTC) orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: i/o timeout Duration: 333.066845ms core website
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 515.652745ms target: https://ap1.storj.io/login FAIL (2025-09-11 05:07:41 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: i/o timeout Duration: 515.687173ms core satellite ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 2.322770643s FAIL (2025-09-11 05:07:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== 6387]: Got next segment. Inline: false Sep 11 05:01:47.070094760 (302h54m7.562527201s) [upload=266387]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 05:01:47.070100812 (302h54m7.562533255s) [upload=266387]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 05:01:47.282517324 (302h54m7.774949756s) [seg_pos={0 0}, upload=266387]: Begin upload segment... Sep 11 05:01:47.282586917 (302h54m7.775019351s) [seg_pos={0 0}, upload=266387]: Done begin upload segment. Sep 11 05:01:47.282630874 (302h54m7.775063319s) [noise=true , address=145.79.227.2:4121 , piece_id=KUVJMQVN5VOZCGW5W4DY5BMLI5IH23GSC2IFN6PH6XEA4OT3VUMA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283078686 (302h54m7.775511133s) [noise=true , address=45.91.116.8:4051 , piece_id=PPCINK7K25XXRN3JQPMWVBQVPXXP7UPVSILUGIKWO3OI7EEI42FQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283596723 (302h54m7.776029168s) [noise=true , address=45.91.116.11:4147 , piece_id=BPNZTKMMEXM5B6UQSOLWZTZVVT5UOV2QHPSZL742DHQ3AQ3O6ESA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283956314 (302h54m7.776388767s) [noise=true , address=45.91.116.6:4984 , piece_id=GQV5UTDPDAYNRXXQH7FL427GSQ5W5BLLOVQIN7NUIQIIIV7AJ4RQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284193911 (302h54m7.776626359s) [noise=true , address=145.79.227.13:4815 , piece_id=GBLGYGVE3WCY27XULJK6UYLUUZFPID33MA7X6N62TWHAMVRH3JBQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284732917 (302h54m7.777165362s) [noise=true , address=77.90.31.11:4556 , piece_id=QCYMCO46JRT2K6H46FYCDTZH6RTTL2Q46HOC2VW44IPTZ2W2KQRQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284833471 (302h54m7.77726592s) [noise=true , address=145.79.227.33:4884 , piece_id=ZTHSKPCM7ZF5BKF26VRUXLJ2N3KGZYFK6HJTKOHYDUJFFYRR7HDA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.285523649 (302h54m7.777956091s) [noise=true , address=145.79.227.32:4854 , piece_id=2YLGSMO4KJ4OTLCQLTFWB6SFEEUPT3X5XKWE7KDQSX7W5LO7FO5Q, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.285585257 (302h54m7.778017699s) [noise=true , address=145.79.227.12:4770 , piece_id=NYBMVQLHBRCGAK2QQHSZ2BRZN3XAMMJKCRYKS4QWI7ZFH64XEGEA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.286297044 (302h54m7.778729499s) [noise=true , address=145.79.227.30:4771 , piece_id=SKXNQMX4RW3KCWKY5TMDPUI5QZJXYROJBMV5Y4P7MAUZUGCSUIEA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.286526017 (302h54m7.778958471s) [noise=true , address=145.79.227.5:4240 , piece_id=Q4PEISD7R7IO4BYBWLADEXE6JBUGQ5AY4J3IPX4P3Q6HZBUSYN7Q, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287104751 (302h54m7.779537193s) [noise=true , address=45.91.116.6:4008 , piece_id=PWJH5FFOUVPV64I4FLTGTBCMYLMIYBEZBZBUCI2WJQBKOPR4KABA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287470770 (302h54m7.779903218s) [noise=true , address=145.79.227.17:4984 , piece_id=ARCUIGNVITSNKFJYAJQEP24HJVBBBDOZ3FRLUQASEZFN2IXGMPLQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287613969 (302h54m7.780046423s) [noise=true , address=145.79.227.14:4843 , piece_id=IXNCU3WCMDYAVT6IE4ETEMTKQROPHV4V77VO5TNNZP5ASMW3WJQQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287960566 (302h54m7.780393019s) [noise=true , address=77.90.31.17:4795 , piece_id=2GUT5J77OOFK3OU6DG5IVXAXCBSV7SZRCXX3TPYZIRMCKGX3JUOQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289210694 (302h54m7.781643146s) [noise=true , address=145.79.227.11:4733 , piece_id=FPN5NMMTUYQHWRQOOYB5RPDKTWHEEWA3CX2OMH233YHTID6MWIFQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289586052 (302h54m7.782018502s) [noise=true , address=145.79.227.37:4589 , piece_id=K4HCLE6PM54ZXJVN5KO626R5UUP32OVEN6DDYIFUM6EYQCRVT7YQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289971344 (302h54m7.782403791s) [noise=true , address=145.79.227.36:4524 , piece_id=RSUO6BNALYS7M6W4RJ55UOD35LNCPD26PQDZBCNY6HHVDFQTRVRQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.849451002 (302h54m8.341883437s) [upload=266387]: Next returned nil segment Sep 11 05:01:47.850308233 (302h54m8.342740675s) [upload=266387]: Waiting for error group managing segments... Sep 11 05:01:47.994127497 (302h54m8.486559926s) [noise=true , address=145.79.227.14:4843 , piece_id=IXNCU3WCMDYAVT6IE4ETEMTKQROPHV4V77VO5TNNZP5ASMW3WJQQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.995677280 (302h54m8.488109717s) [noise=true , address=145.79.227.11:4733 , piece_id=FPN5NMMTUYQHWRQOOYB5RPDKTWHEEWA3CX2OMH233YHTID6MWIFQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.996836577 (302h54m8.489269006s) [noise=true , address=145.79.227.30:4771 , piece_id=SKXNQMX4RW3KCWKY5TMDPUI5QZJXYROJBMV5Y4P7MAUZUGCSUIEA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.997314105 (302h54m8.489746535s) [noise=true , address=145.79.227.13:4815 , piece_id=GBLGYGVE3WCY27XULJK6UYLUUZFPID33MA7X6N62TWHAMVRH3JBQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.997716103 (302h54m8.490148547s) [noise=true , address=145.79.227.36:4524 , piece_id=RSUO6BNALYS7M6W4RJ55UOD35LNCPD26PQDZBCNY6HHVDFQTRVRQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.998369140 (302h54m8.490801569s) [noise=true , address=145.79.227.17:4984 , piece_id=ARCUIGNVITSNKFJYAJQEP24HJVBBBDOZ3FRLUQASEZFN2IXGMPLQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.998606161 (302h54m8.491038597s) [noise=true , address=77.90.31.11:4556 , piece_id=QCYMCO46JRT2K6H46FYCDTZH6RTTL2Q46HOC2VW44IPTZ2W2KQRQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.002273466 (302h54m8.494705902s) [noise=true , address=77.90.31.17:4795 , piece_id=2GUT5J77OOFK3OU6DG5IVXAXCBSV7SZRCXX3TPYZIRMCKGX3JUOQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.006810730 (302h54m8.499243159s) [noise=true , address=145.79.227.12:4770 , piece_id=NYBMVQLHBRCGAK2QQHSZ2BRZN3XAMMJKCRYKS4QWI7ZFH64XEGEA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.011564887 (302h54m8.503997331s) [noise=true , address=145.79.227.33:4884 , piece_id=ZTHSKPCM7ZF5BKF26VRUXLJ2N3KGZYFK6HJTKOHYDUJFFYRR7HDA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.023440869 (302h54m8.515873298s) [noise=true , address=45.91.116.11:4147 , piece_id=BPNZTKMMEXM5B6UQSOLWZTZVVT5UOV2QHPSZL742DHQ3AQ3O6ESA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.085368080 (302h54m8.577800508s) [noise=true , address=145.79.227.37:4589 , piece_id=K4HCLE6PM54ZXJVN5KO626R5UUP32OVEN6DDYIFUM6EYQCRVT7YQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:02:46.754779889 (302h55m7.247212318s) [noise=true , address=145.79.227.5:4240 , piece_id=Q4PEISD7R7IO4BYBWLADEXE6JBUGQ5AY4J3IPX4P3Q6HZBUSYN7Q, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:13SaC5StbguPT3abAT9oTX3mZAyGhJcpAA6b7ueyiDFHa8CCEo, address:145.79.227.5:4240): protocol: rpc: dial tcp 145.79.227.5:4240: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.754831971 (302h55m7.247264401s) [noise=true , address=145.79.227.2:4121 , piece_id=KUVJMQVN5VOZCGW5W4DY5BMLI5IH23GSC2IFN6PH6XEA4OT3VUMA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:1Fq1JNvrZLTFTQLVF8jzyavJ6dU1xX96FTGcyxfaHiPdCLu4pB, address:145.79.227.2:4121): protocol: context deadline exceeded; context deadline exceeded Sep 11 05:02:46.754895261 (302h55m7.247327705s) [noise=true , address=45.91.116.8:4051 , piece_id=PPCINK7K25XXRN3JQPMWVBQVPXXP7UPVSILUGIKWO3OI7EEI42FQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3, address:45.91.116.8:4051): protocol: write tcp 139.59.144.22:38826->45.91.116.8:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.754988069 (302h55m7.247420503s) [noise=true , address=45.91.116.6:4008 , piece_id=PWJH5FFOUVPV64I4FLTGTBCMYLMIYBEZBZBUCI2WJQBKOPR4KABA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:16KXs6ZXZyroRJibAYU5bsga1RFSpmf7yEtaNG7tamaX7QKvng, address:45.91.116.6:4008): protocol: context deadline exceeded; context deadline exceeded Sep 11 05:02:46.755109851 (302h55m7.24754228s) [noise=true , address=45.91.116.6:4984 , piece_id=GQV5UTDPDAYNRXXQH7FL427GSQ5W5BLLOVQIN7NUIQIIIV7AJ4RQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:12VQKskrBadKVwYpngNNeSJPn3knJs7WXtfz9D6syskCDz9EVSt, address:45.91.116.6:4984): protocol: rpc: dial tcp 45.91.116.6:4984: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.755262600 (302h55m7.247695031s) [noise=true , address=145.79.227.32:4854 , piece_id=2YLGSMO4KJ4OTLCQLTFWB6SFEEUPT3X5XKWE7KDQSX7W5LO7FO5Q, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:12eitcwvcNX2GyMiv4GdfDD8wmgb6a1d3ggaGVxbpyKAjPjshmV, address:145.79.227.32:4854): protocol: rpc: dial tcp 145.79.227.32:4854: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.755312278 (302h55m7.247744733s) [seg_pos={0 0}, upload=266387]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Sep 11 05:02:46.866353400 (302h55m7.358785843s) [upload=266387]: Done uploading segments... Sep 11 05:02:46.866397083 (302h55m7.358829529s) [upload=266387]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 2.322804028s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 1.33498322s FAIL (2025-09-11 05:07:30 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.335019635s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 522.296627ms target: https://ap1.storj.io/login FAIL (2025-09-11 05:07:04 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: i/o timeout Duration: 522.375383ms core satellite ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...................................................XX.......] duration: 2.494443909s FAIL (2025-09-11 05:06:54 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.494510177s core uplink us-select-1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 2 out of 60 is failed (threshold=3) [....................................................XX......] duration: 334.293112ms target: https://version.storj.io/ FAIL (2025-09-11 05:06:47 UTC) orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: i/o timeout Duration: 334.321759ms core website
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 502.820431ms target: https://ap1.storj.io/login FAIL (2025-09-11 05:06:34 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: i/o timeout Duration: 502.843252ms core satellite ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 904.486561ms FAIL (2025-09-11 05:06:31 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 904.522543ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 2.523022301s FAIL (2025-09-11 05:06:26 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== 6387]: Got next segment. Inline: false Sep 11 05:01:47.070094760 (302h54m7.562527201s) [upload=266387]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 05:01:47.070100812 (302h54m7.562533255s) [upload=266387]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 05:01:47.282517324 (302h54m7.774949756s) [seg_pos={0 0}, upload=266387]: Begin upload segment... Sep 11 05:01:47.282586917 (302h54m7.775019351s) [seg_pos={0 0}, upload=266387]: Done begin upload segment. Sep 11 05:01:47.282630874 (302h54m7.775063319s) [noise=true , address=145.79.227.2:4121 , piece_id=KUVJMQVN5VOZCGW5W4DY5BMLI5IH23GSC2IFN6PH6XEA4OT3VUMA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283078686 (302h54m7.775511133s) [noise=true , address=45.91.116.8:4051 , piece_id=PPCINK7K25XXRN3JQPMWVBQVPXXP7UPVSILUGIKWO3OI7EEI42FQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283596723 (302h54m7.776029168s) [noise=true , address=45.91.116.11:4147 , piece_id=BPNZTKMMEXM5B6UQSOLWZTZVVT5UOV2QHPSZL742DHQ3AQ3O6ESA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283956314 (302h54m7.776388767s) [noise=true , address=45.91.116.6:4984 , piece_id=GQV5UTDPDAYNRXXQH7FL427GSQ5W5BLLOVQIN7NUIQIIIV7AJ4RQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284193911 (302h54m7.776626359s) [noise=true , address=145.79.227.13:4815 , piece_id=GBLGYGVE3WCY27XULJK6UYLUUZFPID33MA7X6N62TWHAMVRH3JBQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284732917 (302h54m7.777165362s) [noise=true , address=77.90.31.11:4556 , piece_id=QCYMCO46JRT2K6H46FYCDTZH6RTTL2Q46HOC2VW44IPTZ2W2KQRQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284833471 (302h54m7.77726592s) [noise=true , address=145.79.227.33:4884 , piece_id=ZTHSKPCM7ZF5BKF26VRUXLJ2N3KGZYFK6HJTKOHYDUJFFYRR7HDA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.285523649 (302h54m7.777956091s) [noise=true , address=145.79.227.32:4854 , piece_id=2YLGSMO4KJ4OTLCQLTFWB6SFEEUPT3X5XKWE7KDQSX7W5LO7FO5Q, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.285585257 (302h54m7.778017699s) [noise=true , address=145.79.227.12:4770 , piece_id=NYBMVQLHBRCGAK2QQHSZ2BRZN3XAMMJKCRYKS4QWI7ZFH64XEGEA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.286297044 (302h54m7.778729499s) [noise=true , address=145.79.227.30:4771 , piece_id=SKXNQMX4RW3KCWKY5TMDPUI5QZJXYROJBMV5Y4P7MAUZUGCSUIEA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.286526017 (302h54m7.778958471s) [noise=true , address=145.79.227.5:4240 , piece_id=Q4PEISD7R7IO4BYBWLADEXE6JBUGQ5AY4J3IPX4P3Q6HZBUSYN7Q, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287104751 (302h54m7.779537193s) [noise=true , address=45.91.116.6:4008 , piece_id=PWJH5FFOUVPV64I4FLTGTBCMYLMIYBEZBZBUCI2WJQBKOPR4KABA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287470770 (302h54m7.779903218s) [noise=true , address=145.79.227.17:4984 , piece_id=ARCUIGNVITSNKFJYAJQEP24HJVBBBDOZ3FRLUQASEZFN2IXGMPLQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287613969 (302h54m7.780046423s) [noise=true , address=145.79.227.14:4843 , piece_id=IXNCU3WCMDYAVT6IE4ETEMTKQROPHV4V77VO5TNNZP5ASMW3WJQQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287960566 (302h54m7.780393019s) [noise=true , address=77.90.31.17:4795 , piece_id=2GUT5J77OOFK3OU6DG5IVXAXCBSV7SZRCXX3TPYZIRMCKGX3JUOQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289210694 (302h54m7.781643146s) [noise=true , address=145.79.227.11:4733 , piece_id=FPN5NMMTUYQHWRQOOYB5RPDKTWHEEWA3CX2OMH233YHTID6MWIFQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289586052 (302h54m7.782018502s) [noise=true , address=145.79.227.37:4589 , piece_id=K4HCLE6PM54ZXJVN5KO626R5UUP32OVEN6DDYIFUM6EYQCRVT7YQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289971344 (302h54m7.782403791s) [noise=true , address=145.79.227.36:4524 , piece_id=RSUO6BNALYS7M6W4RJ55UOD35LNCPD26PQDZBCNY6HHVDFQTRVRQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.849451002 (302h54m8.341883437s) [upload=266387]: Next returned nil segment Sep 11 05:01:47.850308233 (302h54m8.342740675s) [upload=266387]: Waiting for error group managing segments... Sep 11 05:01:47.994127497 (302h54m8.486559926s) [noise=true , address=145.79.227.14:4843 , piece_id=IXNCU3WCMDYAVT6IE4ETEMTKQROPHV4V77VO5TNNZP5ASMW3WJQQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.995677280 (302h54m8.488109717s) [noise=true , address=145.79.227.11:4733 , piece_id=FPN5NMMTUYQHWRQOOYB5RPDKTWHEEWA3CX2OMH233YHTID6MWIFQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.996836577 (302h54m8.489269006s) [noise=true , address=145.79.227.30:4771 , piece_id=SKXNQMX4RW3KCWKY5TMDPUI5QZJXYROJBMV5Y4P7MAUZUGCSUIEA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.997314105 (302h54m8.489746535s) [noise=true , address=145.79.227.13:4815 , piece_id=GBLGYGVE3WCY27XULJK6UYLUUZFPID33MA7X6N62TWHAMVRH3JBQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.997716103 (302h54m8.490148547s) [noise=true , address=145.79.227.36:4524 , piece_id=RSUO6BNALYS7M6W4RJ55UOD35LNCPD26PQDZBCNY6HHVDFQTRVRQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.998369140 (302h54m8.490801569s) [noise=true , address=145.79.227.17:4984 , piece_id=ARCUIGNVITSNKFJYAJQEP24HJVBBBDOZ3FRLUQASEZFN2IXGMPLQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.998606161 (302h54m8.491038597s) [noise=true , address=77.90.31.11:4556 , piece_id=QCYMCO46JRT2K6H46FYCDTZH6RTTL2Q46HOC2VW44IPTZ2W2KQRQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.002273466 (302h54m8.494705902s) [noise=true , address=77.90.31.17:4795 , piece_id=2GUT5J77OOFK3OU6DG5IVXAXCBSV7SZRCXX3TPYZIRMCKGX3JUOQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.006810730 (302h54m8.499243159s) [noise=true , address=145.79.227.12:4770 , piece_id=NYBMVQLHBRCGAK2QQHSZ2BRZN3XAMMJKCRYKS4QWI7ZFH64XEGEA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.011564887 (302h54m8.503997331s) [noise=true , address=145.79.227.33:4884 , piece_id=ZTHSKPCM7ZF5BKF26VRUXLJ2N3KGZYFK6HJTKOHYDUJFFYRR7HDA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.023440869 (302h54m8.515873298s) [noise=true , address=45.91.116.11:4147 , piece_id=BPNZTKMMEXM5B6UQSOLWZTZVVT5UOV2QHPSZL742DHQ3AQ3O6ESA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.085368080 (302h54m8.577800508s) [noise=true , address=145.79.227.37:4589 , piece_id=K4HCLE6PM54ZXJVN5KO626R5UUP32OVEN6DDYIFUM6EYQCRVT7YQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:02:46.754779889 (302h55m7.247212318s) [noise=true , address=145.79.227.5:4240 , piece_id=Q4PEISD7R7IO4BYBWLADEXE6JBUGQ5AY4J3IPX4P3Q6HZBUSYN7Q, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:13SaC5StbguPT3abAT9oTX3mZAyGhJcpAA6b7ueyiDFHa8CCEo, address:145.79.227.5:4240): protocol: rpc: dial tcp 145.79.227.5:4240: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.754831971 (302h55m7.247264401s) [noise=true , address=145.79.227.2:4121 , piece_id=KUVJMQVN5VOZCGW5W4DY5BMLI5IH23GSC2IFN6PH6XEA4OT3VUMA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:1Fq1JNvrZLTFTQLVF8jzyavJ6dU1xX96FTGcyxfaHiPdCLu4pB, address:145.79.227.2:4121): protocol: context deadline exceeded; context deadline exceeded Sep 11 05:02:46.754895261 (302h55m7.247327705s) [noise=true , address=45.91.116.8:4051 , piece_id=PPCINK7K25XXRN3JQPMWVBQVPXXP7UPVSILUGIKWO3OI7EEI42FQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3, address:45.91.116.8:4051): protocol: write tcp 139.59.144.22:38826->45.91.116.8:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.754988069 (302h55m7.247420503s) [noise=true , address=45.91.116.6:4008 , piece_id=PWJH5FFOUVPV64I4FLTGTBCMYLMIYBEZBZBUCI2WJQBKOPR4KABA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:16KXs6ZXZyroRJibAYU5bsga1RFSpmf7yEtaNG7tamaX7QKvng, address:45.91.116.6:4008): protocol: context deadline exceeded; context deadline exceeded Sep 11 05:02:46.755109851 (302h55m7.24754228s) [noise=true , address=45.91.116.6:4984 , piece_id=GQV5UTDPDAYNRXXQH7FL427GSQ5W5BLLOVQIN7NUIQIIIV7AJ4RQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:12VQKskrBadKVwYpngNNeSJPn3knJs7WXtfz9D6syskCDz9EVSt, address:45.91.116.6:4984): protocol: rpc: dial tcp 45.91.116.6:4984: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.755262600 (302h55m7.247695031s) [noise=true , address=145.79.227.32:4854 , piece_id=2YLGSMO4KJ4OTLCQLTFWB6SFEEUPT3X5XKWE7KDQSX7W5LO7FO5Q, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:12eitcwvcNX2GyMiv4GdfDD8wmgb6a1d3ggaGVxbpyKAjPjshmV, address:145.79.227.32:4854): protocol: rpc: dial tcp 145.79.227.32:4854: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.755312278 (302h55m7.247744733s) [seg_pos={0 0}, upload=266387]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Sep 11 05:02:46.866353400 (302h55m7.358785843s) [upload=266387]: Done uploading segments... Sep 11 05:02:46.866397083 (302h55m7.358829529s) [upload=266387]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 2.523080016s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)