Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 2.393706297s FAIL (2025-09-11 05:26:52 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== 6387]: Got next segment. Inline: false Sep 11 05:01:47.070094760 (302h54m7.562527201s) [upload=266387]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 05:01:47.070100812 (302h54m7.562533255s) [upload=266387]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 05:01:47.282517324 (302h54m7.774949756s) [seg_pos={0 0}, upload=266387]: Begin upload segment... Sep 11 05:01:47.282586917 (302h54m7.775019351s) [seg_pos={0 0}, upload=266387]: Done begin upload segment. Sep 11 05:01:47.282630874 (302h54m7.775063319s) [noise=true , address=145.79.227.2:4121 , piece_id=KUVJMQVN5VOZCGW5W4DY5BMLI5IH23GSC2IFN6PH6XEA4OT3VUMA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283078686 (302h54m7.775511133s) [noise=true , address=45.91.116.8:4051 , piece_id=PPCINK7K25XXRN3JQPMWVBQVPXXP7UPVSILUGIKWO3OI7EEI42FQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283596723 (302h54m7.776029168s) [noise=true , address=45.91.116.11:4147 , piece_id=BPNZTKMMEXM5B6UQSOLWZTZVVT5UOV2QHPSZL742DHQ3AQ3O6ESA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283956314 (302h54m7.776388767s) [noise=true , address=45.91.116.6:4984 , piece_id=GQV5UTDPDAYNRXXQH7FL427GSQ5W5BLLOVQIN7NUIQIIIV7AJ4RQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284193911 (302h54m7.776626359s) [noise=true , address=145.79.227.13:4815 , piece_id=GBLGYGVE3WCY27XULJK6UYLUUZFPID33MA7X6N62TWHAMVRH3JBQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284732917 (302h54m7.777165362s) [noise=true , address=77.90.31.11:4556 , piece_id=QCYMCO46JRT2K6H46FYCDTZH6RTTL2Q46HOC2VW44IPTZ2W2KQRQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284833471 (302h54m7.77726592s) [noise=true , address=145.79.227.33:4884 , piece_id=ZTHSKPCM7ZF5BKF26VRUXLJ2N3KGZYFK6HJTKOHYDUJFFYRR7HDA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.285523649 (302h54m7.777956091s) [noise=true , address=145.79.227.32:4854 , piece_id=2YLGSMO4KJ4OTLCQLTFWB6SFEEUPT3X5XKWE7KDQSX7W5LO7FO5Q, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.285585257 (302h54m7.778017699s) [noise=true , address=145.79.227.12:4770 , piece_id=NYBMVQLHBRCGAK2QQHSZ2BRZN3XAMMJKCRYKS4QWI7ZFH64XEGEA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.286297044 (302h54m7.778729499s) [noise=true , address=145.79.227.30:4771 , piece_id=SKXNQMX4RW3KCWKY5TMDPUI5QZJXYROJBMV5Y4P7MAUZUGCSUIEA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.286526017 (302h54m7.778958471s) [noise=true , address=145.79.227.5:4240 , piece_id=Q4PEISD7R7IO4BYBWLADEXE6JBUGQ5AY4J3IPX4P3Q6HZBUSYN7Q, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287104751 (302h54m7.779537193s) [noise=true , address=45.91.116.6:4008 , piece_id=PWJH5FFOUVPV64I4FLTGTBCMYLMIYBEZBZBUCI2WJQBKOPR4KABA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287470770 (302h54m7.779903218s) [noise=true , address=145.79.227.17:4984 , piece_id=ARCUIGNVITSNKFJYAJQEP24HJVBBBDOZ3FRLUQASEZFN2IXGMPLQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287613969 (302h54m7.780046423s) [noise=true , address=145.79.227.14:4843 , piece_id=IXNCU3WCMDYAVT6IE4ETEMTKQROPHV4V77VO5TNNZP5ASMW3WJQQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287960566 (302h54m7.780393019s) [noise=true , address=77.90.31.17:4795 , piece_id=2GUT5J77OOFK3OU6DG5IVXAXCBSV7SZRCXX3TPYZIRMCKGX3JUOQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289210694 (302h54m7.781643146s) [noise=true , address=145.79.227.11:4733 , piece_id=FPN5NMMTUYQHWRQOOYB5RPDKTWHEEWA3CX2OMH233YHTID6MWIFQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289586052 (302h54m7.782018502s) [noise=true , address=145.79.227.37:4589 , piece_id=K4HCLE6PM54ZXJVN5KO626R5UUP32OVEN6DDYIFUM6EYQCRVT7YQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289971344 (302h54m7.782403791s) [noise=true , address=145.79.227.36:4524 , piece_id=RSUO6BNALYS7M6W4RJ55UOD35LNCPD26PQDZBCNY6HHVDFQTRVRQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.849451002 (302h54m8.341883437s) [upload=266387]: Next returned nil segment Sep 11 05:01:47.850308233 (302h54m8.342740675s) [upload=266387]: Waiting for error group managing segments... Sep 11 05:01:47.994127497 (302h54m8.486559926s) [noise=true , address=145.79.227.14:4843 , piece_id=IXNCU3WCMDYAVT6IE4ETEMTKQROPHV4V77VO5TNNZP5ASMW3WJQQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.995677280 (302h54m8.488109717s) [noise=true , address=145.79.227.11:4733 , piece_id=FPN5NMMTUYQHWRQOOYB5RPDKTWHEEWA3CX2OMH233YHTID6MWIFQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.996836577 (302h54m8.489269006s) [noise=true , address=145.79.227.30:4771 , piece_id=SKXNQMX4RW3KCWKY5TMDPUI5QZJXYROJBMV5Y4P7MAUZUGCSUIEA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.997314105 (302h54m8.489746535s) [noise=true , address=145.79.227.13:4815 , piece_id=GBLGYGVE3WCY27XULJK6UYLUUZFPID33MA7X6N62TWHAMVRH3JBQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.997716103 (302h54m8.490148547s) [noise=true , address=145.79.227.36:4524 , piece_id=RSUO6BNALYS7M6W4RJ55UOD35LNCPD26PQDZBCNY6HHVDFQTRVRQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.998369140 (302h54m8.490801569s) [noise=true , address=145.79.227.17:4984 , piece_id=ARCUIGNVITSNKFJYAJQEP24HJVBBBDOZ3FRLUQASEZFN2IXGMPLQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.998606161 (302h54m8.491038597s) [noise=true , address=77.90.31.11:4556 , piece_id=QCYMCO46JRT2K6H46FYCDTZH6RTTL2Q46HOC2VW44IPTZ2W2KQRQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.002273466 (302h54m8.494705902s) [noise=true , address=77.90.31.17:4795 , piece_id=2GUT5J77OOFK3OU6DG5IVXAXCBSV7SZRCXX3TPYZIRMCKGX3JUOQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.006810730 (302h54m8.499243159s) [noise=true , address=145.79.227.12:4770 , piece_id=NYBMVQLHBRCGAK2QQHSZ2BRZN3XAMMJKCRYKS4QWI7ZFH64XEGEA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.011564887 (302h54m8.503997331s) [noise=true , address=145.79.227.33:4884 , piece_id=ZTHSKPCM7ZF5BKF26VRUXLJ2N3KGZYFK6HJTKOHYDUJFFYRR7HDA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.023440869 (302h54m8.515873298s) [noise=true , address=45.91.116.11:4147 , piece_id=BPNZTKMMEXM5B6UQSOLWZTZVVT5UOV2QHPSZL742DHQ3AQ3O6ESA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.085368080 (302h54m8.577800508s) [noise=true , address=145.79.227.37:4589 , piece_id=K4HCLE6PM54ZXJVN5KO626R5UUP32OVEN6DDYIFUM6EYQCRVT7YQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:02:46.754779889 (302h55m7.247212318s) [noise=true , address=145.79.227.5:4240 , piece_id=Q4PEISD7R7IO4BYBWLADEXE6JBUGQ5AY4J3IPX4P3Q6HZBUSYN7Q, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:13SaC5StbguPT3abAT9oTX3mZAyGhJcpAA6b7ueyiDFHa8CCEo, address:145.79.227.5:4240): protocol: rpc: dial tcp 145.79.227.5:4240: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.754831971 (302h55m7.247264401s) [noise=true , address=145.79.227.2:4121 , piece_id=KUVJMQVN5VOZCGW5W4DY5BMLI5IH23GSC2IFN6PH6XEA4OT3VUMA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:1Fq1JNvrZLTFTQLVF8jzyavJ6dU1xX96FTGcyxfaHiPdCLu4pB, address:145.79.227.2:4121): protocol: context deadline exceeded; context deadline exceeded Sep 11 05:02:46.754895261 (302h55m7.247327705s) [noise=true , address=45.91.116.8:4051 , piece_id=PPCINK7K25XXRN3JQPMWVBQVPXXP7UPVSILUGIKWO3OI7EEI42FQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3, address:45.91.116.8:4051): protocol: write tcp 139.59.144.22:38826->45.91.116.8:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.754988069 (302h55m7.247420503s) [noise=true , address=45.91.116.6:4008 , piece_id=PWJH5FFOUVPV64I4FLTGTBCMYLMIYBEZBZBUCI2WJQBKOPR4KABA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:16KXs6ZXZyroRJibAYU5bsga1RFSpmf7yEtaNG7tamaX7QKvng, address:45.91.116.6:4008): protocol: context deadline exceeded; context deadline exceeded Sep 11 05:02:46.755109851 (302h55m7.24754228s) [noise=true , address=45.91.116.6:4984 , piece_id=GQV5UTDPDAYNRXXQH7FL427GSQ5W5BLLOVQIN7NUIQIIIV7AJ4RQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:12VQKskrBadKVwYpngNNeSJPn3knJs7WXtfz9D6syskCDz9EVSt, address:45.91.116.6:4984): protocol: rpc: dial tcp 45.91.116.6:4984: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.755262600 (302h55m7.247695031s) [noise=true , address=145.79.227.32:4854 , piece_id=2YLGSMO4KJ4OTLCQLTFWB6SFEEUPT3X5XKWE7KDQSX7W5LO7FO5Q, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:12eitcwvcNX2GyMiv4GdfDD8wmgb6a1d3ggaGVxbpyKAjPjshmV, address:145.79.227.32:4854): protocol: rpc: dial tcp 145.79.227.32:4854: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.755312278 (302h55m7.247744733s) [seg_pos={0 0}, upload=266387]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Sep 11 05:02:46.866353400 (302h55m7.358785843s) [upload=266387]: Done uploading segments... Sep 11 05:02:46.866397083 (302h55m7.358829529s) [upload=266387]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 2.393739755s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 516.979988ms target: https://ap1.storj.io/login FAIL (2025-09-11 05:26:42 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: i/o timeout Duration: 517.064284ms core satellite ap1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 498.541744ms target: https://ap1.storj.io/login FAIL (2025-09-11 05:26:24 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: i/o timeout Duration: 498.569641ms core satellite ap1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 2 out of 60 is failed (threshold=3) [............................XX..............................] duration: 360.238223ms target: https://version.storj.io/ FAIL (2025-09-11 05:26:23 UTC) orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: i/o timeout Duration: 360.32257ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 931.976444ms FAIL (2025-09-11 05:26:12 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 932.009083ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.432467003s FAIL (2025-09-11 05:25:58 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== 6387]: Got next segment. Inline: false Sep 11 05:01:47.070094760 (302h54m7.562527201s) [upload=266387]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 05:01:47.070100812 (302h54m7.562533255s) [upload=266387]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 05:01:47.282517324 (302h54m7.774949756s) [seg_pos={0 0}, upload=266387]: Begin upload segment... Sep 11 05:01:47.282586917 (302h54m7.775019351s) [seg_pos={0 0}, upload=266387]: Done begin upload segment. Sep 11 05:01:47.282630874 (302h54m7.775063319s) [noise=true , address=145.79.227.2:4121 , piece_id=KUVJMQVN5VOZCGW5W4DY5BMLI5IH23GSC2IFN6PH6XEA4OT3VUMA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283078686 (302h54m7.775511133s) [noise=true , address=45.91.116.8:4051 , piece_id=PPCINK7K25XXRN3JQPMWVBQVPXXP7UPVSILUGIKWO3OI7EEI42FQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283596723 (302h54m7.776029168s) [noise=true , address=45.91.116.11:4147 , piece_id=BPNZTKMMEXM5B6UQSOLWZTZVVT5UOV2QHPSZL742DHQ3AQ3O6ESA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283956314 (302h54m7.776388767s) [noise=true , address=45.91.116.6:4984 , piece_id=GQV5UTDPDAYNRXXQH7FL427GSQ5W5BLLOVQIN7NUIQIIIV7AJ4RQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284193911 (302h54m7.776626359s) [noise=true , address=145.79.227.13:4815 , piece_id=GBLGYGVE3WCY27XULJK6UYLUUZFPID33MA7X6N62TWHAMVRH3JBQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284732917 (302h54m7.777165362s) [noise=true , address=77.90.31.11:4556 , piece_id=QCYMCO46JRT2K6H46FYCDTZH6RTTL2Q46HOC2VW44IPTZ2W2KQRQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284833471 (302h54m7.77726592s) [noise=true , address=145.79.227.33:4884 , piece_id=ZTHSKPCM7ZF5BKF26VRUXLJ2N3KGZYFK6HJTKOHYDUJFFYRR7HDA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.285523649 (302h54m7.777956091s) [noise=true , address=145.79.227.32:4854 , piece_id=2YLGSMO4KJ4OTLCQLTFWB6SFEEUPT3X5XKWE7KDQSX7W5LO7FO5Q, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.285585257 (302h54m7.778017699s) [noise=true , address=145.79.227.12:4770 , piece_id=NYBMVQLHBRCGAK2QQHSZ2BRZN3XAMMJKCRYKS4QWI7ZFH64XEGEA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.286297044 (302h54m7.778729499s) [noise=true , address=145.79.227.30:4771 , piece_id=SKXNQMX4RW3KCWKY5TMDPUI5QZJXYROJBMV5Y4P7MAUZUGCSUIEA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.286526017 (302h54m7.778958471s) [noise=true , address=145.79.227.5:4240 , piece_id=Q4PEISD7R7IO4BYBWLADEXE6JBUGQ5AY4J3IPX4P3Q6HZBUSYN7Q, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287104751 (302h54m7.779537193s) [noise=true , address=45.91.116.6:4008 , piece_id=PWJH5FFOUVPV64I4FLTGTBCMYLMIYBEZBZBUCI2WJQBKOPR4KABA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287470770 (302h54m7.779903218s) [noise=true , address=145.79.227.17:4984 , piece_id=ARCUIGNVITSNKFJYAJQEP24HJVBBBDOZ3FRLUQASEZFN2IXGMPLQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287613969 (302h54m7.780046423s) [noise=true , address=145.79.227.14:4843 , piece_id=IXNCU3WCMDYAVT6IE4ETEMTKQROPHV4V77VO5TNNZP5ASMW3WJQQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287960566 (302h54m7.780393019s) [noise=true , address=77.90.31.17:4795 , piece_id=2GUT5J77OOFK3OU6DG5IVXAXCBSV7SZRCXX3TPYZIRMCKGX3JUOQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289210694 (302h54m7.781643146s) [noise=true , address=145.79.227.11:4733 , piece_id=FPN5NMMTUYQHWRQOOYB5RPDKTWHEEWA3CX2OMH233YHTID6MWIFQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289586052 (302h54m7.782018502s) [noise=true , address=145.79.227.37:4589 , piece_id=K4HCLE6PM54ZXJVN5KO626R5UUP32OVEN6DDYIFUM6EYQCRVT7YQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289971344 (302h54m7.782403791s) [noise=true , address=145.79.227.36:4524 , piece_id=RSUO6BNALYS7M6W4RJ55UOD35LNCPD26PQDZBCNY6HHVDFQTRVRQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.849451002 (302h54m8.341883437s) [upload=266387]: Next returned nil segment Sep 11 05:01:47.850308233 (302h54m8.342740675s) [upload=266387]: Waiting for error group managing segments... Sep 11 05:01:47.994127497 (302h54m8.486559926s) [noise=true , address=145.79.227.14:4843 , piece_id=IXNCU3WCMDYAVT6IE4ETEMTKQROPHV4V77VO5TNNZP5ASMW3WJQQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.995677280 (302h54m8.488109717s) [noise=true , address=145.79.227.11:4733 , piece_id=FPN5NMMTUYQHWRQOOYB5RPDKTWHEEWA3CX2OMH233YHTID6MWIFQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.996836577 (302h54m8.489269006s) [noise=true , address=145.79.227.30:4771 , piece_id=SKXNQMX4RW3KCWKY5TMDPUI5QZJXYROJBMV5Y4P7MAUZUGCSUIEA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.997314105 (302h54m8.489746535s) [noise=true , address=145.79.227.13:4815 , piece_id=GBLGYGVE3WCY27XULJK6UYLUUZFPID33MA7X6N62TWHAMVRH3JBQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.997716103 (302h54m8.490148547s) [noise=true , address=145.79.227.36:4524 , piece_id=RSUO6BNALYS7M6W4RJ55UOD35LNCPD26PQDZBCNY6HHVDFQTRVRQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.998369140 (302h54m8.490801569s) [noise=true , address=145.79.227.17:4984 , piece_id=ARCUIGNVITSNKFJYAJQEP24HJVBBBDOZ3FRLUQASEZFN2IXGMPLQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.998606161 (302h54m8.491038597s) [noise=true , address=77.90.31.11:4556 , piece_id=QCYMCO46JRT2K6H46FYCDTZH6RTTL2Q46HOC2VW44IPTZ2W2KQRQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.002273466 (302h54m8.494705902s) [noise=true , address=77.90.31.17:4795 , piece_id=2GUT5J77OOFK3OU6DG5IVXAXCBSV7SZRCXX3TPYZIRMCKGX3JUOQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.006810730 (302h54m8.499243159s) [noise=true , address=145.79.227.12:4770 , piece_id=NYBMVQLHBRCGAK2QQHSZ2BRZN3XAMMJKCRYKS4QWI7ZFH64XEGEA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.011564887 (302h54m8.503997331s) [noise=true , address=145.79.227.33:4884 , piece_id=ZTHSKPCM7ZF5BKF26VRUXLJ2N3KGZYFK6HJTKOHYDUJFFYRR7HDA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.023440869 (302h54m8.515873298s) [noise=true , address=45.91.116.11:4147 , piece_id=BPNZTKMMEXM5B6UQSOLWZTZVVT5UOV2QHPSZL742DHQ3AQ3O6ESA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.085368080 (302h54m8.577800508s) [noise=true , address=145.79.227.37:4589 , piece_id=K4HCLE6PM54ZXJVN5KO626R5UUP32OVEN6DDYIFUM6EYQCRVT7YQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:02:46.754779889 (302h55m7.247212318s) [noise=true , address=145.79.227.5:4240 , piece_id=Q4PEISD7R7IO4BYBWLADEXE6JBUGQ5AY4J3IPX4P3Q6HZBUSYN7Q, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:13SaC5StbguPT3abAT9oTX3mZAyGhJcpAA6b7ueyiDFHa8CCEo, address:145.79.227.5:4240): protocol: rpc: dial tcp 145.79.227.5:4240: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.754831971 (302h55m7.247264401s) [noise=true , address=145.79.227.2:4121 , piece_id=KUVJMQVN5VOZCGW5W4DY5BMLI5IH23GSC2IFN6PH6XEA4OT3VUMA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:1Fq1JNvrZLTFTQLVF8jzyavJ6dU1xX96FTGcyxfaHiPdCLu4pB, address:145.79.227.2:4121): protocol: context deadline exceeded; context deadline exceeded Sep 11 05:02:46.754895261 (302h55m7.247327705s) [noise=true , address=45.91.116.8:4051 , piece_id=PPCINK7K25XXRN3JQPMWVBQVPXXP7UPVSILUGIKWO3OI7EEI42FQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3, address:45.91.116.8:4051): protocol: write tcp 139.59.144.22:38826->45.91.116.8:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.754988069 (302h55m7.247420503s) [noise=true , address=45.91.116.6:4008 , piece_id=PWJH5FFOUVPV64I4FLTGTBCMYLMIYBEZBZBUCI2WJQBKOPR4KABA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:16KXs6ZXZyroRJibAYU5bsga1RFSpmf7yEtaNG7tamaX7QKvng, address:45.91.116.6:4008): protocol: context deadline exceeded; context deadline exceeded Sep 11 05:02:46.755109851 (302h55m7.24754228s) [noise=true , address=45.91.116.6:4984 , piece_id=GQV5UTDPDAYNRXXQH7FL427GSQ5W5BLLOVQIN7NUIQIIIV7AJ4RQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:12VQKskrBadKVwYpngNNeSJPn3knJs7WXtfz9D6syskCDz9EVSt, address:45.91.116.6:4984): protocol: rpc: dial tcp 45.91.116.6:4984: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.755262600 (302h55m7.247695031s) [noise=true , address=145.79.227.32:4854 , piece_id=2YLGSMO4KJ4OTLCQLTFWB6SFEEUPT3X5XKWE7KDQSX7W5LO7FO5Q, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:12eitcwvcNX2GyMiv4GdfDD8wmgb6a1d3ggaGVxbpyKAjPjshmV, address:145.79.227.32:4854): protocol: rpc: dial tcp 145.79.227.32:4854: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.755312278 (302h55m7.247744733s) [seg_pos={0 0}, upload=266387]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Sep 11 05:02:46.866353400 (302h55m7.358785843s) [upload=266387]: Done uploading segments... Sep 11 05:02:46.866397083 (302h55m7.358829529s) [upload=266387]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 2.432504002s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................XX................................] duration: 2.354409504s FAIL (2025-09-11 05:25:56 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.35450279s core uplink us-select-1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 515.149581ms target: https://ap1.storj.io/login FAIL (2025-09-11 05:25:46 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: i/o timeout Duration: 515.175833ms core satellite ap1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 2 out of 60 is failed (threshold=3) [.............................XX.............................] duration: 339.914404ms target: https://version.storj.io/ FAIL (2025-09-11 05:25:39 UTC) orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: i/o timeout Duration: 339.94879ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...........................XX...............................] duration: 2.358575052s FAIL (2025-09-11 05:25:38 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.358654389s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 2.351455811s FAIL (2025-09-11 05:25:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== 6387]: Got next segment. Inline: false Sep 11 05:01:47.070094760 (302h54m7.562527201s) [upload=266387]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 05:01:47.070100812 (302h54m7.562533255s) [upload=266387]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 05:01:47.282517324 (302h54m7.774949756s) [seg_pos={0 0}, upload=266387]: Begin upload segment... Sep 11 05:01:47.282586917 (302h54m7.775019351s) [seg_pos={0 0}, upload=266387]: Done begin upload segment. Sep 11 05:01:47.282630874 (302h54m7.775063319s) [noise=true , address=145.79.227.2:4121 , piece_id=KUVJMQVN5VOZCGW5W4DY5BMLI5IH23GSC2IFN6PH6XEA4OT3VUMA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283078686 (302h54m7.775511133s) [noise=true , address=45.91.116.8:4051 , piece_id=PPCINK7K25XXRN3JQPMWVBQVPXXP7UPVSILUGIKWO3OI7EEI42FQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283596723 (302h54m7.776029168s) [noise=true , address=45.91.116.11:4147 , piece_id=BPNZTKMMEXM5B6UQSOLWZTZVVT5UOV2QHPSZL742DHQ3AQ3O6ESA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283956314 (302h54m7.776388767s) [noise=true , address=45.91.116.6:4984 , piece_id=GQV5UTDPDAYNRXXQH7FL427GSQ5W5BLLOVQIN7NUIQIIIV7AJ4RQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284193911 (302h54m7.776626359s) [noise=true , address=145.79.227.13:4815 , piece_id=GBLGYGVE3WCY27XULJK6UYLUUZFPID33MA7X6N62TWHAMVRH3JBQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284732917 (302h54m7.777165362s) [noise=true , address=77.90.31.11:4556 , piece_id=QCYMCO46JRT2K6H46FYCDTZH6RTTL2Q46HOC2VW44IPTZ2W2KQRQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284833471 (302h54m7.77726592s) [noise=true , address=145.79.227.33:4884 , piece_id=ZTHSKPCM7ZF5BKF26VRUXLJ2N3KGZYFK6HJTKOHYDUJFFYRR7HDA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.285523649 (302h54m7.777956091s) [noise=true , address=145.79.227.32:4854 , piece_id=2YLGSMO4KJ4OTLCQLTFWB6SFEEUPT3X5XKWE7KDQSX7W5LO7FO5Q, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.285585257 (302h54m7.778017699s) [noise=true , address=145.79.227.12:4770 , piece_id=NYBMVQLHBRCGAK2QQHSZ2BRZN3XAMMJKCRYKS4QWI7ZFH64XEGEA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.286297044 (302h54m7.778729499s) [noise=true , address=145.79.227.30:4771 , piece_id=SKXNQMX4RW3KCWKY5TMDPUI5QZJXYROJBMV5Y4P7MAUZUGCSUIEA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.286526017 (302h54m7.778958471s) [noise=true , address=145.79.227.5:4240 , piece_id=Q4PEISD7R7IO4BYBWLADEXE6JBUGQ5AY4J3IPX4P3Q6HZBUSYN7Q, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287104751 (302h54m7.779537193s) [noise=true , address=45.91.116.6:4008 , piece_id=PWJH5FFOUVPV64I4FLTGTBCMYLMIYBEZBZBUCI2WJQBKOPR4KABA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287470770 (302h54m7.779903218s) [noise=true , address=145.79.227.17:4984 , piece_id=ARCUIGNVITSNKFJYAJQEP24HJVBBBDOZ3FRLUQASEZFN2IXGMPLQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287613969 (302h54m7.780046423s) [noise=true , address=145.79.227.14:4843 , piece_id=IXNCU3WCMDYAVT6IE4ETEMTKQROPHV4V77VO5TNNZP5ASMW3WJQQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287960566 (302h54m7.780393019s) [noise=true , address=77.90.31.17:4795 , piece_id=2GUT5J77OOFK3OU6DG5IVXAXCBSV7SZRCXX3TPYZIRMCKGX3JUOQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289210694 (302h54m7.781643146s) [noise=true , address=145.79.227.11:4733 , piece_id=FPN5NMMTUYQHWRQOOYB5RPDKTWHEEWA3CX2OMH233YHTID6MWIFQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289586052 (302h54m7.782018502s) [noise=true , address=145.79.227.37:4589 , piece_id=K4HCLE6PM54ZXJVN5KO626R5UUP32OVEN6DDYIFUM6EYQCRVT7YQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289971344 (302h54m7.782403791s) [noise=true , address=145.79.227.36:4524 , piece_id=RSUO6BNALYS7M6W4RJ55UOD35LNCPD26PQDZBCNY6HHVDFQTRVRQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.849451002 (302h54m8.341883437s) [upload=266387]: Next returned nil segment Sep 11 05:01:47.850308233 (302h54m8.342740675s) [upload=266387]: Waiting for error group managing segments... Sep 11 05:01:47.994127497 (302h54m8.486559926s) [noise=true , address=145.79.227.14:4843 , piece_id=IXNCU3WCMDYAVT6IE4ETEMTKQROPHV4V77VO5TNNZP5ASMW3WJQQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.995677280 (302h54m8.488109717s) [noise=true , address=145.79.227.11:4733 , piece_id=FPN5NMMTUYQHWRQOOYB5RPDKTWHEEWA3CX2OMH233YHTID6MWIFQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.996836577 (302h54m8.489269006s) [noise=true , address=145.79.227.30:4771 , piece_id=SKXNQMX4RW3KCWKY5TMDPUI5QZJXYROJBMV5Y4P7MAUZUGCSUIEA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.997314105 (302h54m8.489746535s) [noise=true , address=145.79.227.13:4815 , piece_id=GBLGYGVE3WCY27XULJK6UYLUUZFPID33MA7X6N62TWHAMVRH3JBQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.997716103 (302h54m8.490148547s) [noise=true , address=145.79.227.36:4524 , piece_id=RSUO6BNALYS7M6W4RJ55UOD35LNCPD26PQDZBCNY6HHVDFQTRVRQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.998369140 (302h54m8.490801569s) [noise=true , address=145.79.227.17:4984 , piece_id=ARCUIGNVITSNKFJYAJQEP24HJVBBBDOZ3FRLUQASEZFN2IXGMPLQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.998606161 (302h54m8.491038597s) [noise=true , address=77.90.31.11:4556 , piece_id=QCYMCO46JRT2K6H46FYCDTZH6RTTL2Q46HOC2VW44IPTZ2W2KQRQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.002273466 (302h54m8.494705902s) [noise=true , address=77.90.31.17:4795 , piece_id=2GUT5J77OOFK3OU6DG5IVXAXCBSV7SZRCXX3TPYZIRMCKGX3JUOQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.006810730 (302h54m8.499243159s) [noise=true , address=145.79.227.12:4770 , piece_id=NYBMVQLHBRCGAK2QQHSZ2BRZN3XAMMJKCRYKS4QWI7ZFH64XEGEA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.011564887 (302h54m8.503997331s) [noise=true , address=145.79.227.33:4884 , piece_id=ZTHSKPCM7ZF5BKF26VRUXLJ2N3KGZYFK6HJTKOHYDUJFFYRR7HDA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.023440869 (302h54m8.515873298s) [noise=true , address=45.91.116.11:4147 , piece_id=BPNZTKMMEXM5B6UQSOLWZTZVVT5UOV2QHPSZL742DHQ3AQ3O6ESA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.085368080 (302h54m8.577800508s) [noise=true , address=145.79.227.37:4589 , piece_id=K4HCLE6PM54ZXJVN5KO626R5UUP32OVEN6DDYIFUM6EYQCRVT7YQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:02:46.754779889 (302h55m7.247212318s) [noise=true , address=145.79.227.5:4240 , piece_id=Q4PEISD7R7IO4BYBWLADEXE6JBUGQ5AY4J3IPX4P3Q6HZBUSYN7Q, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:13SaC5StbguPT3abAT9oTX3mZAyGhJcpAA6b7ueyiDFHa8CCEo, address:145.79.227.5:4240): protocol: rpc: dial tcp 145.79.227.5:4240: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.754831971 (302h55m7.247264401s) [noise=true , address=145.79.227.2:4121 , piece_id=KUVJMQVN5VOZCGW5W4DY5BMLI5IH23GSC2IFN6PH6XEA4OT3VUMA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:1Fq1JNvrZLTFTQLVF8jzyavJ6dU1xX96FTGcyxfaHiPdCLu4pB, address:145.79.227.2:4121): protocol: context deadline exceeded; context deadline exceeded Sep 11 05:02:46.754895261 (302h55m7.247327705s) [noise=true , address=45.91.116.8:4051 , piece_id=PPCINK7K25XXRN3JQPMWVBQVPXXP7UPVSILUGIKWO3OI7EEI42FQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3, address:45.91.116.8:4051): protocol: write tcp 139.59.144.22:38826->45.91.116.8:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.754988069 (302h55m7.247420503s) [noise=true , address=45.91.116.6:4008 , piece_id=PWJH5FFOUVPV64I4FLTGTBCMYLMIYBEZBZBUCI2WJQBKOPR4KABA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:16KXs6ZXZyroRJibAYU5bsga1RFSpmf7yEtaNG7tamaX7QKvng, address:45.91.116.6:4008): protocol: context deadline exceeded; context deadline exceeded Sep 11 05:02:46.755109851 (302h55m7.24754228s) [noise=true , address=45.91.116.6:4984 , piece_id=GQV5UTDPDAYNRXXQH7FL427GSQ5W5BLLOVQIN7NUIQIIIV7AJ4RQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:12VQKskrBadKVwYpngNNeSJPn3knJs7WXtfz9D6syskCDz9EVSt, address:45.91.116.6:4984): protocol: rpc: dial tcp 45.91.116.6:4984: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.755262600 (302h55m7.247695031s) [noise=true , address=145.79.227.32:4854 , piece_id=2YLGSMO4KJ4OTLCQLTFWB6SFEEUPT3X5XKWE7KDQSX7W5LO7FO5Q, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:12eitcwvcNX2GyMiv4GdfDD8wmgb6a1d3ggaGVxbpyKAjPjshmV, address:145.79.227.32:4854): protocol: rpc: dial tcp 145.79.227.32:4854: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.755312278 (302h55m7.247744733s) [seg_pos={0 0}, upload=266387]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Sep 11 05:02:46.866353400 (302h55m7.358785843s) [upload=266387]: Done uploading segments... Sep 11 05:02:46.866397083 (302h55m7.358829529s) [upload=266387]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 2.351487824s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 960.669583ms FAIL (2025-09-11 05:25:22 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 960.703751ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [............................XX..............................] duration: 2.580673622s FAIL (2025-09-11 05:25:20 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.580702826s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 2.523333956s FAIL (2025-09-11 05:25:00 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== 6387]: Got next segment. Inline: false Sep 11 05:01:47.070094760 (302h54m7.562527201s) [upload=266387]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 05:01:47.070100812 (302h54m7.562533255s) [upload=266387]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 05:01:47.282517324 (302h54m7.774949756s) [seg_pos={0 0}, upload=266387]: Begin upload segment... Sep 11 05:01:47.282586917 (302h54m7.775019351s) [seg_pos={0 0}, upload=266387]: Done begin upload segment. Sep 11 05:01:47.282630874 (302h54m7.775063319s) [noise=true , address=145.79.227.2:4121 , piece_id=KUVJMQVN5VOZCGW5W4DY5BMLI5IH23GSC2IFN6PH6XEA4OT3VUMA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283078686 (302h54m7.775511133s) [noise=true , address=45.91.116.8:4051 , piece_id=PPCINK7K25XXRN3JQPMWVBQVPXXP7UPVSILUGIKWO3OI7EEI42FQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283596723 (302h54m7.776029168s) [noise=true , address=45.91.116.11:4147 , piece_id=BPNZTKMMEXM5B6UQSOLWZTZVVT5UOV2QHPSZL742DHQ3AQ3O6ESA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283956314 (302h54m7.776388767s) [noise=true , address=45.91.116.6:4984 , piece_id=GQV5UTDPDAYNRXXQH7FL427GSQ5W5BLLOVQIN7NUIQIIIV7AJ4RQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284193911 (302h54m7.776626359s) [noise=true , address=145.79.227.13:4815 , piece_id=GBLGYGVE3WCY27XULJK6UYLUUZFPID33MA7X6N62TWHAMVRH3JBQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284732917 (302h54m7.777165362s) [noise=true , address=77.90.31.11:4556 , piece_id=QCYMCO46JRT2K6H46FYCDTZH6RTTL2Q46HOC2VW44IPTZ2W2KQRQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284833471 (302h54m7.77726592s) [noise=true , address=145.79.227.33:4884 , piece_id=ZTHSKPCM7ZF5BKF26VRUXLJ2N3KGZYFK6HJTKOHYDUJFFYRR7HDA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.285523649 (302h54m7.777956091s) [noise=true , address=145.79.227.32:4854 , piece_id=2YLGSMO4KJ4OTLCQLTFWB6SFEEUPT3X5XKWE7KDQSX7W5LO7FO5Q, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.285585257 (302h54m7.778017699s) [noise=true , address=145.79.227.12:4770 , piece_id=NYBMVQLHBRCGAK2QQHSZ2BRZN3XAMMJKCRYKS4QWI7ZFH64XEGEA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.286297044 (302h54m7.778729499s) [noise=true , address=145.79.227.30:4771 , piece_id=SKXNQMX4RW3KCWKY5TMDPUI5QZJXYROJBMV5Y4P7MAUZUGCSUIEA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.286526017 (302h54m7.778958471s) [noise=true , address=145.79.227.5:4240 , piece_id=Q4PEISD7R7IO4BYBWLADEXE6JBUGQ5AY4J3IPX4P3Q6HZBUSYN7Q, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287104751 (302h54m7.779537193s) [noise=true , address=45.91.116.6:4008 , piece_id=PWJH5FFOUVPV64I4FLTGTBCMYLMIYBEZBZBUCI2WJQBKOPR4KABA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287470770 (302h54m7.779903218s) [noise=true , address=145.79.227.17:4984 , piece_id=ARCUIGNVITSNKFJYAJQEP24HJVBBBDOZ3FRLUQASEZFN2IXGMPLQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287613969 (302h54m7.780046423s) [noise=true , address=145.79.227.14:4843 , piece_id=IXNCU3WCMDYAVT6IE4ETEMTKQROPHV4V77VO5TNNZP5ASMW3WJQQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287960566 (302h54m7.780393019s) [noise=true , address=77.90.31.17:4795 , piece_id=2GUT5J77OOFK3OU6DG5IVXAXCBSV7SZRCXX3TPYZIRMCKGX3JUOQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289210694 (302h54m7.781643146s) [noise=true , address=145.79.227.11:4733 , piece_id=FPN5NMMTUYQHWRQOOYB5RPDKTWHEEWA3CX2OMH233YHTID6MWIFQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289586052 (302h54m7.782018502s) [noise=true , address=145.79.227.37:4589 , piece_id=K4HCLE6PM54ZXJVN5KO626R5UUP32OVEN6DDYIFUM6EYQCRVT7YQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289971344 (302h54m7.782403791s) [noise=true , address=145.79.227.36:4524 , piece_id=RSUO6BNALYS7M6W4RJ55UOD35LNCPD26PQDZBCNY6HHVDFQTRVRQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.849451002 (302h54m8.341883437s) [upload=266387]: Next returned nil segment Sep 11 05:01:47.850308233 (302h54m8.342740675s) [upload=266387]: Waiting for error group managing segments... Sep 11 05:01:47.994127497 (302h54m8.486559926s) [noise=true , address=145.79.227.14:4843 , piece_id=IXNCU3WCMDYAVT6IE4ETEMTKQROPHV4V77VO5TNNZP5ASMW3WJQQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.995677280 (302h54m8.488109717s) [noise=true , address=145.79.227.11:4733 , piece_id=FPN5NMMTUYQHWRQOOYB5RPDKTWHEEWA3CX2OMH233YHTID6MWIFQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.996836577 (302h54m8.489269006s) [noise=true , address=145.79.227.30:4771 , piece_id=SKXNQMX4RW3KCWKY5TMDPUI5QZJXYROJBMV5Y4P7MAUZUGCSUIEA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.997314105 (302h54m8.489746535s) [noise=true , address=145.79.227.13:4815 , piece_id=GBLGYGVE3WCY27XULJK6UYLUUZFPID33MA7X6N62TWHAMVRH3JBQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.997716103 (302h54m8.490148547s) [noise=true , address=145.79.227.36:4524 , piece_id=RSUO6BNALYS7M6W4RJ55UOD35LNCPD26PQDZBCNY6HHVDFQTRVRQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.998369140 (302h54m8.490801569s) [noise=true , address=145.79.227.17:4984 , piece_id=ARCUIGNVITSNKFJYAJQEP24HJVBBBDOZ3FRLUQASEZFN2IXGMPLQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.998606161 (302h54m8.491038597s) [noise=true , address=77.90.31.11:4556 , piece_id=QCYMCO46JRT2K6H46FYCDTZH6RTTL2Q46HOC2VW44IPTZ2W2KQRQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.002273466 (302h54m8.494705902s) [noise=true , address=77.90.31.17:4795 , piece_id=2GUT5J77OOFK3OU6DG5IVXAXCBSV7SZRCXX3TPYZIRMCKGX3JUOQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.006810730 (302h54m8.499243159s) [noise=true , address=145.79.227.12:4770 , piece_id=NYBMVQLHBRCGAK2QQHSZ2BRZN3XAMMJKCRYKS4QWI7ZFH64XEGEA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.011564887 (302h54m8.503997331s) [noise=true , address=145.79.227.33:4884 , piece_id=ZTHSKPCM7ZF5BKF26VRUXLJ2N3KGZYFK6HJTKOHYDUJFFYRR7HDA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.023440869 (302h54m8.515873298s) [noise=true , address=45.91.116.11:4147 , piece_id=BPNZTKMMEXM5B6UQSOLWZTZVVT5UOV2QHPSZL742DHQ3AQ3O6ESA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.085368080 (302h54m8.577800508s) [noise=true , address=145.79.227.37:4589 , piece_id=K4HCLE6PM54ZXJVN5KO626R5UUP32OVEN6DDYIFUM6EYQCRVT7YQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:02:46.754779889 (302h55m7.247212318s) [noise=true , address=145.79.227.5:4240 , piece_id=Q4PEISD7R7IO4BYBWLADEXE6JBUGQ5AY4J3IPX4P3Q6HZBUSYN7Q, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:13SaC5StbguPT3abAT9oTX3mZAyGhJcpAA6b7ueyiDFHa8CCEo, address:145.79.227.5:4240): protocol: rpc: dial tcp 145.79.227.5:4240: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.754831971 (302h55m7.247264401s) [noise=true , address=145.79.227.2:4121 , piece_id=KUVJMQVN5VOZCGW5W4DY5BMLI5IH23GSC2IFN6PH6XEA4OT3VUMA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:1Fq1JNvrZLTFTQLVF8jzyavJ6dU1xX96FTGcyxfaHiPdCLu4pB, address:145.79.227.2:4121): protocol: context deadline exceeded; context deadline exceeded Sep 11 05:02:46.754895261 (302h55m7.247327705s) [noise=true , address=45.91.116.8:4051 , piece_id=PPCINK7K25XXRN3JQPMWVBQVPXXP7UPVSILUGIKWO3OI7EEI42FQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3, address:45.91.116.8:4051): protocol: write tcp 139.59.144.22:38826->45.91.116.8:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.754988069 (302h55m7.247420503s) [noise=true , address=45.91.116.6:4008 , piece_id=PWJH5FFOUVPV64I4FLTGTBCMYLMIYBEZBZBUCI2WJQBKOPR4KABA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:16KXs6ZXZyroRJibAYU5bsga1RFSpmf7yEtaNG7tamaX7QKvng, address:45.91.116.6:4008): protocol: context deadline exceeded; context deadline exceeded Sep 11 05:02:46.755109851 (302h55m7.24754228s) [noise=true , address=45.91.116.6:4984 , piece_id=GQV5UTDPDAYNRXXQH7FL427GSQ5W5BLLOVQIN7NUIQIIIV7AJ4RQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:12VQKskrBadKVwYpngNNeSJPn3knJs7WXtfz9D6syskCDz9EVSt, address:45.91.116.6:4984): protocol: rpc: dial tcp 45.91.116.6:4984: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.755262600 (302h55m7.247695031s) [noise=true , address=145.79.227.32:4854 , piece_id=2YLGSMO4KJ4OTLCQLTFWB6SFEEUPT3X5XKWE7KDQSX7W5LO7FO5Q, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:12eitcwvcNX2GyMiv4GdfDD8wmgb6a1d3ggaGVxbpyKAjPjshmV, address:145.79.227.32:4854): protocol: rpc: dial tcp 145.79.227.32:4854: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.755312278 (302h55m7.247744733s) [seg_pos={0 0}, upload=266387]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Sep 11 05:02:46.866353400 (302h55m7.358785843s) [upload=266387]: Done uploading segments... Sep 11 05:02:46.866397083 (302h55m7.358829529s) [upload=266387]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 2.523360134s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 951.865347ms FAIL (2025-09-11 05:24:59 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 951.897747ms core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 519.382167ms target: https://ap1.storj.io/login FAIL (2025-09-11 05:24:58 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: i/o timeout Duration: 519.405756ms core satellite ap1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 2 out of 60 is failed (threshold=3) [..............................XX............................] duration: 341.113533ms target: https://version.storj.io/ FAIL (2025-09-11 05:24:40 UTC) orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: i/o timeout Duration: 341.167308ms core website
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 522.276301ms target: https://ap1.storj.io/login FAIL (2025-09-11 05:24:32 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: i/o timeout Duration: 522.309813ms core satellite ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.............................XX.............................] duration: 2.414018732s FAIL (2025-09-11 05:24:24 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.414121126s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 1.0559846s FAIL (2025-09-11 05:24:23 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.056027591s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 2.404252535s FAIL (2025-09-11 05:23:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== 6387]: Got next segment. Inline: false Sep 11 05:01:47.070094760 (302h54m7.562527201s) [upload=266387]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 05:01:47.070100812 (302h54m7.562533255s) [upload=266387]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 05:01:47.282517324 (302h54m7.774949756s) [seg_pos={0 0}, upload=266387]: Begin upload segment... Sep 11 05:01:47.282586917 (302h54m7.775019351s) [seg_pos={0 0}, upload=266387]: Done begin upload segment. Sep 11 05:01:47.282630874 (302h54m7.775063319s) [noise=true , address=145.79.227.2:4121 , piece_id=KUVJMQVN5VOZCGW5W4DY5BMLI5IH23GSC2IFN6PH6XEA4OT3VUMA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283078686 (302h54m7.775511133s) [noise=true , address=45.91.116.8:4051 , piece_id=PPCINK7K25XXRN3JQPMWVBQVPXXP7UPVSILUGIKWO3OI7EEI42FQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283596723 (302h54m7.776029168s) [noise=true , address=45.91.116.11:4147 , piece_id=BPNZTKMMEXM5B6UQSOLWZTZVVT5UOV2QHPSZL742DHQ3AQ3O6ESA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283956314 (302h54m7.776388767s) [noise=true , address=45.91.116.6:4984 , piece_id=GQV5UTDPDAYNRXXQH7FL427GSQ5W5BLLOVQIN7NUIQIIIV7AJ4RQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284193911 (302h54m7.776626359s) [noise=true , address=145.79.227.13:4815 , piece_id=GBLGYGVE3WCY27XULJK6UYLUUZFPID33MA7X6N62TWHAMVRH3JBQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284732917 (302h54m7.777165362s) [noise=true , address=77.90.31.11:4556 , piece_id=QCYMCO46JRT2K6H46FYCDTZH6RTTL2Q46HOC2VW44IPTZ2W2KQRQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284833471 (302h54m7.77726592s) [noise=true , address=145.79.227.33:4884 , piece_id=ZTHSKPCM7ZF5BKF26VRUXLJ2N3KGZYFK6HJTKOHYDUJFFYRR7HDA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.285523649 (302h54m7.777956091s) [noise=true , address=145.79.227.32:4854 , piece_id=2YLGSMO4KJ4OTLCQLTFWB6SFEEUPT3X5XKWE7KDQSX7W5LO7FO5Q, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.285585257 (302h54m7.778017699s) [noise=true , address=145.79.227.12:4770 , piece_id=NYBMVQLHBRCGAK2QQHSZ2BRZN3XAMMJKCRYKS4QWI7ZFH64XEGEA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.286297044 (302h54m7.778729499s) [noise=true , address=145.79.227.30:4771 , piece_id=SKXNQMX4RW3KCWKY5TMDPUI5QZJXYROJBMV5Y4P7MAUZUGCSUIEA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.286526017 (302h54m7.778958471s) [noise=true , address=145.79.227.5:4240 , piece_id=Q4PEISD7R7IO4BYBWLADEXE6JBUGQ5AY4J3IPX4P3Q6HZBUSYN7Q, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287104751 (302h54m7.779537193s) [noise=true , address=45.91.116.6:4008 , piece_id=PWJH5FFOUVPV64I4FLTGTBCMYLMIYBEZBZBUCI2WJQBKOPR4KABA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287470770 (302h54m7.779903218s) [noise=true , address=145.79.227.17:4984 , piece_id=ARCUIGNVITSNKFJYAJQEP24HJVBBBDOZ3FRLUQASEZFN2IXGMPLQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287613969 (302h54m7.780046423s) [noise=true , address=145.79.227.14:4843 , piece_id=IXNCU3WCMDYAVT6IE4ETEMTKQROPHV4V77VO5TNNZP5ASMW3WJQQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287960566 (302h54m7.780393019s) [noise=true , address=77.90.31.17:4795 , piece_id=2GUT5J77OOFK3OU6DG5IVXAXCBSV7SZRCXX3TPYZIRMCKGX3JUOQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289210694 (302h54m7.781643146s) [noise=true , address=145.79.227.11:4733 , piece_id=FPN5NMMTUYQHWRQOOYB5RPDKTWHEEWA3CX2OMH233YHTID6MWIFQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289586052 (302h54m7.782018502s) [noise=true , address=145.79.227.37:4589 , piece_id=K4HCLE6PM54ZXJVN5KO626R5UUP32OVEN6DDYIFUM6EYQCRVT7YQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289971344 (302h54m7.782403791s) [noise=true , address=145.79.227.36:4524 , piece_id=RSUO6BNALYS7M6W4RJ55UOD35LNCPD26PQDZBCNY6HHVDFQTRVRQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.849451002 (302h54m8.341883437s) [upload=266387]: Next returned nil segment Sep 11 05:01:47.850308233 (302h54m8.342740675s) [upload=266387]: Waiting for error group managing segments... Sep 11 05:01:47.994127497 (302h54m8.486559926s) [noise=true , address=145.79.227.14:4843 , piece_id=IXNCU3WCMDYAVT6IE4ETEMTKQROPHV4V77VO5TNNZP5ASMW3WJQQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.995677280 (302h54m8.488109717s) [noise=true , address=145.79.227.11:4733 , piece_id=FPN5NMMTUYQHWRQOOYB5RPDKTWHEEWA3CX2OMH233YHTID6MWIFQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.996836577 (302h54m8.489269006s) [noise=true , address=145.79.227.30:4771 , piece_id=SKXNQMX4RW3KCWKY5TMDPUI5QZJXYROJBMV5Y4P7MAUZUGCSUIEA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.997314105 (302h54m8.489746535s) [noise=true , address=145.79.227.13:4815 , piece_id=GBLGYGVE3WCY27XULJK6UYLUUZFPID33MA7X6N62TWHAMVRH3JBQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.997716103 (302h54m8.490148547s) [noise=true , address=145.79.227.36:4524 , piece_id=RSUO6BNALYS7M6W4RJ55UOD35LNCPD26PQDZBCNY6HHVDFQTRVRQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.998369140 (302h54m8.490801569s) [noise=true , address=145.79.227.17:4984 , piece_id=ARCUIGNVITSNKFJYAJQEP24HJVBBBDOZ3FRLUQASEZFN2IXGMPLQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.998606161 (302h54m8.491038597s) [noise=true , address=77.90.31.11:4556 , piece_id=QCYMCO46JRT2K6H46FYCDTZH6RTTL2Q46HOC2VW44IPTZ2W2KQRQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.002273466 (302h54m8.494705902s) [noise=true , address=77.90.31.17:4795 , piece_id=2GUT5J77OOFK3OU6DG5IVXAXCBSV7SZRCXX3TPYZIRMCKGX3JUOQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.006810730 (302h54m8.499243159s) [noise=true , address=145.79.227.12:4770 , piece_id=NYBMVQLHBRCGAK2QQHSZ2BRZN3XAMMJKCRYKS4QWI7ZFH64XEGEA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.011564887 (302h54m8.503997331s) [noise=true , address=145.79.227.33:4884 , piece_id=ZTHSKPCM7ZF5BKF26VRUXLJ2N3KGZYFK6HJTKOHYDUJFFYRR7HDA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.023440869 (302h54m8.515873298s) [noise=true , address=45.91.116.11:4147 , piece_id=BPNZTKMMEXM5B6UQSOLWZTZVVT5UOV2QHPSZL742DHQ3AQ3O6ESA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.085368080 (302h54m8.577800508s) [noise=true , address=145.79.227.37:4589 , piece_id=K4HCLE6PM54ZXJVN5KO626R5UUP32OVEN6DDYIFUM6EYQCRVT7YQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:02:46.754779889 (302h55m7.247212318s) [noise=true , address=145.79.227.5:4240 , piece_id=Q4PEISD7R7IO4BYBWLADEXE6JBUGQ5AY4J3IPX4P3Q6HZBUSYN7Q, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:13SaC5StbguPT3abAT9oTX3mZAyGhJcpAA6b7ueyiDFHa8CCEo, address:145.79.227.5:4240): protocol: rpc: dial tcp 145.79.227.5:4240: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.754831971 (302h55m7.247264401s) [noise=true , address=145.79.227.2:4121 , piece_id=KUVJMQVN5VOZCGW5W4DY5BMLI5IH23GSC2IFN6PH6XEA4OT3VUMA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:1Fq1JNvrZLTFTQLVF8jzyavJ6dU1xX96FTGcyxfaHiPdCLu4pB, address:145.79.227.2:4121): protocol: context deadline exceeded; context deadline exceeded Sep 11 05:02:46.754895261 (302h55m7.247327705s) [noise=true , address=45.91.116.8:4051 , piece_id=PPCINK7K25XXRN3JQPMWVBQVPXXP7UPVSILUGIKWO3OI7EEI42FQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3, address:45.91.116.8:4051): protocol: write tcp 139.59.144.22:38826->45.91.116.8:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.754988069 (302h55m7.247420503s) [noise=true , address=45.91.116.6:4008 , piece_id=PWJH5FFOUVPV64I4FLTGTBCMYLMIYBEZBZBUCI2WJQBKOPR4KABA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:16KXs6ZXZyroRJibAYU5bsga1RFSpmf7yEtaNG7tamaX7QKvng, address:45.91.116.6:4008): protocol: context deadline exceeded; context deadline exceeded Sep 11 05:02:46.755109851 (302h55m7.24754228s) [noise=true , address=45.91.116.6:4984 , piece_id=GQV5UTDPDAYNRXXQH7FL427GSQ5W5BLLOVQIN7NUIQIIIV7AJ4RQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:12VQKskrBadKVwYpngNNeSJPn3knJs7WXtfz9D6syskCDz9EVSt, address:45.91.116.6:4984): protocol: rpc: dial tcp 45.91.116.6:4984: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.755262600 (302h55m7.247695031s) [noise=true , address=145.79.227.32:4854 , piece_id=2YLGSMO4KJ4OTLCQLTFWB6SFEEUPT3X5XKWE7KDQSX7W5LO7FO5Q, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:12eitcwvcNX2GyMiv4GdfDD8wmgb6a1d3ggaGVxbpyKAjPjshmV, address:145.79.227.32:4854): protocol: rpc: dial tcp 145.79.227.32:4854: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.755312278 (302h55m7.247744733s) [seg_pos={0 0}, upload=266387]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Sep 11 05:02:46.866353400 (302h55m7.358785843s) [upload=266387]: Done uploading segments... Sep 11 05:02:46.866397083 (302h55m7.358829529s) [upload=266387]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 2.404292921s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 926.6296ms FAIL (2025-09-11 05:23:41 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 926.675594ms core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 510.404564ms target: https://ap1.storj.io/login FAIL (2025-09-11 05:23:34 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: i/o timeout Duration: 510.433876ms core satellite ap1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 2 out of 60 is failed (threshold=3) [...............................XX...........................] duration: 332.218665ms target: https://version.storj.io/ FAIL (2025-09-11 05:23:30 UTC) orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: i/o timeout Duration: 332.267165ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 2.656617643s FAIL (2025-09-11 05:23:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== 6387]: Got next segment. Inline: false Sep 11 05:01:47.070094760 (302h54m7.562527201s) [upload=266387]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 05:01:47.070100812 (302h54m7.562533255s) [upload=266387]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 05:01:47.282517324 (302h54m7.774949756s) [seg_pos={0 0}, upload=266387]: Begin upload segment... Sep 11 05:01:47.282586917 (302h54m7.775019351s) [seg_pos={0 0}, upload=266387]: Done begin upload segment. Sep 11 05:01:47.282630874 (302h54m7.775063319s) [noise=true , address=145.79.227.2:4121 , piece_id=KUVJMQVN5VOZCGW5W4DY5BMLI5IH23GSC2IFN6PH6XEA4OT3VUMA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283078686 (302h54m7.775511133s) [noise=true , address=45.91.116.8:4051 , piece_id=PPCINK7K25XXRN3JQPMWVBQVPXXP7UPVSILUGIKWO3OI7EEI42FQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283596723 (302h54m7.776029168s) [noise=true , address=45.91.116.11:4147 , piece_id=BPNZTKMMEXM5B6UQSOLWZTZVVT5UOV2QHPSZL742DHQ3AQ3O6ESA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283956314 (302h54m7.776388767s) [noise=true , address=45.91.116.6:4984 , piece_id=GQV5UTDPDAYNRXXQH7FL427GSQ5W5BLLOVQIN7NUIQIIIV7AJ4RQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284193911 (302h54m7.776626359s) [noise=true , address=145.79.227.13:4815 , piece_id=GBLGYGVE3WCY27XULJK6UYLUUZFPID33MA7X6N62TWHAMVRH3JBQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284732917 (302h54m7.777165362s) [noise=true , address=77.90.31.11:4556 , piece_id=QCYMCO46JRT2K6H46FYCDTZH6RTTL2Q46HOC2VW44IPTZ2W2KQRQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284833471 (302h54m7.77726592s) [noise=true , address=145.79.227.33:4884 , piece_id=ZTHSKPCM7ZF5BKF26VRUXLJ2N3KGZYFK6HJTKOHYDUJFFYRR7HDA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.285523649 (302h54m7.777956091s) [noise=true , address=145.79.227.32:4854 , piece_id=2YLGSMO4KJ4OTLCQLTFWB6SFEEUPT3X5XKWE7KDQSX7W5LO7FO5Q, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.285585257 (302h54m7.778017699s) [noise=true , address=145.79.227.12:4770 , piece_id=NYBMVQLHBRCGAK2QQHSZ2BRZN3XAMMJKCRYKS4QWI7ZFH64XEGEA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.286297044 (302h54m7.778729499s) [noise=true , address=145.79.227.30:4771 , piece_id=SKXNQMX4RW3KCWKY5TMDPUI5QZJXYROJBMV5Y4P7MAUZUGCSUIEA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.286526017 (302h54m7.778958471s) [noise=true , address=145.79.227.5:4240 , piece_id=Q4PEISD7R7IO4BYBWLADEXE6JBUGQ5AY4J3IPX4P3Q6HZBUSYN7Q, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287104751 (302h54m7.779537193s) [noise=true , address=45.91.116.6:4008 , piece_id=PWJH5FFOUVPV64I4FLTGTBCMYLMIYBEZBZBUCI2WJQBKOPR4KABA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287470770 (302h54m7.779903218s) [noise=true , address=145.79.227.17:4984 , piece_id=ARCUIGNVITSNKFJYAJQEP24HJVBBBDOZ3FRLUQASEZFN2IXGMPLQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287613969 (302h54m7.780046423s) [noise=true , address=145.79.227.14:4843 , piece_id=IXNCU3WCMDYAVT6IE4ETEMTKQROPHV4V77VO5TNNZP5ASMW3WJQQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287960566 (302h54m7.780393019s) [noise=true , address=77.90.31.17:4795 , piece_id=2GUT5J77OOFK3OU6DG5IVXAXCBSV7SZRCXX3TPYZIRMCKGX3JUOQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289210694 (302h54m7.781643146s) [noise=true , address=145.79.227.11:4733 , piece_id=FPN5NMMTUYQHWRQOOYB5RPDKTWHEEWA3CX2OMH233YHTID6MWIFQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289586052 (302h54m7.782018502s) [noise=true , address=145.79.227.37:4589 , piece_id=K4HCLE6PM54ZXJVN5KO626R5UUP32OVEN6DDYIFUM6EYQCRVT7YQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289971344 (302h54m7.782403791s) [noise=true , address=145.79.227.36:4524 , piece_id=RSUO6BNALYS7M6W4RJ55UOD35LNCPD26PQDZBCNY6HHVDFQTRVRQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.849451002 (302h54m8.341883437s) [upload=266387]: Next returned nil segment Sep 11 05:01:47.850308233 (302h54m8.342740675s) [upload=266387]: Waiting for error group managing segments... Sep 11 05:01:47.994127497 (302h54m8.486559926s) [noise=true , address=145.79.227.14:4843 , piece_id=IXNCU3WCMDYAVT6IE4ETEMTKQROPHV4V77VO5TNNZP5ASMW3WJQQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.995677280 (302h54m8.488109717s) [noise=true , address=145.79.227.11:4733 , piece_id=FPN5NMMTUYQHWRQOOYB5RPDKTWHEEWA3CX2OMH233YHTID6MWIFQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.996836577 (302h54m8.489269006s) [noise=true , address=145.79.227.30:4771 , piece_id=SKXNQMX4RW3KCWKY5TMDPUI5QZJXYROJBMV5Y4P7MAUZUGCSUIEA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.997314105 (302h54m8.489746535s) [noise=true , address=145.79.227.13:4815 , piece_id=GBLGYGVE3WCY27XULJK6UYLUUZFPID33MA7X6N62TWHAMVRH3JBQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.997716103 (302h54m8.490148547s) [noise=true , address=145.79.227.36:4524 , piece_id=RSUO6BNALYS7M6W4RJ55UOD35LNCPD26PQDZBCNY6HHVDFQTRVRQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.998369140 (302h54m8.490801569s) [noise=true , address=145.79.227.17:4984 , piece_id=ARCUIGNVITSNKFJYAJQEP24HJVBBBDOZ3FRLUQASEZFN2IXGMPLQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.998606161 (302h54m8.491038597s) [noise=true , address=77.90.31.11:4556 , piece_id=QCYMCO46JRT2K6H46FYCDTZH6RTTL2Q46HOC2VW44IPTZ2W2KQRQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.002273466 (302h54m8.494705902s) [noise=true , address=77.90.31.17:4795 , piece_id=2GUT5J77OOFK3OU6DG5IVXAXCBSV7SZRCXX3TPYZIRMCKGX3JUOQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.006810730 (302h54m8.499243159s) [noise=true , address=145.79.227.12:4770 , piece_id=NYBMVQLHBRCGAK2QQHSZ2BRZN3XAMMJKCRYKS4QWI7ZFH64XEGEA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.011564887 (302h54m8.503997331s) [noise=true , address=145.79.227.33:4884 , piece_id=ZTHSKPCM7ZF5BKF26VRUXLJ2N3KGZYFK6HJTKOHYDUJFFYRR7HDA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.023440869 (302h54m8.515873298s) [noise=true , address=45.91.116.11:4147 , piece_id=BPNZTKMMEXM5B6UQSOLWZTZVVT5UOV2QHPSZL742DHQ3AQ3O6ESA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.085368080 (302h54m8.577800508s) [noise=true , address=145.79.227.37:4589 , piece_id=K4HCLE6PM54ZXJVN5KO626R5UUP32OVEN6DDYIFUM6EYQCRVT7YQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:02:46.754779889 (302h55m7.247212318s) [noise=true , address=145.79.227.5:4240 , piece_id=Q4PEISD7R7IO4BYBWLADEXE6JBUGQ5AY4J3IPX4P3Q6HZBUSYN7Q, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:13SaC5StbguPT3abAT9oTX3mZAyGhJcpAA6b7ueyiDFHa8CCEo, address:145.79.227.5:4240): protocol: rpc: dial tcp 145.79.227.5:4240: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.754831971 (302h55m7.247264401s) [noise=true , address=145.79.227.2:4121 , piece_id=KUVJMQVN5VOZCGW5W4DY5BMLI5IH23GSC2IFN6PH6XEA4OT3VUMA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:1Fq1JNvrZLTFTQLVF8jzyavJ6dU1xX96FTGcyxfaHiPdCLu4pB, address:145.79.227.2:4121): protocol: context deadline exceeded; context deadline exceeded Sep 11 05:02:46.754895261 (302h55m7.247327705s) [noise=true , address=45.91.116.8:4051 , piece_id=PPCINK7K25XXRN3JQPMWVBQVPXXP7UPVSILUGIKWO3OI7EEI42FQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3, address:45.91.116.8:4051): protocol: write tcp 139.59.144.22:38826->45.91.116.8:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.754988069 (302h55m7.247420503s) [noise=true , address=45.91.116.6:4008 , piece_id=PWJH5FFOUVPV64I4FLTGTBCMYLMIYBEZBZBUCI2WJQBKOPR4KABA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:16KXs6ZXZyroRJibAYU5bsga1RFSpmf7yEtaNG7tamaX7QKvng, address:45.91.116.6:4008): protocol: context deadline exceeded; context deadline exceeded Sep 11 05:02:46.755109851 (302h55m7.24754228s) [noise=true , address=45.91.116.6:4984 , piece_id=GQV5UTDPDAYNRXXQH7FL427GSQ5W5BLLOVQIN7NUIQIIIV7AJ4RQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:12VQKskrBadKVwYpngNNeSJPn3knJs7WXtfz9D6syskCDz9EVSt, address:45.91.116.6:4984): protocol: rpc: dial tcp 45.91.116.6:4984: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.755262600 (302h55m7.247695031s) [noise=true , address=145.79.227.32:4854 , piece_id=2YLGSMO4KJ4OTLCQLTFWB6SFEEUPT3X5XKWE7KDQSX7W5LO7FO5Q, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:12eitcwvcNX2GyMiv4GdfDD8wmgb6a1d3ggaGVxbpyKAjPjshmV, address:145.79.227.32:4854): protocol: rpc: dial tcp 145.79.227.32:4854: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.755312278 (302h55m7.247744733s) [seg_pos={0 0}, upload=266387]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Sep 11 05:02:46.866353400 (302h55m7.358785843s) [upload=266387]: Done uploading segments... Sep 11 05:02:46.866397083 (302h55m7.358829529s) [upload=266387]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 2.656667853s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..............................XX............................] duration: 2.850960673s FAIL (2025-09-11 05:23:17 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.85099993s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 916.324683ms FAIL (2025-09-11 05:23:14 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 916.363964ms core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 520.472046ms target: https://ap1.storj.io/login FAIL (2025-09-11 05:23:07 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: i/o timeout Duration: 520.589853ms core satellite ap1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 2 out of 60 is failed (threshold=3) [................................XX..........................] duration: 338.15998ms target: https://version.storj.io/ FAIL (2025-09-11 05:22:47 UTC) orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: i/o timeout Duration: 338.19831ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...............................XX...........................] duration: 2.516990763s FAIL (2025-09-11 05:22:46 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.517057908s core uplink us-select-1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 534.703916ms target: https://ap1.storj.io/login FAIL (2025-09-11 05:22:42 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: i/o timeout Duration: 534.736792ms core satellite ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 2.45963082s FAIL (2025-09-11 05:22:37 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== 6387]: Got next segment. Inline: false Sep 11 05:01:47.070094760 (302h54m7.562527201s) [upload=266387]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 05:01:47.070100812 (302h54m7.562533255s) [upload=266387]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 05:01:47.282517324 (302h54m7.774949756s) [seg_pos={0 0}, upload=266387]: Begin upload segment... Sep 11 05:01:47.282586917 (302h54m7.775019351s) [seg_pos={0 0}, upload=266387]: Done begin upload segment. Sep 11 05:01:47.282630874 (302h54m7.775063319s) [noise=true , address=145.79.227.2:4121 , piece_id=KUVJMQVN5VOZCGW5W4DY5BMLI5IH23GSC2IFN6PH6XEA4OT3VUMA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283078686 (302h54m7.775511133s) [noise=true , address=45.91.116.8:4051 , piece_id=PPCINK7K25XXRN3JQPMWVBQVPXXP7UPVSILUGIKWO3OI7EEI42FQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283596723 (302h54m7.776029168s) [noise=true , address=45.91.116.11:4147 , piece_id=BPNZTKMMEXM5B6UQSOLWZTZVVT5UOV2QHPSZL742DHQ3AQ3O6ESA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283956314 (302h54m7.776388767s) [noise=true , address=45.91.116.6:4984 , piece_id=GQV5UTDPDAYNRXXQH7FL427GSQ5W5BLLOVQIN7NUIQIIIV7AJ4RQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284193911 (302h54m7.776626359s) [noise=true , address=145.79.227.13:4815 , piece_id=GBLGYGVE3WCY27XULJK6UYLUUZFPID33MA7X6N62TWHAMVRH3JBQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284732917 (302h54m7.777165362s) [noise=true , address=77.90.31.11:4556 , piece_id=QCYMCO46JRT2K6H46FYCDTZH6RTTL2Q46HOC2VW44IPTZ2W2KQRQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284833471 (302h54m7.77726592s) [noise=true , address=145.79.227.33:4884 , piece_id=ZTHSKPCM7ZF5BKF26VRUXLJ2N3KGZYFK6HJTKOHYDUJFFYRR7HDA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.285523649 (302h54m7.777956091s) [noise=true , address=145.79.227.32:4854 , piece_id=2YLGSMO4KJ4OTLCQLTFWB6SFEEUPT3X5XKWE7KDQSX7W5LO7FO5Q, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.285585257 (302h54m7.778017699s) [noise=true , address=145.79.227.12:4770 , piece_id=NYBMVQLHBRCGAK2QQHSZ2BRZN3XAMMJKCRYKS4QWI7ZFH64XEGEA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.286297044 (302h54m7.778729499s) [noise=true , address=145.79.227.30:4771 , piece_id=SKXNQMX4RW3KCWKY5TMDPUI5QZJXYROJBMV5Y4P7MAUZUGCSUIEA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.286526017 (302h54m7.778958471s) [noise=true , address=145.79.227.5:4240 , piece_id=Q4PEISD7R7IO4BYBWLADEXE6JBUGQ5AY4J3IPX4P3Q6HZBUSYN7Q, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287104751 (302h54m7.779537193s) [noise=true , address=45.91.116.6:4008 , piece_id=PWJH5FFOUVPV64I4FLTGTBCMYLMIYBEZBZBUCI2WJQBKOPR4KABA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287470770 (302h54m7.779903218s) [noise=true , address=145.79.227.17:4984 , piece_id=ARCUIGNVITSNKFJYAJQEP24HJVBBBDOZ3FRLUQASEZFN2IXGMPLQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287613969 (302h54m7.780046423s) [noise=true , address=145.79.227.14:4843 , piece_id=IXNCU3WCMDYAVT6IE4ETEMTKQROPHV4V77VO5TNNZP5ASMW3WJQQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287960566 (302h54m7.780393019s) [noise=true , address=77.90.31.17:4795 , piece_id=2GUT5J77OOFK3OU6DG5IVXAXCBSV7SZRCXX3TPYZIRMCKGX3JUOQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289210694 (302h54m7.781643146s) [noise=true , address=145.79.227.11:4733 , piece_id=FPN5NMMTUYQHWRQOOYB5RPDKTWHEEWA3CX2OMH233YHTID6MWIFQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289586052 (302h54m7.782018502s) [noise=true , address=145.79.227.37:4589 , piece_id=K4HCLE6PM54ZXJVN5KO626R5UUP32OVEN6DDYIFUM6EYQCRVT7YQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289971344 (302h54m7.782403791s) [noise=true , address=145.79.227.36:4524 , piece_id=RSUO6BNALYS7M6W4RJ55UOD35LNCPD26PQDZBCNY6HHVDFQTRVRQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.849451002 (302h54m8.341883437s) [upload=266387]: Next returned nil segment Sep 11 05:01:47.850308233 (302h54m8.342740675s) [upload=266387]: Waiting for error group managing segments... Sep 11 05:01:47.994127497 (302h54m8.486559926s) [noise=true , address=145.79.227.14:4843 , piece_id=IXNCU3WCMDYAVT6IE4ETEMTKQROPHV4V77VO5TNNZP5ASMW3WJQQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.995677280 (302h54m8.488109717s) [noise=true , address=145.79.227.11:4733 , piece_id=FPN5NMMTUYQHWRQOOYB5RPDKTWHEEWA3CX2OMH233YHTID6MWIFQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.996836577 (302h54m8.489269006s) [noise=true , address=145.79.227.30:4771 , piece_id=SKXNQMX4RW3KCWKY5TMDPUI5QZJXYROJBMV5Y4P7MAUZUGCSUIEA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.997314105 (302h54m8.489746535s) [noise=true , address=145.79.227.13:4815 , piece_id=GBLGYGVE3WCY27XULJK6UYLUUZFPID33MA7X6N62TWHAMVRH3JBQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.997716103 (302h54m8.490148547s) [noise=true , address=145.79.227.36:4524 , piece_id=RSUO6BNALYS7M6W4RJ55UOD35LNCPD26PQDZBCNY6HHVDFQTRVRQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.998369140 (302h54m8.490801569s) [noise=true , address=145.79.227.17:4984 , piece_id=ARCUIGNVITSNKFJYAJQEP24HJVBBBDOZ3FRLUQASEZFN2IXGMPLQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.998606161 (302h54m8.491038597s) [noise=true , address=77.90.31.11:4556 , piece_id=QCYMCO46JRT2K6H46FYCDTZH6RTTL2Q46HOC2VW44IPTZ2W2KQRQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.002273466 (302h54m8.494705902s) [noise=true , address=77.90.31.17:4795 , piece_id=2GUT5J77OOFK3OU6DG5IVXAXCBSV7SZRCXX3TPYZIRMCKGX3JUOQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.006810730 (302h54m8.499243159s) [noise=true , address=145.79.227.12:4770 , piece_id=NYBMVQLHBRCGAK2QQHSZ2BRZN3XAMMJKCRYKS4QWI7ZFH64XEGEA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.011564887 (302h54m8.503997331s) [noise=true , address=145.79.227.33:4884 , piece_id=ZTHSKPCM7ZF5BKF26VRUXLJ2N3KGZYFK6HJTKOHYDUJFFYRR7HDA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.023440869 (302h54m8.515873298s) [noise=true , address=45.91.116.11:4147 , piece_id=BPNZTKMMEXM5B6UQSOLWZTZVVT5UOV2QHPSZL742DHQ3AQ3O6ESA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.085368080 (302h54m8.577800508s) [noise=true , address=145.79.227.37:4589 , piece_id=K4HCLE6PM54ZXJVN5KO626R5UUP32OVEN6DDYIFUM6EYQCRVT7YQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:02:46.754779889 (302h55m7.247212318s) [noise=true , address=145.79.227.5:4240 , piece_id=Q4PEISD7R7IO4BYBWLADEXE6JBUGQ5AY4J3IPX4P3Q6HZBUSYN7Q, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:13SaC5StbguPT3abAT9oTX3mZAyGhJcpAA6b7ueyiDFHa8CCEo, address:145.79.227.5:4240): protocol: rpc: dial tcp 145.79.227.5:4240: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.754831971 (302h55m7.247264401s) [noise=true , address=145.79.227.2:4121 , piece_id=KUVJMQVN5VOZCGW5W4DY5BMLI5IH23GSC2IFN6PH6XEA4OT3VUMA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:1Fq1JNvrZLTFTQLVF8jzyavJ6dU1xX96FTGcyxfaHiPdCLu4pB, address:145.79.227.2:4121): protocol: context deadline exceeded; context deadline exceeded Sep 11 05:02:46.754895261 (302h55m7.247327705s) [noise=true , address=45.91.116.8:4051 , piece_id=PPCINK7K25XXRN3JQPMWVBQVPXXP7UPVSILUGIKWO3OI7EEI42FQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3, address:45.91.116.8:4051): protocol: write tcp 139.59.144.22:38826->45.91.116.8:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.754988069 (302h55m7.247420503s) [noise=true , address=45.91.116.6:4008 , piece_id=PWJH5FFOUVPV64I4FLTGTBCMYLMIYBEZBZBUCI2WJQBKOPR4KABA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:16KXs6ZXZyroRJibAYU5bsga1RFSpmf7yEtaNG7tamaX7QKvng, address:45.91.116.6:4008): protocol: context deadline exceeded; context deadline exceeded Sep 11 05:02:46.755109851 (302h55m7.24754228s) [noise=true , address=45.91.116.6:4984 , piece_id=GQV5UTDPDAYNRXXQH7FL427GSQ5W5BLLOVQIN7NUIQIIIV7AJ4RQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:12VQKskrBadKVwYpngNNeSJPn3knJs7WXtfz9D6syskCDz9EVSt, address:45.91.116.6:4984): protocol: rpc: dial tcp 45.91.116.6:4984: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.755262600 (302h55m7.247695031s) [noise=true , address=145.79.227.32:4854 , piece_id=2YLGSMO4KJ4OTLCQLTFWB6SFEEUPT3X5XKWE7KDQSX7W5LO7FO5Q, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:12eitcwvcNX2GyMiv4GdfDD8wmgb6a1d3ggaGVxbpyKAjPjshmV, address:145.79.227.32:4854): protocol: rpc: dial tcp 145.79.227.32:4854: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.755312278 (302h55m7.247744733s) [seg_pos={0 0}, upload=266387]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Sep 11 05:02:46.866353400 (302h55m7.358785843s) [upload=266387]: Done uploading segments... Sep 11 05:02:46.866397083 (302h55m7.358829529s) [upload=266387]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 2.45968649s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 1.14044224s FAIL (2025-09-11 05:22:25 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.140481057s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [................................XX..........................] duration: 2.419307193s FAIL (2025-09-11 05:22:17 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.419341037s core uplink us-select-1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 517.358361ms target: https://ap1.storj.io/login FAIL (2025-09-11 05:22:08 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: i/o timeout Duration: 517.386305ms core satellite ap1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 2 out of 60 is failed (threshold=3) [.................................XX.........................] duration: 349.979678ms target: https://version.storj.io/ FAIL (2025-09-11 05:22:05 UTC) orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: i/o timeout Duration: 350.010645ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 1.164369695s FAIL (2025-09-11 05:21:53 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.164403482s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 2.580191873s FAIL (2025-09-11 05:21:41 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== 6387]: Got next segment. Inline: false Sep 11 05:01:47.070094760 (302h54m7.562527201s) [upload=266387]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 05:01:47.070100812 (302h54m7.562533255s) [upload=266387]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 05:01:47.282517324 (302h54m7.774949756s) [seg_pos={0 0}, upload=266387]: Begin upload segment... Sep 11 05:01:47.282586917 (302h54m7.775019351s) [seg_pos={0 0}, upload=266387]: Done begin upload segment. Sep 11 05:01:47.282630874 (302h54m7.775063319s) [noise=true , address=145.79.227.2:4121 , piece_id=KUVJMQVN5VOZCGW5W4DY5BMLI5IH23GSC2IFN6PH6XEA4OT3VUMA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283078686 (302h54m7.775511133s) [noise=true , address=45.91.116.8:4051 , piece_id=PPCINK7K25XXRN3JQPMWVBQVPXXP7UPVSILUGIKWO3OI7EEI42FQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283596723 (302h54m7.776029168s) [noise=true , address=45.91.116.11:4147 , piece_id=BPNZTKMMEXM5B6UQSOLWZTZVVT5UOV2QHPSZL742DHQ3AQ3O6ESA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283956314 (302h54m7.776388767s) [noise=true , address=45.91.116.6:4984 , piece_id=GQV5UTDPDAYNRXXQH7FL427GSQ5W5BLLOVQIN7NUIQIIIV7AJ4RQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284193911 (302h54m7.776626359s) [noise=true , address=145.79.227.13:4815 , piece_id=GBLGYGVE3WCY27XULJK6UYLUUZFPID33MA7X6N62TWHAMVRH3JBQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284732917 (302h54m7.777165362s) [noise=true , address=77.90.31.11:4556 , piece_id=QCYMCO46JRT2K6H46FYCDTZH6RTTL2Q46HOC2VW44IPTZ2W2KQRQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284833471 (302h54m7.77726592s) [noise=true , address=145.79.227.33:4884 , piece_id=ZTHSKPCM7ZF5BKF26VRUXLJ2N3KGZYFK6HJTKOHYDUJFFYRR7HDA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.285523649 (302h54m7.777956091s) [noise=true , address=145.79.227.32:4854 , piece_id=2YLGSMO4KJ4OTLCQLTFWB6SFEEUPT3X5XKWE7KDQSX7W5LO7FO5Q, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.285585257 (302h54m7.778017699s) [noise=true , address=145.79.227.12:4770 , piece_id=NYBMVQLHBRCGAK2QQHSZ2BRZN3XAMMJKCRYKS4QWI7ZFH64XEGEA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.286297044 (302h54m7.778729499s) [noise=true , address=145.79.227.30:4771 , piece_id=SKXNQMX4RW3KCWKY5TMDPUI5QZJXYROJBMV5Y4P7MAUZUGCSUIEA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.286526017 (302h54m7.778958471s) [noise=true , address=145.79.227.5:4240 , piece_id=Q4PEISD7R7IO4BYBWLADEXE6JBUGQ5AY4J3IPX4P3Q6HZBUSYN7Q, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287104751 (302h54m7.779537193s) [noise=true , address=45.91.116.6:4008 , piece_id=PWJH5FFOUVPV64I4FLTGTBCMYLMIYBEZBZBUCI2WJQBKOPR4KABA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287470770 (302h54m7.779903218s) [noise=true , address=145.79.227.17:4984 , piece_id=ARCUIGNVITSNKFJYAJQEP24HJVBBBDOZ3FRLUQASEZFN2IXGMPLQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287613969 (302h54m7.780046423s) [noise=true , address=145.79.227.14:4843 , piece_id=IXNCU3WCMDYAVT6IE4ETEMTKQROPHV4V77VO5TNNZP5ASMW3WJQQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287960566 (302h54m7.780393019s) [noise=true , address=77.90.31.17:4795 , piece_id=2GUT5J77OOFK3OU6DG5IVXAXCBSV7SZRCXX3TPYZIRMCKGX3JUOQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289210694 (302h54m7.781643146s) [noise=true , address=145.79.227.11:4733 , piece_id=FPN5NMMTUYQHWRQOOYB5RPDKTWHEEWA3CX2OMH233YHTID6MWIFQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289586052 (302h54m7.782018502s) [noise=true , address=145.79.227.37:4589 , piece_id=K4HCLE6PM54ZXJVN5KO626R5UUP32OVEN6DDYIFUM6EYQCRVT7YQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289971344 (302h54m7.782403791s) [noise=true , address=145.79.227.36:4524 , piece_id=RSUO6BNALYS7M6W4RJ55UOD35LNCPD26PQDZBCNY6HHVDFQTRVRQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.849451002 (302h54m8.341883437s) [upload=266387]: Next returned nil segment Sep 11 05:01:47.850308233 (302h54m8.342740675s) [upload=266387]: Waiting for error group managing segments... Sep 11 05:01:47.994127497 (302h54m8.486559926s) [noise=true , address=145.79.227.14:4843 , piece_id=IXNCU3WCMDYAVT6IE4ETEMTKQROPHV4V77VO5TNNZP5ASMW3WJQQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.995677280 (302h54m8.488109717s) [noise=true , address=145.79.227.11:4733 , piece_id=FPN5NMMTUYQHWRQOOYB5RPDKTWHEEWA3CX2OMH233YHTID6MWIFQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.996836577 (302h54m8.489269006s) [noise=true , address=145.79.227.30:4771 , piece_id=SKXNQMX4RW3KCWKY5TMDPUI5QZJXYROJBMV5Y4P7MAUZUGCSUIEA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.997314105 (302h54m8.489746535s) [noise=true , address=145.79.227.13:4815 , piece_id=GBLGYGVE3WCY27XULJK6UYLUUZFPID33MA7X6N62TWHAMVRH3JBQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.997716103 (302h54m8.490148547s) [noise=true , address=145.79.227.36:4524 , piece_id=RSUO6BNALYS7M6W4RJ55UOD35LNCPD26PQDZBCNY6HHVDFQTRVRQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.998369140 (302h54m8.490801569s) [noise=true , address=145.79.227.17:4984 , piece_id=ARCUIGNVITSNKFJYAJQEP24HJVBBBDOZ3FRLUQASEZFN2IXGMPLQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.998606161 (302h54m8.491038597s) [noise=true , address=77.90.31.11:4556 , piece_id=QCYMCO46JRT2K6H46FYCDTZH6RTTL2Q46HOC2VW44IPTZ2W2KQRQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.002273466 (302h54m8.494705902s) [noise=true , address=77.90.31.17:4795 , piece_id=2GUT5J77OOFK3OU6DG5IVXAXCBSV7SZRCXX3TPYZIRMCKGX3JUOQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.006810730 (302h54m8.499243159s) [noise=true , address=145.79.227.12:4770 , piece_id=NYBMVQLHBRCGAK2QQHSZ2BRZN3XAMMJKCRYKS4QWI7ZFH64XEGEA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.011564887 (302h54m8.503997331s) [noise=true , address=145.79.227.33:4884 , piece_id=ZTHSKPCM7ZF5BKF26VRUXLJ2N3KGZYFK6HJTKOHYDUJFFYRR7HDA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.023440869 (302h54m8.515873298s) [noise=true , address=45.91.116.11:4147 , piece_id=BPNZTKMMEXM5B6UQSOLWZTZVVT5UOV2QHPSZL742DHQ3AQ3O6ESA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.085368080 (302h54m8.577800508s) [noise=true , address=145.79.227.37:4589 , piece_id=K4HCLE6PM54ZXJVN5KO626R5UUP32OVEN6DDYIFUM6EYQCRVT7YQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:02:46.754779889 (302h55m7.247212318s) [noise=true , address=145.79.227.5:4240 , piece_id=Q4PEISD7R7IO4BYBWLADEXE6JBUGQ5AY4J3IPX4P3Q6HZBUSYN7Q, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:13SaC5StbguPT3abAT9oTX3mZAyGhJcpAA6b7ueyiDFHa8CCEo, address:145.79.227.5:4240): protocol: rpc: dial tcp 145.79.227.5:4240: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.754831971 (302h55m7.247264401s) [noise=true , address=145.79.227.2:4121 , piece_id=KUVJMQVN5VOZCGW5W4DY5BMLI5IH23GSC2IFN6PH6XEA4OT3VUMA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:1Fq1JNvrZLTFTQLVF8jzyavJ6dU1xX96FTGcyxfaHiPdCLu4pB, address:145.79.227.2:4121): protocol: context deadline exceeded; context deadline exceeded Sep 11 05:02:46.754895261 (302h55m7.247327705s) [noise=true , address=45.91.116.8:4051 , piece_id=PPCINK7K25XXRN3JQPMWVBQVPXXP7UPVSILUGIKWO3OI7EEI42FQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3, address:45.91.116.8:4051): protocol: write tcp 139.59.144.22:38826->45.91.116.8:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.754988069 (302h55m7.247420503s) [noise=true , address=45.91.116.6:4008 , piece_id=PWJH5FFOUVPV64I4FLTGTBCMYLMIYBEZBZBUCI2WJQBKOPR4KABA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:16KXs6ZXZyroRJibAYU5bsga1RFSpmf7yEtaNG7tamaX7QKvng, address:45.91.116.6:4008): protocol: context deadline exceeded; context deadline exceeded Sep 11 05:02:46.755109851 (302h55m7.24754228s) [noise=true , address=45.91.116.6:4984 , piece_id=GQV5UTDPDAYNRXXQH7FL427GSQ5W5BLLOVQIN7NUIQIIIV7AJ4RQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:12VQKskrBadKVwYpngNNeSJPn3knJs7WXtfz9D6syskCDz9EVSt, address:45.91.116.6:4984): protocol: rpc: dial tcp 45.91.116.6:4984: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.755262600 (302h55m7.247695031s) [noise=true , address=145.79.227.32:4854 , piece_id=2YLGSMO4KJ4OTLCQLTFWB6SFEEUPT3X5XKWE7KDQSX7W5LO7FO5Q, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:12eitcwvcNX2GyMiv4GdfDD8wmgb6a1d3ggaGVxbpyKAjPjshmV, address:145.79.227.32:4854): protocol: rpc: dial tcp 145.79.227.32:4854: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.755312278 (302h55m7.247744733s) [seg_pos={0 0}, upload=266387]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Sep 11 05:02:46.866353400 (302h55m7.358785843s) [upload=266387]: Done uploading segments... Sep 11 05:02:46.866397083 (302h55m7.358829529s) [upload=266387]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 2.580289902s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 505.14567ms target: https://ap1.storj.io/login FAIL (2025-09-11 05:21:34 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: i/o timeout Duration: 505.171623ms core satellite ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 990.982452ms FAIL (2025-09-11 05:21:31 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 991.069674ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 2.479388685s FAIL (2025-09-11 05:21:19 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== 6387]: Got next segment. Inline: false Sep 11 05:01:47.070094760 (302h54m7.562527201s) [upload=266387]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 05:01:47.070100812 (302h54m7.562533255s) [upload=266387]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 05:01:47.282517324 (302h54m7.774949756s) [seg_pos={0 0}, upload=266387]: Begin upload segment... Sep 11 05:01:47.282586917 (302h54m7.775019351s) [seg_pos={0 0}, upload=266387]: Done begin upload segment. Sep 11 05:01:47.282630874 (302h54m7.775063319s) [noise=true , address=145.79.227.2:4121 , piece_id=KUVJMQVN5VOZCGW5W4DY5BMLI5IH23GSC2IFN6PH6XEA4OT3VUMA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283078686 (302h54m7.775511133s) [noise=true , address=45.91.116.8:4051 , piece_id=PPCINK7K25XXRN3JQPMWVBQVPXXP7UPVSILUGIKWO3OI7EEI42FQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283596723 (302h54m7.776029168s) [noise=true , address=45.91.116.11:4147 , piece_id=BPNZTKMMEXM5B6UQSOLWZTZVVT5UOV2QHPSZL742DHQ3AQ3O6ESA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283956314 (302h54m7.776388767s) [noise=true , address=45.91.116.6:4984 , piece_id=GQV5UTDPDAYNRXXQH7FL427GSQ5W5BLLOVQIN7NUIQIIIV7AJ4RQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284193911 (302h54m7.776626359s) [noise=true , address=145.79.227.13:4815 , piece_id=GBLGYGVE3WCY27XULJK6UYLUUZFPID33MA7X6N62TWHAMVRH3JBQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284732917 (302h54m7.777165362s) [noise=true , address=77.90.31.11:4556 , piece_id=QCYMCO46JRT2K6H46FYCDTZH6RTTL2Q46HOC2VW44IPTZ2W2KQRQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284833471 (302h54m7.77726592s) [noise=true , address=145.79.227.33:4884 , piece_id=ZTHSKPCM7ZF5BKF26VRUXLJ2N3KGZYFK6HJTKOHYDUJFFYRR7HDA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.285523649 (302h54m7.777956091s) [noise=true , address=145.79.227.32:4854 , piece_id=2YLGSMO4KJ4OTLCQLTFWB6SFEEUPT3X5XKWE7KDQSX7W5LO7FO5Q, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.285585257 (302h54m7.778017699s) [noise=true , address=145.79.227.12:4770 , piece_id=NYBMVQLHBRCGAK2QQHSZ2BRZN3XAMMJKCRYKS4QWI7ZFH64XEGEA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.286297044 (302h54m7.778729499s) [noise=true , address=145.79.227.30:4771 , piece_id=SKXNQMX4RW3KCWKY5TMDPUI5QZJXYROJBMV5Y4P7MAUZUGCSUIEA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.286526017 (302h54m7.778958471s) [noise=true , address=145.79.227.5:4240 , piece_id=Q4PEISD7R7IO4BYBWLADEXE6JBUGQ5AY4J3IPX4P3Q6HZBUSYN7Q, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287104751 (302h54m7.779537193s) [noise=true , address=45.91.116.6:4008 , piece_id=PWJH5FFOUVPV64I4FLTGTBCMYLMIYBEZBZBUCI2WJQBKOPR4KABA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287470770 (302h54m7.779903218s) [noise=true , address=145.79.227.17:4984 , piece_id=ARCUIGNVITSNKFJYAJQEP24HJVBBBDOZ3FRLUQASEZFN2IXGMPLQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287613969 (302h54m7.780046423s) [noise=true , address=145.79.227.14:4843 , piece_id=IXNCU3WCMDYAVT6IE4ETEMTKQROPHV4V77VO5TNNZP5ASMW3WJQQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287960566 (302h54m7.780393019s) [noise=true , address=77.90.31.17:4795 , piece_id=2GUT5J77OOFK3OU6DG5IVXAXCBSV7SZRCXX3TPYZIRMCKGX3JUOQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289210694 (302h54m7.781643146s) [noise=true , address=145.79.227.11:4733 , piece_id=FPN5NMMTUYQHWRQOOYB5RPDKTWHEEWA3CX2OMH233YHTID6MWIFQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289586052 (302h54m7.782018502s) [noise=true , address=145.79.227.37:4589 , piece_id=K4HCLE6PM54ZXJVN5KO626R5UUP32OVEN6DDYIFUM6EYQCRVT7YQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289971344 (302h54m7.782403791s) [noise=true , address=145.79.227.36:4524 , piece_id=RSUO6BNALYS7M6W4RJ55UOD35LNCPD26PQDZBCNY6HHVDFQTRVRQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.849451002 (302h54m8.341883437s) [upload=266387]: Next returned nil segment Sep 11 05:01:47.850308233 (302h54m8.342740675s) [upload=266387]: Waiting for error group managing segments... Sep 11 05:01:47.994127497 (302h54m8.486559926s) [noise=true , address=145.79.227.14:4843 , piece_id=IXNCU3WCMDYAVT6IE4ETEMTKQROPHV4V77VO5TNNZP5ASMW3WJQQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.995677280 (302h54m8.488109717s) [noise=true , address=145.79.227.11:4733 , piece_id=FPN5NMMTUYQHWRQOOYB5RPDKTWHEEWA3CX2OMH233YHTID6MWIFQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.996836577 (302h54m8.489269006s) [noise=true , address=145.79.227.30:4771 , piece_id=SKXNQMX4RW3KCWKY5TMDPUI5QZJXYROJBMV5Y4P7MAUZUGCSUIEA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.997314105 (302h54m8.489746535s) [noise=true , address=145.79.227.13:4815 , piece_id=GBLGYGVE3WCY27XULJK6UYLUUZFPID33MA7X6N62TWHAMVRH3JBQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.997716103 (302h54m8.490148547s) [noise=true , address=145.79.227.36:4524 , piece_id=RSUO6BNALYS7M6W4RJ55UOD35LNCPD26PQDZBCNY6HHVDFQTRVRQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.998369140 (302h54m8.490801569s) [noise=true , address=145.79.227.17:4984 , piece_id=ARCUIGNVITSNKFJYAJQEP24HJVBBBDOZ3FRLUQASEZFN2IXGMPLQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.998606161 (302h54m8.491038597s) [noise=true , address=77.90.31.11:4556 , piece_id=QCYMCO46JRT2K6H46FYCDTZH6RTTL2Q46HOC2VW44IPTZ2W2KQRQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.002273466 (302h54m8.494705902s) [noise=true , address=77.90.31.17:4795 , piece_id=2GUT5J77OOFK3OU6DG5IVXAXCBSV7SZRCXX3TPYZIRMCKGX3JUOQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.006810730 (302h54m8.499243159s) [noise=true , address=145.79.227.12:4770 , piece_id=NYBMVQLHBRCGAK2QQHSZ2BRZN3XAMMJKCRYKS4QWI7ZFH64XEGEA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.011564887 (302h54m8.503997331s) [noise=true , address=145.79.227.33:4884 , piece_id=ZTHSKPCM7ZF5BKF26VRUXLJ2N3KGZYFK6HJTKOHYDUJFFYRR7HDA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.023440869 (302h54m8.515873298s) [noise=true , address=45.91.116.11:4147 , piece_id=BPNZTKMMEXM5B6UQSOLWZTZVVT5UOV2QHPSZL742DHQ3AQ3O6ESA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.085368080 (302h54m8.577800508s) [noise=true , address=145.79.227.37:4589 , piece_id=K4HCLE6PM54ZXJVN5KO626R5UUP32OVEN6DDYIFUM6EYQCRVT7YQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:02:46.754779889 (302h55m7.247212318s) [noise=true , address=145.79.227.5:4240 , piece_id=Q4PEISD7R7IO4BYBWLADEXE6JBUGQ5AY4J3IPX4P3Q6HZBUSYN7Q, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:13SaC5StbguPT3abAT9oTX3mZAyGhJcpAA6b7ueyiDFHa8CCEo, address:145.79.227.5:4240): protocol: rpc: dial tcp 145.79.227.5:4240: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.754831971 (302h55m7.247264401s) [noise=true , address=145.79.227.2:4121 , piece_id=KUVJMQVN5VOZCGW5W4DY5BMLI5IH23GSC2IFN6PH6XEA4OT3VUMA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:1Fq1JNvrZLTFTQLVF8jzyavJ6dU1xX96FTGcyxfaHiPdCLu4pB, address:145.79.227.2:4121): protocol: context deadline exceeded; context deadline exceeded Sep 11 05:02:46.754895261 (302h55m7.247327705s) [noise=true , address=45.91.116.8:4051 , piece_id=PPCINK7K25XXRN3JQPMWVBQVPXXP7UPVSILUGIKWO3OI7EEI42FQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3, address:45.91.116.8:4051): protocol: write tcp 139.59.144.22:38826->45.91.116.8:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.754988069 (302h55m7.247420503s) [noise=true , address=45.91.116.6:4008 , piece_id=PWJH5FFOUVPV64I4FLTGTBCMYLMIYBEZBZBUCI2WJQBKOPR4KABA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:16KXs6ZXZyroRJibAYU5bsga1RFSpmf7yEtaNG7tamaX7QKvng, address:45.91.116.6:4008): protocol: context deadline exceeded; context deadline exceeded Sep 11 05:02:46.755109851 (302h55m7.24754228s) [noise=true , address=45.91.116.6:4984 , piece_id=GQV5UTDPDAYNRXXQH7FL427GSQ5W5BLLOVQIN7NUIQIIIV7AJ4RQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:12VQKskrBadKVwYpngNNeSJPn3knJs7WXtfz9D6syskCDz9EVSt, address:45.91.116.6:4984): protocol: rpc: dial tcp 45.91.116.6:4984: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.755262600 (302h55m7.247695031s) [noise=true , address=145.79.227.32:4854 , piece_id=2YLGSMO4KJ4OTLCQLTFWB6SFEEUPT3X5XKWE7KDQSX7W5LO7FO5Q, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:12eitcwvcNX2GyMiv4GdfDD8wmgb6a1d3ggaGVxbpyKAjPjshmV, address:145.79.227.32:4854): protocol: rpc: dial tcp 145.79.227.32:4854: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.755312278 (302h55m7.247744733s) [seg_pos={0 0}, upload=266387]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Sep 11 05:02:46.866353400 (302h55m7.358785843s) [upload=266387]: Done uploading segments... Sep 11 05:02:46.866397083 (302h55m7.358829529s) [upload=266387]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 2.479446517s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.................................XX.........................] duration: 2.718474393s FAIL (2025-09-11 05:21:03 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.718507605s core uplink us-select-1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 507.994991ms target: https://ap1.storj.io/login FAIL (2025-09-11 05:20:59 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: i/o timeout Duration: 508.038534ms core satellite ap1
checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io) antiblip: 2 out of 60 is failed (threshold=3) [..................................XX........................] duration: 356.366781ms target: https://version.storj.io/ FAIL (2025-09-11 05:20:50 UTC) orbiter warning: Get "https://version.storj.io/": dial tcp 34.173.164.90:443: i/o timeout Duration: 356.457016ms core website
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 1.129838812s FAIL (2025-09-11 05:20:33 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 1.129873839s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 2.299047097s FAIL (2025-09-11 05:20:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 14 but got 12) ======LOGS====== 6387]: Got next segment. Inline: false Sep 11 05:01:47.070094760 (302h54m7.562527201s) [upload=266387]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 11 05:01:47.070100812 (302h54m7.562533255s) [upload=266387]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 11 05:01:47.282517324 (302h54m7.774949756s) [seg_pos={0 0}, upload=266387]: Begin upload segment... Sep 11 05:01:47.282586917 (302h54m7.775019351s) [seg_pos={0 0}, upload=266387]: Done begin upload segment. Sep 11 05:01:47.282630874 (302h54m7.775063319s) [noise=true , address=145.79.227.2:4121 , piece_id=KUVJMQVN5VOZCGW5W4DY5BMLI5IH23GSC2IFN6PH6XEA4OT3VUMA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283078686 (302h54m7.775511133s) [noise=true , address=45.91.116.8:4051 , piece_id=PPCINK7K25XXRN3JQPMWVBQVPXXP7UPVSILUGIKWO3OI7EEI42FQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283596723 (302h54m7.776029168s) [noise=true , address=45.91.116.11:4147 , piece_id=BPNZTKMMEXM5B6UQSOLWZTZVVT5UOV2QHPSZL742DHQ3AQ3O6ESA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.283956314 (302h54m7.776388767s) [noise=true , address=45.91.116.6:4984 , piece_id=GQV5UTDPDAYNRXXQH7FL427GSQ5W5BLLOVQIN7NUIQIIIV7AJ4RQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284193911 (302h54m7.776626359s) [noise=true , address=145.79.227.13:4815 , piece_id=GBLGYGVE3WCY27XULJK6UYLUUZFPID33MA7X6N62TWHAMVRH3JBQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284732917 (302h54m7.777165362s) [noise=true , address=77.90.31.11:4556 , piece_id=QCYMCO46JRT2K6H46FYCDTZH6RTTL2Q46HOC2VW44IPTZ2W2KQRQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.284833471 (302h54m7.77726592s) [noise=true , address=145.79.227.33:4884 , piece_id=ZTHSKPCM7ZF5BKF26VRUXLJ2N3KGZYFK6HJTKOHYDUJFFYRR7HDA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.285523649 (302h54m7.777956091s) [noise=true , address=145.79.227.32:4854 , piece_id=2YLGSMO4KJ4OTLCQLTFWB6SFEEUPT3X5XKWE7KDQSX7W5LO7FO5Q, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.285585257 (302h54m7.778017699s) [noise=true , address=145.79.227.12:4770 , piece_id=NYBMVQLHBRCGAK2QQHSZ2BRZN3XAMMJKCRYKS4QWI7ZFH64XEGEA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.286297044 (302h54m7.778729499s) [noise=true , address=145.79.227.30:4771 , piece_id=SKXNQMX4RW3KCWKY5TMDPUI5QZJXYROJBMV5Y4P7MAUZUGCSUIEA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.286526017 (302h54m7.778958471s) [noise=true , address=145.79.227.5:4240 , piece_id=Q4PEISD7R7IO4BYBWLADEXE6JBUGQ5AY4J3IPX4P3Q6HZBUSYN7Q, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287104751 (302h54m7.779537193s) [noise=true , address=45.91.116.6:4008 , piece_id=PWJH5FFOUVPV64I4FLTGTBCMYLMIYBEZBZBUCI2WJQBKOPR4KABA, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287470770 (302h54m7.779903218s) [noise=true , address=145.79.227.17:4984 , piece_id=ARCUIGNVITSNKFJYAJQEP24HJVBBBDOZ3FRLUQASEZFN2IXGMPLQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287613969 (302h54m7.780046423s) [noise=true , address=145.79.227.14:4843 , piece_id=IXNCU3WCMDYAVT6IE4ETEMTKQROPHV4V77VO5TNNZP5ASMW3WJQQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.287960566 (302h54m7.780393019s) [noise=true , address=77.90.31.17:4795 , piece_id=2GUT5J77OOFK3OU6DG5IVXAXCBSV7SZRCXX3TPYZIRMCKGX3JUOQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289210694 (302h54m7.781643146s) [noise=true , address=145.79.227.11:4733 , piece_id=FPN5NMMTUYQHWRQOOYB5RPDKTWHEEWA3CX2OMH233YHTID6MWIFQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289586052 (302h54m7.782018502s) [noise=true , address=145.79.227.37:4589 , piece_id=K4HCLE6PM54ZXJVN5KO626R5UUP32OVEN6DDYIFUM6EYQCRVT7YQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.289971344 (302h54m7.782403791s) [noise=true , address=145.79.227.36:4524 , piece_id=RSUO6BNALYS7M6W4RJ55UOD35LNCPD26PQDZBCNY6HHVDFQTRVRQ, seg_pos={0 0}, upload=266387]: Uploading piece... Sep 11 05:01:47.849451002 (302h54m8.341883437s) [upload=266387]: Next returned nil segment Sep 11 05:01:47.850308233 (302h54m8.342740675s) [upload=266387]: Waiting for error group managing segments... Sep 11 05:01:47.994127497 (302h54m8.486559926s) [noise=true , address=145.79.227.14:4843 , piece_id=IXNCU3WCMDYAVT6IE4ETEMTKQROPHV4V77VO5TNNZP5ASMW3WJQQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.995677280 (302h54m8.488109717s) [noise=true , address=145.79.227.11:4733 , piece_id=FPN5NMMTUYQHWRQOOYB5RPDKTWHEEWA3CX2OMH233YHTID6MWIFQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.996836577 (302h54m8.489269006s) [noise=true , address=145.79.227.30:4771 , piece_id=SKXNQMX4RW3KCWKY5TMDPUI5QZJXYROJBMV5Y4P7MAUZUGCSUIEA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.997314105 (302h54m8.489746535s) [noise=true , address=145.79.227.13:4815 , piece_id=GBLGYGVE3WCY27XULJK6UYLUUZFPID33MA7X6N62TWHAMVRH3JBQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.997716103 (302h54m8.490148547s) [noise=true , address=145.79.227.36:4524 , piece_id=RSUO6BNALYS7M6W4RJ55UOD35LNCPD26PQDZBCNY6HHVDFQTRVRQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.998369140 (302h54m8.490801569s) [noise=true , address=145.79.227.17:4984 , piece_id=ARCUIGNVITSNKFJYAJQEP24HJVBBBDOZ3FRLUQASEZFN2IXGMPLQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:47.998606161 (302h54m8.491038597s) [noise=true , address=77.90.31.11:4556 , piece_id=QCYMCO46JRT2K6H46FYCDTZH6RTTL2Q46HOC2VW44IPTZ2W2KQRQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.002273466 (302h54m8.494705902s) [noise=true , address=77.90.31.17:4795 , piece_id=2GUT5J77OOFK3OU6DG5IVXAXCBSV7SZRCXX3TPYZIRMCKGX3JUOQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.006810730 (302h54m8.499243159s) [noise=true , address=145.79.227.12:4770 , piece_id=NYBMVQLHBRCGAK2QQHSZ2BRZN3XAMMJKCRYKS4QWI7ZFH64XEGEA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.011564887 (302h54m8.503997331s) [noise=true , address=145.79.227.33:4884 , piece_id=ZTHSKPCM7ZF5BKF26VRUXLJ2N3KGZYFK6HJTKOHYDUJFFYRR7HDA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.023440869 (302h54m8.515873298s) [noise=true , address=45.91.116.11:4147 , piece_id=BPNZTKMMEXM5B6UQSOLWZTZVVT5UOV2QHPSZL742DHQ3AQ3O6ESA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:01:48.085368080 (302h54m8.577800508s) [noise=true , address=145.79.227.37:4589 , piece_id=K4HCLE6PM54ZXJVN5KO626R5UUP32OVEN6DDYIFUM6EYQCRVT7YQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: <nil> Sep 11 05:02:46.754779889 (302h55m7.247212318s) [noise=true , address=145.79.227.5:4240 , piece_id=Q4PEISD7R7IO4BYBWLADEXE6JBUGQ5AY4J3IPX4P3Q6HZBUSYN7Q, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:13SaC5StbguPT3abAT9oTX3mZAyGhJcpAA6b7ueyiDFHa8CCEo, address:145.79.227.5:4240): protocol: rpc: dial tcp 145.79.227.5:4240: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.754831971 (302h55m7.247264401s) [noise=true , address=145.79.227.2:4121 , piece_id=KUVJMQVN5VOZCGW5W4DY5BMLI5IH23GSC2IFN6PH6XEA4OT3VUMA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:1Fq1JNvrZLTFTQLVF8jzyavJ6dU1xX96FTGcyxfaHiPdCLu4pB, address:145.79.227.2:4121): protocol: context deadline exceeded; context deadline exceeded Sep 11 05:02:46.754895261 (302h55m7.247327705s) [noise=true , address=45.91.116.8:4051 , piece_id=PPCINK7K25XXRN3JQPMWVBQVPXXP7UPVSILUGIKWO3OI7EEI42FQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:1preT33ei4yVXXYVLHhaUbHbiyL14oHFEiof6cCWPig83W6CT3, address:45.91.116.8:4051): protocol: write tcp 139.59.144.22:38826->45.91.116.8:4051: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.754988069 (302h55m7.247420503s) [noise=true , address=45.91.116.6:4008 , piece_id=PWJH5FFOUVPV64I4FLTGTBCMYLMIYBEZBZBUCI2WJQBKOPR4KABA, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:16KXs6ZXZyroRJibAYU5bsga1RFSpmf7yEtaNG7tamaX7QKvng, address:45.91.116.6:4008): protocol: context deadline exceeded; context deadline exceeded Sep 11 05:02:46.755109851 (302h55m7.24754228s) [noise=true , address=45.91.116.6:4984 , piece_id=GQV5UTDPDAYNRXXQH7FL427GSQ5W5BLLOVQIN7NUIQIIIV7AJ4RQ, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:12VQKskrBadKVwYpngNNeSJPn3knJs7WXtfz9D6syskCDz9EVSt, address:45.91.116.6:4984): protocol: rpc: dial tcp 45.91.116.6:4984: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.755262600 (302h55m7.247695031s) [noise=true , address=145.79.227.32:4854 , piece_id=2YLGSMO4KJ4OTLCQLTFWB6SFEEUPT3X5XKWE7KDQSX7W5LO7FO5Q, seg_pos={0 0}, upload=266387]: Done uploading piece. err: ecclient: upload failed (node:12eitcwvcNX2GyMiv4GdfDD8wmgb6a1d3ggaGVxbpyKAjPjshmV, address:145.79.227.32:4854): protocol: rpc: dial tcp 145.79.227.32:4854: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Sep 11 05:02:46.755312278 (302h55m7.247744733s) [seg_pos={0 0}, upload=266387]: Done waiting for segment. successful: 12 optimal: 14 errs: <nil> Sep 11 05:02:46.866353400 (302h55m7.358785843s) [upload=266387]: Done uploading segments... Sep 11 05:02:46.866397083 (302h55m7.358829529s) [upload=266387]: Upload finished. err: failed to upload enough pieces (needed at least 14 but got 12) Duration: 2.299079768s core uplink us-select-1 us1-placement-20
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 522.929121ms target: https://ap1.storj.io/login FAIL (2025-09-11 05:20:21 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: i/o timeout Duration: 522.96359ms core satellite ap1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 886.707376ms FAIL (2025-09-11 05:20:16 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 886.744326ms core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..................................XX........................] duration: 2.375032756s FAIL (2025-09-11 05:20:15 UTC) orbiter warning: operation: StatBucket ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== Duration: 2.375070251s core uplink us-select-1
checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 515.480279ms target: https://ap1.storj.io/login FAIL (2025-09-11 05:20:05 UTC) orbiter warning: Get "https://ap1.storj.io/login": dial tcp 34.2.157.232:443: i/o timeout Duration: 515.518354ms core satellite ap1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.HTTP{"GET" "https://version.storj.io/"} failure (antiblip window 3/60): (http.version_storj_io)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1k", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.placement_20.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://ap1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.ap1.satellite_login)