Orbiter History

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 11.184879ms target: https://eu1.storj.io/login FAIL (2025-07-01 22:02:17 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused Duration: 11.21653ms core satellite eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 2.520768772s FAIL (2025-07-01 22:02:09 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== ece hash; context canceled; EOF Jul 1 21:55:26.205988280 (204h44m26.089401908s) [noise=true , address=104.36.82.16:4295 , piece_id=5NGMFQZGUANYL5YIZKYEK5KW2FG3BMCZM5BO6USG5DUDUVINYZTQ, seg_pos={0 0}, upload=163807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 1 21:55:26.206039318 (204h44m26.089452947s) [seg_pos={0 0}, upload=163807]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 21:55:26.206156289 (204h44m26.089569924s) [upload=163807]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 21:55:26.206162589 (204h44m26.089576223s) [upload=163807]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 21:55:26.355816710 (204h44m26.239230325s) [upload=163807]: Done uploading segments... Jul 1 21:55:26.355840004 (204h44m26.239253617s) [upload=163807]: Upload finished. err: <nil> Jul 1 21:55:40.843042256 (204h44m40.726455889s) [upload=163813]: Starting upload Jul 1 21:55:40.843177726 (204h44m40.726591357s) [upload=163813]: Done starting upload Jul 1 21:55:40.843270217 (204h44m40.726683839s) [upload=163813]: Uploading segments... Jul 1 21:55:40.843630266 (204h44m40.727043895s) [upload=163813]: Got next segment. Inline: false Jul 1 21:55:40.843724627 (204h44m40.727138257s) [upload=163813]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 1 21:55:40.843732293 (204h44m40.727145921s) [upload=163813]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 1 21:55:40.960993113 (204h44m40.84440674s) [seg_pos={0 0}, upload=163813]: Begin upload segment... Jul 1 21:55:40.961037554 (204h44m40.844451166s) [seg_pos={0 0}, upload=163813]: Done begin upload segment. Jul 1 21:55:40.961088163 (204h44m40.844501787s) [noise=true , address=77.90.31.14:4662 , piece_id=J65Z52J56UCJ4X35CFRUYDU7OSSXUTJY4UQVE4EUD44KGNHKG4EQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.961118736 (204h44m40.844532363s) [noise=true , address=77.90.31.15:4697 , piece_id=MQ4CE7CFM5PVLCOTGJGGOHNSCXPINBUDDPM4AW5KDNTWQOY2GSOA, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.961491001 (204h44m40.844904627s) [noise=true , address=45.91.116.5:5299 , piece_id=IC6WYGP7I6Z5QGUO2UA2YY2JCX3X5X64QFTFZ6XFZARZ2UAQHDHA, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.961649635 (204h44m40.845063263s) [noise=true , address=45.91.116.13:4155 , piece_id=XIIZ2SSODWARQ65MP6FK2X3TLMOQWJ5C3QHMVAQUWGV3QMDTDOAA, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.961832008 (204h44m40.845245637s) [noise=true , address=45.91.116.7:4009 , piece_id=SUKLORUZTKORJUXW5S5CXLLUS3SZEUUG4JTNRTVKJTHCSAEOQT6Q, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.962138542 (204h44m40.845552156s) [noise=true , address=77.90.31.18:4806 , piece_id=3M6FHWPK65RHLWDKM6WUP62642BCPN2DEB5ZXYGO5XE5ISA73KAA, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.962987586 (204h44m40.846401218s) [noise=true , address=77.90.31.13:4626 , piece_id=CJMZYOJG7LYBPIMDCFBXCZMK2FVHZU73GIGJIQHJQR5S5CDNB5DQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.963424066 (204h44m40.84683768s) [noise=true , address=77.90.31.11:4555 , piece_id=UXFNOBSKZGP5DS7GR3CO3EC2BSCR7Q3I4LKDHM5YXN4GLT43XW7Q, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.963683094 (204h44m40.84709671s) [noise=true , address=77.90.31.16:4733 , piece_id=BLHFUC4PG32AR6UDKHGL5WAF4NYGPXNRYT6AJKNV77WQGATN45LQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.963862255 (204h44m40.847275868s) [noise=true , address=45.91.116.6:4973 , piece_id=3OROJ5W2C2FSBIFRW4FZV2IQDPAHL2AFSWT3VCSVL4TDBXFDPE6Q, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.964378671 (204h44m40.847792284s) [noise=true , address=45.91.116.14:4189 , piece_id=ZUMQUNIT5UB6LW4UEDIF4O7A4UJOQ6WSWCBCMZXXWA6EKJRXU7IQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.964462817 (204h44m40.847876445s) [noise=true , address=104.36.82.2:4730 , piece_id=HPGHQCT5Y7J6XQ7PAKVRWV7ACF5QP7YD2HRMPJ5ZZKCYISD7EGLA, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.965200515 (204h44m40.84861414s) [noise=true , address=45.91.116.12:4226 , piece_id=CHDORG6AH7J6OXNSWBOKHYUAUBFO5Z7PE5VPXNN6DZYN4WLAKMGQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.965315995 (204h44m40.848729623s) [noise=true , address=77.90.31.19:4843 , piece_id=7S5CQ24KNNT4FF5Z47T6JTPKENG3GDT6TH3L3HZY7O4BXU4D2MXQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.965724902 (204h44m40.849138528s) [noise=true , address=77.90.31.17:4772 , piece_id=LWPUINLPMEMWQPFVZ5QO66TIF6TLRVHUXOU2H3PVB36N2BVDPHBQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.966073775 (204h44m40.849487401s) [noise=true , address=77.90.31.11:4554 , piece_id=NZ23Y66G3XEXCZRVQHZE363UMCZHD5HKS4GYHDMD7OP3G6NBUNFQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:41.577860363 (204h44m41.461273981s) [upload=163813]: Next returned nil segment Jul 1 21:55:41.577884796 (204h44m41.461298434s) [upload=163813]: Waiting for error group managing segments... Jul 1 21:55:41.702724908 (204h44m41.586138525s) [noise=true , address=77.90.31.13:4626 , piece_id=CJMZYOJG7LYBPIMDCFBXCZMK2FVHZU73GIGJIQHJQR5S5CDNB5DQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.711223054 (204h44m41.594636673s) [noise=true , address=77.90.31.16:4733 , piece_id=BLHFUC4PG32AR6UDKHGL5WAF4NYGPXNRYT6AJKNV77WQGATN45LQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.713793831 (204h44m41.597207458s) [noise=true , address=77.90.31.18:4806 , piece_id=3M6FHWPK65RHLWDKM6WUP62642BCPN2DEB5ZXYGO5XE5ISA73KAA, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.716457878 (204h44m41.599871495s) [noise=true , address=45.91.116.14:4189 , piece_id=ZUMQUNIT5UB6LW4UEDIF4O7A4UJOQ6WSWCBCMZXXWA6EKJRXU7IQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.716822202 (204h44m41.600235815s) [noise=true , address=77.90.31.14:4662 , piece_id=J65Z52J56UCJ4X35CFRUYDU7OSSXUTJY4UQVE4EUD44KGNHKG4EQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.719686465 (204h44m41.603100115s) [noise=true , address=45.91.116.13:4155 , piece_id=XIIZ2SSODWARQ65MP6FK2X3TLMOQWJ5C3QHMVAQUWGV3QMDTDOAA, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.720339789 (204h44m41.603753472s) [noise=true , address=45.91.116.5:5299 , piece_id=IC6WYGP7I6Z5QGUO2UA2YY2JCX3X5X64QFTFZ6XFZARZ2UAQHDHA, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.721538082 (204h44m41.604951695s) [noise=true , address=77.90.31.19:4843 , piece_id=7S5CQ24KNNT4FF5Z47T6JTPKENG3GDT6TH3L3HZY7O4BXU4D2MXQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.721589207 (204h44m41.605002824s) [noise=true , address=45.91.116.7:4009 , piece_id=SUKLORUZTKORJUXW5S5CXLLUS3SZEUUG4JTNRTVKJTHCSAEOQT6Q, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.721896624 (204h44m41.605310236s) [noise=true , address=77.90.31.17:4772 , piece_id=LWPUINLPMEMWQPFVZ5QO66TIF6TLRVHUXOU2H3PVB36N2BVDPHBQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.734719903 (204h44m41.618133519s) [noise=true , address=45.91.116.12:4226 , piece_id=CHDORG6AH7J6OXNSWBOKHYUAUBFO5Z7PE5VPXNN6DZYN4WLAKMGQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.735057052 (204h44m41.618470667s) [noise=true , address=45.91.116.6:4973 , piece_id=3OROJ5W2C2FSBIFRW4FZV2IQDPAHL2AFSWT3VCSVL4TDBXFDPE6Q, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.740402702 (204h44m41.623816316s) [noise=true , address=77.90.31.11:4555 , piece_id=UXFNOBSKZGP5DS7GR3CO3EC2BSCR7Q3I4LKDHM5YXN4GLT43XW7Q, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.740422137 (204h44m41.623835749s) [seg_pos={0 0}, upload=163813]: Segment reached optimal threshold of 13 pieces. Jul 1 21:55:41.740671603 (204h44m41.624085219s) [noise=true , address=77.90.31.15:4697 , piece_id=MQ4CE7CFM5PVLCOTGJGGOHNSCXPINBUDDPM4AW5KDNTWQOY2GSOA, seg_pos={0 0}, upload=163813]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5): protocol: expected piece hash; context canceled; EOF Jul 1 21:55:41.740878935 (204h44m41.624292548s) [noise=true , address=104.36.82.2:4730 , piece_id=HPGHQCT5Y7J6XQ7PAKVRWV7ACF5QP7YD2HRMPJ5ZZKCYISD7EGLA, seg_pos={0 0}, upload=163813]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: write tcp 139.59.144.22:43370->104.36.82.2:4730: use of closed network connection; write tcp 139.59.144.22:43370->104.36.82.2:4730: use of closed network connection Jul 1 21:55:41.740951902 (204h44m41.624365519s) [noise=true , address=77.90.31.11:4554 , piece_id=NZ23Y66G3XEXCZRVQHZE363UMCZHD5HKS4GYHDMD7OP3G6NBUNFQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.740966291 (204h44m41.624379918s) [seg_pos={0 0}, upload=163813]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 1 21:55:41.741056758 (204h44m41.624470387s) [upload=163813]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 21:55:41.741062848 (204h44m41.624476465s) [upload=163813]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 21:55:41.928934333 (204h44m41.812347951s) [upload=163813]: Done uploading segments... Jul 1 21:55:41.928954364 (204h44m41.812367978s) [upload=163813]: Upload finished. err: <nil> Duration: 2.520801718s core uplink us-select-1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 13.029208ms target: https://eu1.storj.io/login FAIL (2025-07-01 22:01:53 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused Duration: 13.055401ms core satellite eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 12.883115ms target: https://eu1.storj.io/login FAIL (2025-07-01 22:01:38 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused Duration: 12.913401ms core satellite eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 2.389610908s FAIL (2025-07-01 22:01:19 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== ece hash; context canceled; EOF Jul 1 21:55:26.205988280 (204h44m26.089401908s) [noise=true , address=104.36.82.16:4295 , piece_id=5NGMFQZGUANYL5YIZKYEK5KW2FG3BMCZM5BO6USG5DUDUVINYZTQ, seg_pos={0 0}, upload=163807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 1 21:55:26.206039318 (204h44m26.089452947s) [seg_pos={0 0}, upload=163807]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 21:55:26.206156289 (204h44m26.089569924s) [upload=163807]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 21:55:26.206162589 (204h44m26.089576223s) [upload=163807]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 21:55:26.355816710 (204h44m26.239230325s) [upload=163807]: Done uploading segments... Jul 1 21:55:26.355840004 (204h44m26.239253617s) [upload=163807]: Upload finished. err: <nil> Jul 1 21:55:40.843042256 (204h44m40.726455889s) [upload=163813]: Starting upload Jul 1 21:55:40.843177726 (204h44m40.726591357s) [upload=163813]: Done starting upload Jul 1 21:55:40.843270217 (204h44m40.726683839s) [upload=163813]: Uploading segments... Jul 1 21:55:40.843630266 (204h44m40.727043895s) [upload=163813]: Got next segment. Inline: false Jul 1 21:55:40.843724627 (204h44m40.727138257s) [upload=163813]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 1 21:55:40.843732293 (204h44m40.727145921s) [upload=163813]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 1 21:55:40.960993113 (204h44m40.84440674s) [seg_pos={0 0}, upload=163813]: Begin upload segment... Jul 1 21:55:40.961037554 (204h44m40.844451166s) [seg_pos={0 0}, upload=163813]: Done begin upload segment. Jul 1 21:55:40.961088163 (204h44m40.844501787s) [noise=true , address=77.90.31.14:4662 , piece_id=J65Z52J56UCJ4X35CFRUYDU7OSSXUTJY4UQVE4EUD44KGNHKG4EQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.961118736 (204h44m40.844532363s) [noise=true , address=77.90.31.15:4697 , piece_id=MQ4CE7CFM5PVLCOTGJGGOHNSCXPINBUDDPM4AW5KDNTWQOY2GSOA, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.961491001 (204h44m40.844904627s) [noise=true , address=45.91.116.5:5299 , piece_id=IC6WYGP7I6Z5QGUO2UA2YY2JCX3X5X64QFTFZ6XFZARZ2UAQHDHA, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.961649635 (204h44m40.845063263s) [noise=true , address=45.91.116.13:4155 , piece_id=XIIZ2SSODWARQ65MP6FK2X3TLMOQWJ5C3QHMVAQUWGV3QMDTDOAA, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.961832008 (204h44m40.845245637s) [noise=true , address=45.91.116.7:4009 , piece_id=SUKLORUZTKORJUXW5S5CXLLUS3SZEUUG4JTNRTVKJTHCSAEOQT6Q, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.962138542 (204h44m40.845552156s) [noise=true , address=77.90.31.18:4806 , piece_id=3M6FHWPK65RHLWDKM6WUP62642BCPN2DEB5ZXYGO5XE5ISA73KAA, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.962987586 (204h44m40.846401218s) [noise=true , address=77.90.31.13:4626 , piece_id=CJMZYOJG7LYBPIMDCFBXCZMK2FVHZU73GIGJIQHJQR5S5CDNB5DQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.963424066 (204h44m40.84683768s) [noise=true , address=77.90.31.11:4555 , piece_id=UXFNOBSKZGP5DS7GR3CO3EC2BSCR7Q3I4LKDHM5YXN4GLT43XW7Q, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.963683094 (204h44m40.84709671s) [noise=true , address=77.90.31.16:4733 , piece_id=BLHFUC4PG32AR6UDKHGL5WAF4NYGPXNRYT6AJKNV77WQGATN45LQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.963862255 (204h44m40.847275868s) [noise=true , address=45.91.116.6:4973 , piece_id=3OROJ5W2C2FSBIFRW4FZV2IQDPAHL2AFSWT3VCSVL4TDBXFDPE6Q, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.964378671 (204h44m40.847792284s) [noise=true , address=45.91.116.14:4189 , piece_id=ZUMQUNIT5UB6LW4UEDIF4O7A4UJOQ6WSWCBCMZXXWA6EKJRXU7IQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.964462817 (204h44m40.847876445s) [noise=true , address=104.36.82.2:4730 , piece_id=HPGHQCT5Y7J6XQ7PAKVRWV7ACF5QP7YD2HRMPJ5ZZKCYISD7EGLA, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.965200515 (204h44m40.84861414s) [noise=true , address=45.91.116.12:4226 , piece_id=CHDORG6AH7J6OXNSWBOKHYUAUBFO5Z7PE5VPXNN6DZYN4WLAKMGQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.965315995 (204h44m40.848729623s) [noise=true , address=77.90.31.19:4843 , piece_id=7S5CQ24KNNT4FF5Z47T6JTPKENG3GDT6TH3L3HZY7O4BXU4D2MXQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.965724902 (204h44m40.849138528s) [noise=true , address=77.90.31.17:4772 , piece_id=LWPUINLPMEMWQPFVZ5QO66TIF6TLRVHUXOU2H3PVB36N2BVDPHBQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.966073775 (204h44m40.849487401s) [noise=true , address=77.90.31.11:4554 , piece_id=NZ23Y66G3XEXCZRVQHZE363UMCZHD5HKS4GYHDMD7OP3G6NBUNFQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:41.577860363 (204h44m41.461273981s) [upload=163813]: Next returned nil segment Jul 1 21:55:41.577884796 (204h44m41.461298434s) [upload=163813]: Waiting for error group managing segments... Jul 1 21:55:41.702724908 (204h44m41.586138525s) [noise=true , address=77.90.31.13:4626 , piece_id=CJMZYOJG7LYBPIMDCFBXCZMK2FVHZU73GIGJIQHJQR5S5CDNB5DQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.711223054 (204h44m41.594636673s) [noise=true , address=77.90.31.16:4733 , piece_id=BLHFUC4PG32AR6UDKHGL5WAF4NYGPXNRYT6AJKNV77WQGATN45LQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.713793831 (204h44m41.597207458s) [noise=true , address=77.90.31.18:4806 , piece_id=3M6FHWPK65RHLWDKM6WUP62642BCPN2DEB5ZXYGO5XE5ISA73KAA, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.716457878 (204h44m41.599871495s) [noise=true , address=45.91.116.14:4189 , piece_id=ZUMQUNIT5UB6LW4UEDIF4O7A4UJOQ6WSWCBCMZXXWA6EKJRXU7IQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.716822202 (204h44m41.600235815s) [noise=true , address=77.90.31.14:4662 , piece_id=J65Z52J56UCJ4X35CFRUYDU7OSSXUTJY4UQVE4EUD44KGNHKG4EQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.719686465 (204h44m41.603100115s) [noise=true , address=45.91.116.13:4155 , piece_id=XIIZ2SSODWARQ65MP6FK2X3TLMOQWJ5C3QHMVAQUWGV3QMDTDOAA, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.720339789 (204h44m41.603753472s) [noise=true , address=45.91.116.5:5299 , piece_id=IC6WYGP7I6Z5QGUO2UA2YY2JCX3X5X64QFTFZ6XFZARZ2UAQHDHA, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.721538082 (204h44m41.604951695s) [noise=true , address=77.90.31.19:4843 , piece_id=7S5CQ24KNNT4FF5Z47T6JTPKENG3GDT6TH3L3HZY7O4BXU4D2MXQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.721589207 (204h44m41.605002824s) [noise=true , address=45.91.116.7:4009 , piece_id=SUKLORUZTKORJUXW5S5CXLLUS3SZEUUG4JTNRTVKJTHCSAEOQT6Q, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.721896624 (204h44m41.605310236s) [noise=true , address=77.90.31.17:4772 , piece_id=LWPUINLPMEMWQPFVZ5QO66TIF6TLRVHUXOU2H3PVB36N2BVDPHBQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.734719903 (204h44m41.618133519s) [noise=true , address=45.91.116.12:4226 , piece_id=CHDORG6AH7J6OXNSWBOKHYUAUBFO5Z7PE5VPXNN6DZYN4WLAKMGQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.735057052 (204h44m41.618470667s) [noise=true , address=45.91.116.6:4973 , piece_id=3OROJ5W2C2FSBIFRW4FZV2IQDPAHL2AFSWT3VCSVL4TDBXFDPE6Q, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.740402702 (204h44m41.623816316s) [noise=true , address=77.90.31.11:4555 , piece_id=UXFNOBSKZGP5DS7GR3CO3EC2BSCR7Q3I4LKDHM5YXN4GLT43XW7Q, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.740422137 (204h44m41.623835749s) [seg_pos={0 0}, upload=163813]: Segment reached optimal threshold of 13 pieces. Jul 1 21:55:41.740671603 (204h44m41.624085219s) [noise=true , address=77.90.31.15:4697 , piece_id=MQ4CE7CFM5PVLCOTGJGGOHNSCXPINBUDDPM4AW5KDNTWQOY2GSOA, seg_pos={0 0}, upload=163813]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5): protocol: expected piece hash; context canceled; EOF Jul 1 21:55:41.740878935 (204h44m41.624292548s) [noise=true , address=104.36.82.2:4730 , piece_id=HPGHQCT5Y7J6XQ7PAKVRWV7ACF5QP7YD2HRMPJ5ZZKCYISD7EGLA, seg_pos={0 0}, upload=163813]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: write tcp 139.59.144.22:43370->104.36.82.2:4730: use of closed network connection; write tcp 139.59.144.22:43370->104.36.82.2:4730: use of closed network connection Jul 1 21:55:41.740951902 (204h44m41.624365519s) [noise=true , address=77.90.31.11:4554 , piece_id=NZ23Y66G3XEXCZRVQHZE363UMCZHD5HKS4GYHDMD7OP3G6NBUNFQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.740966291 (204h44m41.624379918s) [seg_pos={0 0}, upload=163813]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 1 21:55:41.741056758 (204h44m41.624470387s) [upload=163813]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 21:55:41.741062848 (204h44m41.624476465s) [upload=163813]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 21:55:41.928934333 (204h44m41.812347951s) [upload=163813]: Done uploading segments... Jul 1 21:55:41.928954364 (204h44m41.812367978s) [upload=163813]: Upload finished. err: <nil> Duration: 2.389642185s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 2.018330671s FAIL (2025-07-01 22:01:11 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 2.018377931s core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 2.927436637s FAIL (2025-07-01 22:00:53 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 2.927469044s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 2.659044494s FAIL (2025-07-01 22:00:51 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== ece hash; context canceled; EOF Jul 1 21:55:26.205988280 (204h44m26.089401908s) [noise=true , address=104.36.82.16:4295 , piece_id=5NGMFQZGUANYL5YIZKYEK5KW2FG3BMCZM5BO6USG5DUDUVINYZTQ, seg_pos={0 0}, upload=163807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 1 21:55:26.206039318 (204h44m26.089452947s) [seg_pos={0 0}, upload=163807]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 21:55:26.206156289 (204h44m26.089569924s) [upload=163807]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 21:55:26.206162589 (204h44m26.089576223s) [upload=163807]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 21:55:26.355816710 (204h44m26.239230325s) [upload=163807]: Done uploading segments... Jul 1 21:55:26.355840004 (204h44m26.239253617s) [upload=163807]: Upload finished. err: <nil> Jul 1 21:55:40.843042256 (204h44m40.726455889s) [upload=163813]: Starting upload Jul 1 21:55:40.843177726 (204h44m40.726591357s) [upload=163813]: Done starting upload Jul 1 21:55:40.843270217 (204h44m40.726683839s) [upload=163813]: Uploading segments... Jul 1 21:55:40.843630266 (204h44m40.727043895s) [upload=163813]: Got next segment. Inline: false Jul 1 21:55:40.843724627 (204h44m40.727138257s) [upload=163813]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 1 21:55:40.843732293 (204h44m40.727145921s) [upload=163813]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 1 21:55:40.960993113 (204h44m40.84440674s) [seg_pos={0 0}, upload=163813]: Begin upload segment... Jul 1 21:55:40.961037554 (204h44m40.844451166s) [seg_pos={0 0}, upload=163813]: Done begin upload segment. Jul 1 21:55:40.961088163 (204h44m40.844501787s) [noise=true , address=77.90.31.14:4662 , piece_id=J65Z52J56UCJ4X35CFRUYDU7OSSXUTJY4UQVE4EUD44KGNHKG4EQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.961118736 (204h44m40.844532363s) [noise=true , address=77.90.31.15:4697 , piece_id=MQ4CE7CFM5PVLCOTGJGGOHNSCXPINBUDDPM4AW5KDNTWQOY2GSOA, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.961491001 (204h44m40.844904627s) [noise=true , address=45.91.116.5:5299 , piece_id=IC6WYGP7I6Z5QGUO2UA2YY2JCX3X5X64QFTFZ6XFZARZ2UAQHDHA, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.961649635 (204h44m40.845063263s) [noise=true , address=45.91.116.13:4155 , piece_id=XIIZ2SSODWARQ65MP6FK2X3TLMOQWJ5C3QHMVAQUWGV3QMDTDOAA, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.961832008 (204h44m40.845245637s) [noise=true , address=45.91.116.7:4009 , piece_id=SUKLORUZTKORJUXW5S5CXLLUS3SZEUUG4JTNRTVKJTHCSAEOQT6Q, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.962138542 (204h44m40.845552156s) [noise=true , address=77.90.31.18:4806 , piece_id=3M6FHWPK65RHLWDKM6WUP62642BCPN2DEB5ZXYGO5XE5ISA73KAA, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.962987586 (204h44m40.846401218s) [noise=true , address=77.90.31.13:4626 , piece_id=CJMZYOJG7LYBPIMDCFBXCZMK2FVHZU73GIGJIQHJQR5S5CDNB5DQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.963424066 (204h44m40.84683768s) [noise=true , address=77.90.31.11:4555 , piece_id=UXFNOBSKZGP5DS7GR3CO3EC2BSCR7Q3I4LKDHM5YXN4GLT43XW7Q, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.963683094 (204h44m40.84709671s) [noise=true , address=77.90.31.16:4733 , piece_id=BLHFUC4PG32AR6UDKHGL5WAF4NYGPXNRYT6AJKNV77WQGATN45LQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.963862255 (204h44m40.847275868s) [noise=true , address=45.91.116.6:4973 , piece_id=3OROJ5W2C2FSBIFRW4FZV2IQDPAHL2AFSWT3VCSVL4TDBXFDPE6Q, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.964378671 (204h44m40.847792284s) [noise=true , address=45.91.116.14:4189 , piece_id=ZUMQUNIT5UB6LW4UEDIF4O7A4UJOQ6WSWCBCMZXXWA6EKJRXU7IQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.964462817 (204h44m40.847876445s) [noise=true , address=104.36.82.2:4730 , piece_id=HPGHQCT5Y7J6XQ7PAKVRWV7ACF5QP7YD2HRMPJ5ZZKCYISD7EGLA, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.965200515 (204h44m40.84861414s) [noise=true , address=45.91.116.12:4226 , piece_id=CHDORG6AH7J6OXNSWBOKHYUAUBFO5Z7PE5VPXNN6DZYN4WLAKMGQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.965315995 (204h44m40.848729623s) [noise=true , address=77.90.31.19:4843 , piece_id=7S5CQ24KNNT4FF5Z47T6JTPKENG3GDT6TH3L3HZY7O4BXU4D2MXQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.965724902 (204h44m40.849138528s) [noise=true , address=77.90.31.17:4772 , piece_id=LWPUINLPMEMWQPFVZ5QO66TIF6TLRVHUXOU2H3PVB36N2BVDPHBQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.966073775 (204h44m40.849487401s) [noise=true , address=77.90.31.11:4554 , piece_id=NZ23Y66G3XEXCZRVQHZE363UMCZHD5HKS4GYHDMD7OP3G6NBUNFQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:41.577860363 (204h44m41.461273981s) [upload=163813]: Next returned nil segment Jul 1 21:55:41.577884796 (204h44m41.461298434s) [upload=163813]: Waiting for error group managing segments... Jul 1 21:55:41.702724908 (204h44m41.586138525s) [noise=true , address=77.90.31.13:4626 , piece_id=CJMZYOJG7LYBPIMDCFBXCZMK2FVHZU73GIGJIQHJQR5S5CDNB5DQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.711223054 (204h44m41.594636673s) [noise=true , address=77.90.31.16:4733 , piece_id=BLHFUC4PG32AR6UDKHGL5WAF4NYGPXNRYT6AJKNV77WQGATN45LQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.713793831 (204h44m41.597207458s) [noise=true , address=77.90.31.18:4806 , piece_id=3M6FHWPK65RHLWDKM6WUP62642BCPN2DEB5ZXYGO5XE5ISA73KAA, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.716457878 (204h44m41.599871495s) [noise=true , address=45.91.116.14:4189 , piece_id=ZUMQUNIT5UB6LW4UEDIF4O7A4UJOQ6WSWCBCMZXXWA6EKJRXU7IQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.716822202 (204h44m41.600235815s) [noise=true , address=77.90.31.14:4662 , piece_id=J65Z52J56UCJ4X35CFRUYDU7OSSXUTJY4UQVE4EUD44KGNHKG4EQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.719686465 (204h44m41.603100115s) [noise=true , address=45.91.116.13:4155 , piece_id=XIIZ2SSODWARQ65MP6FK2X3TLMOQWJ5C3QHMVAQUWGV3QMDTDOAA, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.720339789 (204h44m41.603753472s) [noise=true , address=45.91.116.5:5299 , piece_id=IC6WYGP7I6Z5QGUO2UA2YY2JCX3X5X64QFTFZ6XFZARZ2UAQHDHA, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.721538082 (204h44m41.604951695s) [noise=true , address=77.90.31.19:4843 , piece_id=7S5CQ24KNNT4FF5Z47T6JTPKENG3GDT6TH3L3HZY7O4BXU4D2MXQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.721589207 (204h44m41.605002824s) [noise=true , address=45.91.116.7:4009 , piece_id=SUKLORUZTKORJUXW5S5CXLLUS3SZEUUG4JTNRTVKJTHCSAEOQT6Q, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.721896624 (204h44m41.605310236s) [noise=true , address=77.90.31.17:4772 , piece_id=LWPUINLPMEMWQPFVZ5QO66TIF6TLRVHUXOU2H3PVB36N2BVDPHBQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.734719903 (204h44m41.618133519s) [noise=true , address=45.91.116.12:4226 , piece_id=CHDORG6AH7J6OXNSWBOKHYUAUBFO5Z7PE5VPXNN6DZYN4WLAKMGQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.735057052 (204h44m41.618470667s) [noise=true , address=45.91.116.6:4973 , piece_id=3OROJ5W2C2FSBIFRW4FZV2IQDPAHL2AFSWT3VCSVL4TDBXFDPE6Q, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.740402702 (204h44m41.623816316s) [noise=true , address=77.90.31.11:4555 , piece_id=UXFNOBSKZGP5DS7GR3CO3EC2BSCR7Q3I4LKDHM5YXN4GLT43XW7Q, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.740422137 (204h44m41.623835749s) [seg_pos={0 0}, upload=163813]: Segment reached optimal threshold of 13 pieces. Jul 1 21:55:41.740671603 (204h44m41.624085219s) [noise=true , address=77.90.31.15:4697 , piece_id=MQ4CE7CFM5PVLCOTGJGGOHNSCXPINBUDDPM4AW5KDNTWQOY2GSOA, seg_pos={0 0}, upload=163813]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5): protocol: expected piece hash; context canceled; EOF Jul 1 21:55:41.740878935 (204h44m41.624292548s) [noise=true , address=104.36.82.2:4730 , piece_id=HPGHQCT5Y7J6XQ7PAKVRWV7ACF5QP7YD2HRMPJ5ZZKCYISD7EGLA, seg_pos={0 0}, upload=163813]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: write tcp 139.59.144.22:43370->104.36.82.2:4730: use of closed network connection; write tcp 139.59.144.22:43370->104.36.82.2:4730: use of closed network connection Jul 1 21:55:41.740951902 (204h44m41.624365519s) [noise=true , address=77.90.31.11:4554 , piece_id=NZ23Y66G3XEXCZRVQHZE363UMCZHD5HKS4GYHDMD7OP3G6NBUNFQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.740966291 (204h44m41.624379918s) [seg_pos={0 0}, upload=163813]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 1 21:55:41.741056758 (204h44m41.624470387s) [upload=163813]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 21:55:41.741062848 (204h44m41.624476465s) [upload=163813]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 21:55:41.928934333 (204h44m41.812347951s) [upload=163813]: Done uploading segments... Jul 1 21:55:41.928954364 (204h44m41.812367978s) [upload=163813]: Upload finished. err: <nil> Duration: 2.659079192s core uplink us-select-1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 14.642627ms target: https://eu1.storj.io/login FAIL (2025-07-01 22:00:50 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused Duration: 14.678395ms core satellite eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 9.889438ms target: https://eu1.storj.io/login FAIL (2025-07-01 22:00:24 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused Duration: 9.911338ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 3.763865938s FAIL (2025-07-01 22:00:11 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 3.763911289s core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 3.668900819s FAIL (2025-07-01 21:59:39 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== ece hash; context canceled; EOF Jul 1 21:55:26.205988280 (204h44m26.089401908s) [noise=true , address=104.36.82.16:4295 , piece_id=5NGMFQZGUANYL5YIZKYEK5KW2FG3BMCZM5BO6USG5DUDUVINYZTQ, seg_pos={0 0}, upload=163807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 1 21:55:26.206039318 (204h44m26.089452947s) [seg_pos={0 0}, upload=163807]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 21:55:26.206156289 (204h44m26.089569924s) [upload=163807]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 21:55:26.206162589 (204h44m26.089576223s) [upload=163807]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 21:55:26.355816710 (204h44m26.239230325s) [upload=163807]: Done uploading segments... Jul 1 21:55:26.355840004 (204h44m26.239253617s) [upload=163807]: Upload finished. err: <nil> Jul 1 21:55:40.843042256 (204h44m40.726455889s) [upload=163813]: Starting upload Jul 1 21:55:40.843177726 (204h44m40.726591357s) [upload=163813]: Done starting upload Jul 1 21:55:40.843270217 (204h44m40.726683839s) [upload=163813]: Uploading segments... Jul 1 21:55:40.843630266 (204h44m40.727043895s) [upload=163813]: Got next segment. Inline: false Jul 1 21:55:40.843724627 (204h44m40.727138257s) [upload=163813]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 1 21:55:40.843732293 (204h44m40.727145921s) [upload=163813]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 1 21:55:40.960993113 (204h44m40.84440674s) [seg_pos={0 0}, upload=163813]: Begin upload segment... Jul 1 21:55:40.961037554 (204h44m40.844451166s) [seg_pos={0 0}, upload=163813]: Done begin upload segment. Jul 1 21:55:40.961088163 (204h44m40.844501787s) [noise=true , address=77.90.31.14:4662 , piece_id=J65Z52J56UCJ4X35CFRUYDU7OSSXUTJY4UQVE4EUD44KGNHKG4EQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.961118736 (204h44m40.844532363s) [noise=true , address=77.90.31.15:4697 , piece_id=MQ4CE7CFM5PVLCOTGJGGOHNSCXPINBUDDPM4AW5KDNTWQOY2GSOA, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.961491001 (204h44m40.844904627s) [noise=true , address=45.91.116.5:5299 , piece_id=IC6WYGP7I6Z5QGUO2UA2YY2JCX3X5X64QFTFZ6XFZARZ2UAQHDHA, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.961649635 (204h44m40.845063263s) [noise=true , address=45.91.116.13:4155 , piece_id=XIIZ2SSODWARQ65MP6FK2X3TLMOQWJ5C3QHMVAQUWGV3QMDTDOAA, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.961832008 (204h44m40.845245637s) [noise=true , address=45.91.116.7:4009 , piece_id=SUKLORUZTKORJUXW5S5CXLLUS3SZEUUG4JTNRTVKJTHCSAEOQT6Q, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.962138542 (204h44m40.845552156s) [noise=true , address=77.90.31.18:4806 , piece_id=3M6FHWPK65RHLWDKM6WUP62642BCPN2DEB5ZXYGO5XE5ISA73KAA, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.962987586 (204h44m40.846401218s) [noise=true , address=77.90.31.13:4626 , piece_id=CJMZYOJG7LYBPIMDCFBXCZMK2FVHZU73GIGJIQHJQR5S5CDNB5DQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.963424066 (204h44m40.84683768s) [noise=true , address=77.90.31.11:4555 , piece_id=UXFNOBSKZGP5DS7GR3CO3EC2BSCR7Q3I4LKDHM5YXN4GLT43XW7Q, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.963683094 (204h44m40.84709671s) [noise=true , address=77.90.31.16:4733 , piece_id=BLHFUC4PG32AR6UDKHGL5WAF4NYGPXNRYT6AJKNV77WQGATN45LQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.963862255 (204h44m40.847275868s) [noise=true , address=45.91.116.6:4973 , piece_id=3OROJ5W2C2FSBIFRW4FZV2IQDPAHL2AFSWT3VCSVL4TDBXFDPE6Q, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.964378671 (204h44m40.847792284s) [noise=true , address=45.91.116.14:4189 , piece_id=ZUMQUNIT5UB6LW4UEDIF4O7A4UJOQ6WSWCBCMZXXWA6EKJRXU7IQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.964462817 (204h44m40.847876445s) [noise=true , address=104.36.82.2:4730 , piece_id=HPGHQCT5Y7J6XQ7PAKVRWV7ACF5QP7YD2HRMPJ5ZZKCYISD7EGLA, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.965200515 (204h44m40.84861414s) [noise=true , address=45.91.116.12:4226 , piece_id=CHDORG6AH7J6OXNSWBOKHYUAUBFO5Z7PE5VPXNN6DZYN4WLAKMGQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.965315995 (204h44m40.848729623s) [noise=true , address=77.90.31.19:4843 , piece_id=7S5CQ24KNNT4FF5Z47T6JTPKENG3GDT6TH3L3HZY7O4BXU4D2MXQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.965724902 (204h44m40.849138528s) [noise=true , address=77.90.31.17:4772 , piece_id=LWPUINLPMEMWQPFVZ5QO66TIF6TLRVHUXOU2H3PVB36N2BVDPHBQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.966073775 (204h44m40.849487401s) [noise=true , address=77.90.31.11:4554 , piece_id=NZ23Y66G3XEXCZRVQHZE363UMCZHD5HKS4GYHDMD7OP3G6NBUNFQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:41.577860363 (204h44m41.461273981s) [upload=163813]: Next returned nil segment Jul 1 21:55:41.577884796 (204h44m41.461298434s) [upload=163813]: Waiting for error group managing segments... Jul 1 21:55:41.702724908 (204h44m41.586138525s) [noise=true , address=77.90.31.13:4626 , piece_id=CJMZYOJG7LYBPIMDCFBXCZMK2FVHZU73GIGJIQHJQR5S5CDNB5DQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.711223054 (204h44m41.594636673s) [noise=true , address=77.90.31.16:4733 , piece_id=BLHFUC4PG32AR6UDKHGL5WAF4NYGPXNRYT6AJKNV77WQGATN45LQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.713793831 (204h44m41.597207458s) [noise=true , address=77.90.31.18:4806 , piece_id=3M6FHWPK65RHLWDKM6WUP62642BCPN2DEB5ZXYGO5XE5ISA73KAA, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.716457878 (204h44m41.599871495s) [noise=true , address=45.91.116.14:4189 , piece_id=ZUMQUNIT5UB6LW4UEDIF4O7A4UJOQ6WSWCBCMZXXWA6EKJRXU7IQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.716822202 (204h44m41.600235815s) [noise=true , address=77.90.31.14:4662 , piece_id=J65Z52J56UCJ4X35CFRUYDU7OSSXUTJY4UQVE4EUD44KGNHKG4EQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.719686465 (204h44m41.603100115s) [noise=true , address=45.91.116.13:4155 , piece_id=XIIZ2SSODWARQ65MP6FK2X3TLMOQWJ5C3QHMVAQUWGV3QMDTDOAA, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.720339789 (204h44m41.603753472s) [noise=true , address=45.91.116.5:5299 , piece_id=IC6WYGP7I6Z5QGUO2UA2YY2JCX3X5X64QFTFZ6XFZARZ2UAQHDHA, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.721538082 (204h44m41.604951695s) [noise=true , address=77.90.31.19:4843 , piece_id=7S5CQ24KNNT4FF5Z47T6JTPKENG3GDT6TH3L3HZY7O4BXU4D2MXQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.721589207 (204h44m41.605002824s) [noise=true , address=45.91.116.7:4009 , piece_id=SUKLORUZTKORJUXW5S5CXLLUS3SZEUUG4JTNRTVKJTHCSAEOQT6Q, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.721896624 (204h44m41.605310236s) [noise=true , address=77.90.31.17:4772 , piece_id=LWPUINLPMEMWQPFVZ5QO66TIF6TLRVHUXOU2H3PVB36N2BVDPHBQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.734719903 (204h44m41.618133519s) [noise=true , address=45.91.116.12:4226 , piece_id=CHDORG6AH7J6OXNSWBOKHYUAUBFO5Z7PE5VPXNN6DZYN4WLAKMGQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.735057052 (204h44m41.618470667s) [noise=true , address=45.91.116.6:4973 , piece_id=3OROJ5W2C2FSBIFRW4FZV2IQDPAHL2AFSWT3VCSVL4TDBXFDPE6Q, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.740402702 (204h44m41.623816316s) [noise=true , address=77.90.31.11:4555 , piece_id=UXFNOBSKZGP5DS7GR3CO3EC2BSCR7Q3I4LKDHM5YXN4GLT43XW7Q, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.740422137 (204h44m41.623835749s) [seg_pos={0 0}, upload=163813]: Segment reached optimal threshold of 13 pieces. Jul 1 21:55:41.740671603 (204h44m41.624085219s) [noise=true , address=77.90.31.15:4697 , piece_id=MQ4CE7CFM5PVLCOTGJGGOHNSCXPINBUDDPM4AW5KDNTWQOY2GSOA, seg_pos={0 0}, upload=163813]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5): protocol: expected piece hash; context canceled; EOF Jul 1 21:55:41.740878935 (204h44m41.624292548s) [noise=true , address=104.36.82.2:4730 , piece_id=HPGHQCT5Y7J6XQ7PAKVRWV7ACF5QP7YD2HRMPJ5ZZKCYISD7EGLA, seg_pos={0 0}, upload=163813]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: write tcp 139.59.144.22:43370->104.36.82.2:4730: use of closed network connection; write tcp 139.59.144.22:43370->104.36.82.2:4730: use of closed network connection Jul 1 21:55:41.740951902 (204h44m41.624365519s) [noise=true , address=77.90.31.11:4554 , piece_id=NZ23Y66G3XEXCZRVQHZE363UMCZHD5HKS4GYHDMD7OP3G6NBUNFQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.740966291 (204h44m41.624379918s) [seg_pos={0 0}, upload=163813]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 1 21:55:41.741056758 (204h44m41.624470387s) [upload=163813]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 21:55:41.741062848 (204h44m41.624476465s) [upload=163813]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 21:55:41.928934333 (204h44m41.812347951s) [upload=163813]: Done uploading segments... Jul 1 21:55:41.928954364 (204h44m41.812367978s) [upload=163813]: Upload finished. err: <nil> Duration: 3.66892842s core uplink us-select-1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 11.376159ms target: https://eu1.storj.io/login FAIL (2025-07-01 21:59:18 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused Duration: 11.411507ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 216.278124ms FAIL (2025-07-01 21:59:06 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 216.305386ms core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 2.865002616s FAIL (2025-07-01 21:59:02 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== ece hash; context canceled; EOF Jul 1 21:55:26.205988280 (204h44m26.089401908s) [noise=true , address=104.36.82.16:4295 , piece_id=5NGMFQZGUANYL5YIZKYEK5KW2FG3BMCZM5BO6USG5DUDUVINYZTQ, seg_pos={0 0}, upload=163807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 1 21:55:26.206039318 (204h44m26.089452947s) [seg_pos={0 0}, upload=163807]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 21:55:26.206156289 (204h44m26.089569924s) [upload=163807]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 21:55:26.206162589 (204h44m26.089576223s) [upload=163807]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 21:55:26.355816710 (204h44m26.239230325s) [upload=163807]: Done uploading segments... Jul 1 21:55:26.355840004 (204h44m26.239253617s) [upload=163807]: Upload finished. err: <nil> Jul 1 21:55:40.843042256 (204h44m40.726455889s) [upload=163813]: Starting upload Jul 1 21:55:40.843177726 (204h44m40.726591357s) [upload=163813]: Done starting upload Jul 1 21:55:40.843270217 (204h44m40.726683839s) [upload=163813]: Uploading segments... Jul 1 21:55:40.843630266 (204h44m40.727043895s) [upload=163813]: Got next segment. Inline: false Jul 1 21:55:40.843724627 (204h44m40.727138257s) [upload=163813]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 1 21:55:40.843732293 (204h44m40.727145921s) [upload=163813]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 1 21:55:40.960993113 (204h44m40.84440674s) [seg_pos={0 0}, upload=163813]: Begin upload segment... Jul 1 21:55:40.961037554 (204h44m40.844451166s) [seg_pos={0 0}, upload=163813]: Done begin upload segment. Jul 1 21:55:40.961088163 (204h44m40.844501787s) [noise=true , address=77.90.31.14:4662 , piece_id=J65Z52J56UCJ4X35CFRUYDU7OSSXUTJY4UQVE4EUD44KGNHKG4EQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.961118736 (204h44m40.844532363s) [noise=true , address=77.90.31.15:4697 , piece_id=MQ4CE7CFM5PVLCOTGJGGOHNSCXPINBUDDPM4AW5KDNTWQOY2GSOA, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.961491001 (204h44m40.844904627s) [noise=true , address=45.91.116.5:5299 , piece_id=IC6WYGP7I6Z5QGUO2UA2YY2JCX3X5X64QFTFZ6XFZARZ2UAQHDHA, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.961649635 (204h44m40.845063263s) [noise=true , address=45.91.116.13:4155 , piece_id=XIIZ2SSODWARQ65MP6FK2X3TLMOQWJ5C3QHMVAQUWGV3QMDTDOAA, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.961832008 (204h44m40.845245637s) [noise=true , address=45.91.116.7:4009 , piece_id=SUKLORUZTKORJUXW5S5CXLLUS3SZEUUG4JTNRTVKJTHCSAEOQT6Q, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.962138542 (204h44m40.845552156s) [noise=true , address=77.90.31.18:4806 , piece_id=3M6FHWPK65RHLWDKM6WUP62642BCPN2DEB5ZXYGO5XE5ISA73KAA, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.962987586 (204h44m40.846401218s) [noise=true , address=77.90.31.13:4626 , piece_id=CJMZYOJG7LYBPIMDCFBXCZMK2FVHZU73GIGJIQHJQR5S5CDNB5DQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.963424066 (204h44m40.84683768s) [noise=true , address=77.90.31.11:4555 , piece_id=UXFNOBSKZGP5DS7GR3CO3EC2BSCR7Q3I4LKDHM5YXN4GLT43XW7Q, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.963683094 (204h44m40.84709671s) [noise=true , address=77.90.31.16:4733 , piece_id=BLHFUC4PG32AR6UDKHGL5WAF4NYGPXNRYT6AJKNV77WQGATN45LQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.963862255 (204h44m40.847275868s) [noise=true , address=45.91.116.6:4973 , piece_id=3OROJ5W2C2FSBIFRW4FZV2IQDPAHL2AFSWT3VCSVL4TDBXFDPE6Q, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.964378671 (204h44m40.847792284s) [noise=true , address=45.91.116.14:4189 , piece_id=ZUMQUNIT5UB6LW4UEDIF4O7A4UJOQ6WSWCBCMZXXWA6EKJRXU7IQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.964462817 (204h44m40.847876445s) [noise=true , address=104.36.82.2:4730 , piece_id=HPGHQCT5Y7J6XQ7PAKVRWV7ACF5QP7YD2HRMPJ5ZZKCYISD7EGLA, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.965200515 (204h44m40.84861414s) [noise=true , address=45.91.116.12:4226 , piece_id=CHDORG6AH7J6OXNSWBOKHYUAUBFO5Z7PE5VPXNN6DZYN4WLAKMGQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.965315995 (204h44m40.848729623s) [noise=true , address=77.90.31.19:4843 , piece_id=7S5CQ24KNNT4FF5Z47T6JTPKENG3GDT6TH3L3HZY7O4BXU4D2MXQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.965724902 (204h44m40.849138528s) [noise=true , address=77.90.31.17:4772 , piece_id=LWPUINLPMEMWQPFVZ5QO66TIF6TLRVHUXOU2H3PVB36N2BVDPHBQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.966073775 (204h44m40.849487401s) [noise=true , address=77.90.31.11:4554 , piece_id=NZ23Y66G3XEXCZRVQHZE363UMCZHD5HKS4GYHDMD7OP3G6NBUNFQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:41.577860363 (204h44m41.461273981s) [upload=163813]: Next returned nil segment Jul 1 21:55:41.577884796 (204h44m41.461298434s) [upload=163813]: Waiting for error group managing segments... Jul 1 21:55:41.702724908 (204h44m41.586138525s) [noise=true , address=77.90.31.13:4626 , piece_id=CJMZYOJG7LYBPIMDCFBXCZMK2FVHZU73GIGJIQHJQR5S5CDNB5DQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.711223054 (204h44m41.594636673s) [noise=true , address=77.90.31.16:4733 , piece_id=BLHFUC4PG32AR6UDKHGL5WAF4NYGPXNRYT6AJKNV77WQGATN45LQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.713793831 (204h44m41.597207458s) [noise=true , address=77.90.31.18:4806 , piece_id=3M6FHWPK65RHLWDKM6WUP62642BCPN2DEB5ZXYGO5XE5ISA73KAA, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.716457878 (204h44m41.599871495s) [noise=true , address=45.91.116.14:4189 , piece_id=ZUMQUNIT5UB6LW4UEDIF4O7A4UJOQ6WSWCBCMZXXWA6EKJRXU7IQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.716822202 (204h44m41.600235815s) [noise=true , address=77.90.31.14:4662 , piece_id=J65Z52J56UCJ4X35CFRUYDU7OSSXUTJY4UQVE4EUD44KGNHKG4EQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.719686465 (204h44m41.603100115s) [noise=true , address=45.91.116.13:4155 , piece_id=XIIZ2SSODWARQ65MP6FK2X3TLMOQWJ5C3QHMVAQUWGV3QMDTDOAA, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.720339789 (204h44m41.603753472s) [noise=true , address=45.91.116.5:5299 , piece_id=IC6WYGP7I6Z5QGUO2UA2YY2JCX3X5X64QFTFZ6XFZARZ2UAQHDHA, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.721538082 (204h44m41.604951695s) [noise=true , address=77.90.31.19:4843 , piece_id=7S5CQ24KNNT4FF5Z47T6JTPKENG3GDT6TH3L3HZY7O4BXU4D2MXQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.721589207 (204h44m41.605002824s) [noise=true , address=45.91.116.7:4009 , piece_id=SUKLORUZTKORJUXW5S5CXLLUS3SZEUUG4JTNRTVKJTHCSAEOQT6Q, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.721896624 (204h44m41.605310236s) [noise=true , address=77.90.31.17:4772 , piece_id=LWPUINLPMEMWQPFVZ5QO66TIF6TLRVHUXOU2H3PVB36N2BVDPHBQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.734719903 (204h44m41.618133519s) [noise=true , address=45.91.116.12:4226 , piece_id=CHDORG6AH7J6OXNSWBOKHYUAUBFO5Z7PE5VPXNN6DZYN4WLAKMGQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.735057052 (204h44m41.618470667s) [noise=true , address=45.91.116.6:4973 , piece_id=3OROJ5W2C2FSBIFRW4FZV2IQDPAHL2AFSWT3VCSVL4TDBXFDPE6Q, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.740402702 (204h44m41.623816316s) [noise=true , address=77.90.31.11:4555 , piece_id=UXFNOBSKZGP5DS7GR3CO3EC2BSCR7Q3I4LKDHM5YXN4GLT43XW7Q, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.740422137 (204h44m41.623835749s) [seg_pos={0 0}, upload=163813]: Segment reached optimal threshold of 13 pieces. Jul 1 21:55:41.740671603 (204h44m41.624085219s) [noise=true , address=77.90.31.15:4697 , piece_id=MQ4CE7CFM5PVLCOTGJGGOHNSCXPINBUDDPM4AW5KDNTWQOY2GSOA, seg_pos={0 0}, upload=163813]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5): protocol: expected piece hash; context canceled; EOF Jul 1 21:55:41.740878935 (204h44m41.624292548s) [noise=true , address=104.36.82.2:4730 , piece_id=HPGHQCT5Y7J6XQ7PAKVRWV7ACF5QP7YD2HRMPJ5ZZKCYISD7EGLA, seg_pos={0 0}, upload=163813]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: write tcp 139.59.144.22:43370->104.36.82.2:4730: use of closed network connection; write tcp 139.59.144.22:43370->104.36.82.2:4730: use of closed network connection Jul 1 21:55:41.740951902 (204h44m41.624365519s) [noise=true , address=77.90.31.11:4554 , piece_id=NZ23Y66G3XEXCZRVQHZE363UMCZHD5HKS4GYHDMD7OP3G6NBUNFQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.740966291 (204h44m41.624379918s) [seg_pos={0 0}, upload=163813]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 1 21:55:41.741056758 (204h44m41.624470387s) [upload=163813]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 21:55:41.741062848 (204h44m41.624476465s) [upload=163813]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 21:55:41.928934333 (204h44m41.812347951s) [upload=163813]: Done uploading segments... Jul 1 21:55:41.928954364 (204h44m41.812367978s) [upload=163813]: Upload finished. err: <nil> Duration: 2.865035895s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 269.624307ms FAIL (2025-07-01 21:58:50 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 269.753885ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 219.779665ms FAIL (2025-07-01 21:58:09 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 219.813195ms core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 9.372289ms target: https://eu1.storj.io/login FAIL (2025-07-01 21:58:05 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused Duration: 9.400275ms core satellite eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 2.492402673s FAIL (2025-07-01 21:58:04 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== ece hash; context canceled; EOF Jul 1 21:55:26.205988280 (204h44m26.089401908s) [noise=true , address=104.36.82.16:4295 , piece_id=5NGMFQZGUANYL5YIZKYEK5KW2FG3BMCZM5BO6USG5DUDUVINYZTQ, seg_pos={0 0}, upload=163807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 1 21:55:26.206039318 (204h44m26.089452947s) [seg_pos={0 0}, upload=163807]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 21:55:26.206156289 (204h44m26.089569924s) [upload=163807]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 21:55:26.206162589 (204h44m26.089576223s) [upload=163807]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 21:55:26.355816710 (204h44m26.239230325s) [upload=163807]: Done uploading segments... Jul 1 21:55:26.355840004 (204h44m26.239253617s) [upload=163807]: Upload finished. err: <nil> Jul 1 21:55:40.843042256 (204h44m40.726455889s) [upload=163813]: Starting upload Jul 1 21:55:40.843177726 (204h44m40.726591357s) [upload=163813]: Done starting upload Jul 1 21:55:40.843270217 (204h44m40.726683839s) [upload=163813]: Uploading segments... Jul 1 21:55:40.843630266 (204h44m40.727043895s) [upload=163813]: Got next segment. Inline: false Jul 1 21:55:40.843724627 (204h44m40.727138257s) [upload=163813]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 1 21:55:40.843732293 (204h44m40.727145921s) [upload=163813]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 1 21:55:40.960993113 (204h44m40.84440674s) [seg_pos={0 0}, upload=163813]: Begin upload segment... Jul 1 21:55:40.961037554 (204h44m40.844451166s) [seg_pos={0 0}, upload=163813]: Done begin upload segment. Jul 1 21:55:40.961088163 (204h44m40.844501787s) [noise=true , address=77.90.31.14:4662 , piece_id=J65Z52J56UCJ4X35CFRUYDU7OSSXUTJY4UQVE4EUD44KGNHKG4EQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.961118736 (204h44m40.844532363s) [noise=true , address=77.90.31.15:4697 , piece_id=MQ4CE7CFM5PVLCOTGJGGOHNSCXPINBUDDPM4AW5KDNTWQOY2GSOA, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.961491001 (204h44m40.844904627s) [noise=true , address=45.91.116.5:5299 , piece_id=IC6WYGP7I6Z5QGUO2UA2YY2JCX3X5X64QFTFZ6XFZARZ2UAQHDHA, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.961649635 (204h44m40.845063263s) [noise=true , address=45.91.116.13:4155 , piece_id=XIIZ2SSODWARQ65MP6FK2X3TLMOQWJ5C3QHMVAQUWGV3QMDTDOAA, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.961832008 (204h44m40.845245637s) [noise=true , address=45.91.116.7:4009 , piece_id=SUKLORUZTKORJUXW5S5CXLLUS3SZEUUG4JTNRTVKJTHCSAEOQT6Q, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.962138542 (204h44m40.845552156s) [noise=true , address=77.90.31.18:4806 , piece_id=3M6FHWPK65RHLWDKM6WUP62642BCPN2DEB5ZXYGO5XE5ISA73KAA, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.962987586 (204h44m40.846401218s) [noise=true , address=77.90.31.13:4626 , piece_id=CJMZYOJG7LYBPIMDCFBXCZMK2FVHZU73GIGJIQHJQR5S5CDNB5DQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.963424066 (204h44m40.84683768s) [noise=true , address=77.90.31.11:4555 , piece_id=UXFNOBSKZGP5DS7GR3CO3EC2BSCR7Q3I4LKDHM5YXN4GLT43XW7Q, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.963683094 (204h44m40.84709671s) [noise=true , address=77.90.31.16:4733 , piece_id=BLHFUC4PG32AR6UDKHGL5WAF4NYGPXNRYT6AJKNV77WQGATN45LQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.963862255 (204h44m40.847275868s) [noise=true , address=45.91.116.6:4973 , piece_id=3OROJ5W2C2FSBIFRW4FZV2IQDPAHL2AFSWT3VCSVL4TDBXFDPE6Q, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.964378671 (204h44m40.847792284s) [noise=true , address=45.91.116.14:4189 , piece_id=ZUMQUNIT5UB6LW4UEDIF4O7A4UJOQ6WSWCBCMZXXWA6EKJRXU7IQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.964462817 (204h44m40.847876445s) [noise=true , address=104.36.82.2:4730 , piece_id=HPGHQCT5Y7J6XQ7PAKVRWV7ACF5QP7YD2HRMPJ5ZZKCYISD7EGLA, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.965200515 (204h44m40.84861414s) [noise=true , address=45.91.116.12:4226 , piece_id=CHDORG6AH7J6OXNSWBOKHYUAUBFO5Z7PE5VPXNN6DZYN4WLAKMGQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.965315995 (204h44m40.848729623s) [noise=true , address=77.90.31.19:4843 , piece_id=7S5CQ24KNNT4FF5Z47T6JTPKENG3GDT6TH3L3HZY7O4BXU4D2MXQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.965724902 (204h44m40.849138528s) [noise=true , address=77.90.31.17:4772 , piece_id=LWPUINLPMEMWQPFVZ5QO66TIF6TLRVHUXOU2H3PVB36N2BVDPHBQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.966073775 (204h44m40.849487401s) [noise=true , address=77.90.31.11:4554 , piece_id=NZ23Y66G3XEXCZRVQHZE363UMCZHD5HKS4GYHDMD7OP3G6NBUNFQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:41.577860363 (204h44m41.461273981s) [upload=163813]: Next returned nil segment Jul 1 21:55:41.577884796 (204h44m41.461298434s) [upload=163813]: Waiting for error group managing segments... Jul 1 21:55:41.702724908 (204h44m41.586138525s) [noise=true , address=77.90.31.13:4626 , piece_id=CJMZYOJG7LYBPIMDCFBXCZMK2FVHZU73GIGJIQHJQR5S5CDNB5DQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.711223054 (204h44m41.594636673s) [noise=true , address=77.90.31.16:4733 , piece_id=BLHFUC4PG32AR6UDKHGL5WAF4NYGPXNRYT6AJKNV77WQGATN45LQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.713793831 (204h44m41.597207458s) [noise=true , address=77.90.31.18:4806 , piece_id=3M6FHWPK65RHLWDKM6WUP62642BCPN2DEB5ZXYGO5XE5ISA73KAA, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.716457878 (204h44m41.599871495s) [noise=true , address=45.91.116.14:4189 , piece_id=ZUMQUNIT5UB6LW4UEDIF4O7A4UJOQ6WSWCBCMZXXWA6EKJRXU7IQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.716822202 (204h44m41.600235815s) [noise=true , address=77.90.31.14:4662 , piece_id=J65Z52J56UCJ4X35CFRUYDU7OSSXUTJY4UQVE4EUD44KGNHKG4EQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.719686465 (204h44m41.603100115s) [noise=true , address=45.91.116.13:4155 , piece_id=XIIZ2SSODWARQ65MP6FK2X3TLMOQWJ5C3QHMVAQUWGV3QMDTDOAA, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.720339789 (204h44m41.603753472s) [noise=true , address=45.91.116.5:5299 , piece_id=IC6WYGP7I6Z5QGUO2UA2YY2JCX3X5X64QFTFZ6XFZARZ2UAQHDHA, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.721538082 (204h44m41.604951695s) [noise=true , address=77.90.31.19:4843 , piece_id=7S5CQ24KNNT4FF5Z47T6JTPKENG3GDT6TH3L3HZY7O4BXU4D2MXQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.721589207 (204h44m41.605002824s) [noise=true , address=45.91.116.7:4009 , piece_id=SUKLORUZTKORJUXW5S5CXLLUS3SZEUUG4JTNRTVKJTHCSAEOQT6Q, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.721896624 (204h44m41.605310236s) [noise=true , address=77.90.31.17:4772 , piece_id=LWPUINLPMEMWQPFVZ5QO66TIF6TLRVHUXOU2H3PVB36N2BVDPHBQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.734719903 (204h44m41.618133519s) [noise=true , address=45.91.116.12:4226 , piece_id=CHDORG6AH7J6OXNSWBOKHYUAUBFO5Z7PE5VPXNN6DZYN4WLAKMGQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.735057052 (204h44m41.618470667s) [noise=true , address=45.91.116.6:4973 , piece_id=3OROJ5W2C2FSBIFRW4FZV2IQDPAHL2AFSWT3VCSVL4TDBXFDPE6Q, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.740402702 (204h44m41.623816316s) [noise=true , address=77.90.31.11:4555 , piece_id=UXFNOBSKZGP5DS7GR3CO3EC2BSCR7Q3I4LKDHM5YXN4GLT43XW7Q, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.740422137 (204h44m41.623835749s) [seg_pos={0 0}, upload=163813]: Segment reached optimal threshold of 13 pieces. Jul 1 21:55:41.740671603 (204h44m41.624085219s) [noise=true , address=77.90.31.15:4697 , piece_id=MQ4CE7CFM5PVLCOTGJGGOHNSCXPINBUDDPM4AW5KDNTWQOY2GSOA, seg_pos={0 0}, upload=163813]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5): protocol: expected piece hash; context canceled; EOF Jul 1 21:55:41.740878935 (204h44m41.624292548s) [noise=true , address=104.36.82.2:4730 , piece_id=HPGHQCT5Y7J6XQ7PAKVRWV7ACF5QP7YD2HRMPJ5ZZKCYISD7EGLA, seg_pos={0 0}, upload=163813]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: write tcp 139.59.144.22:43370->104.36.82.2:4730: use of closed network connection; write tcp 139.59.144.22:43370->104.36.82.2:4730: use of closed network connection Jul 1 21:55:41.740951902 (204h44m41.624365519s) [noise=true , address=77.90.31.11:4554 , piece_id=NZ23Y66G3XEXCZRVQHZE363UMCZHD5HKS4GYHDMD7OP3G6NBUNFQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.740966291 (204h44m41.624379918s) [seg_pos={0 0}, upload=163813]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 1 21:55:41.741056758 (204h44m41.624470387s) [upload=163813]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 21:55:41.741062848 (204h44m41.624476465s) [upload=163813]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 21:55:41.928934333 (204h44m41.812347951s) [upload=163813]: Done uploading segments... Jul 1 21:55:41.928954364 (204h44m41.812367978s) [upload=163813]: Upload finished. err: <nil> Duration: 2.49243384s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 178.679455ms FAIL (2025-07-01 21:57:39 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 178.709465ms core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 12.173739ms target: https://eu1.storj.io/login FAIL (2025-07-01 21:57:37 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused Duration: 12.220166ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 219.503014ms FAIL (2025-07-01 21:57:23 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 219.533915ms core uplink eu1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.0021996s FAIL (2025-07-01 21:57:17 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== ece hash; context canceled; EOF Jul 1 21:55:26.205988280 (204h44m26.089401908s) [noise=true , address=104.36.82.16:4295 , piece_id=5NGMFQZGUANYL5YIZKYEK5KW2FG3BMCZM5BO6USG5DUDUVINYZTQ, seg_pos={0 0}, upload=163807]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1kjzBTGEGEs1qKgbkvvC9bBfPrUa6r6yToz1qhS1pjVqEagauT): protocol: expected piece hash; context canceled; EOF Jul 1 21:55:26.206039318 (204h44m26.089452947s) [seg_pos={0 0}, upload=163807]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 1 21:55:26.206156289 (204h44m26.089569924s) [upload=163807]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 21:55:26.206162589 (204h44m26.089576223s) [upload=163807]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 21:55:26.355816710 (204h44m26.239230325s) [upload=163807]: Done uploading segments... Jul 1 21:55:26.355840004 (204h44m26.239253617s) [upload=163807]: Upload finished. err: <nil> Jul 1 21:55:40.843042256 (204h44m40.726455889s) [upload=163813]: Starting upload Jul 1 21:55:40.843177726 (204h44m40.726591357s) [upload=163813]: Done starting upload Jul 1 21:55:40.843270217 (204h44m40.726683839s) [upload=163813]: Uploading segments... Jul 1 21:55:40.843630266 (204h44m40.727043895s) [upload=163813]: Got next segment. Inline: false Jul 1 21:55:40.843724627 (204h44m40.727138257s) [upload=163813]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 1 21:55:40.843732293 (204h44m40.727145921s) [upload=163813]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 1 21:55:40.960993113 (204h44m40.84440674s) [seg_pos={0 0}, upload=163813]: Begin upload segment... Jul 1 21:55:40.961037554 (204h44m40.844451166s) [seg_pos={0 0}, upload=163813]: Done begin upload segment. Jul 1 21:55:40.961088163 (204h44m40.844501787s) [noise=true , address=77.90.31.14:4662 , piece_id=J65Z52J56UCJ4X35CFRUYDU7OSSXUTJY4UQVE4EUD44KGNHKG4EQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.961118736 (204h44m40.844532363s) [noise=true , address=77.90.31.15:4697 , piece_id=MQ4CE7CFM5PVLCOTGJGGOHNSCXPINBUDDPM4AW5KDNTWQOY2GSOA, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.961491001 (204h44m40.844904627s) [noise=true , address=45.91.116.5:5299 , piece_id=IC6WYGP7I6Z5QGUO2UA2YY2JCX3X5X64QFTFZ6XFZARZ2UAQHDHA, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.961649635 (204h44m40.845063263s) [noise=true , address=45.91.116.13:4155 , piece_id=XIIZ2SSODWARQ65MP6FK2X3TLMOQWJ5C3QHMVAQUWGV3QMDTDOAA, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.961832008 (204h44m40.845245637s) [noise=true , address=45.91.116.7:4009 , piece_id=SUKLORUZTKORJUXW5S5CXLLUS3SZEUUG4JTNRTVKJTHCSAEOQT6Q, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.962138542 (204h44m40.845552156s) [noise=true , address=77.90.31.18:4806 , piece_id=3M6FHWPK65RHLWDKM6WUP62642BCPN2DEB5ZXYGO5XE5ISA73KAA, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.962987586 (204h44m40.846401218s) [noise=true , address=77.90.31.13:4626 , piece_id=CJMZYOJG7LYBPIMDCFBXCZMK2FVHZU73GIGJIQHJQR5S5CDNB5DQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.963424066 (204h44m40.84683768s) [noise=true , address=77.90.31.11:4555 , piece_id=UXFNOBSKZGP5DS7GR3CO3EC2BSCR7Q3I4LKDHM5YXN4GLT43XW7Q, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.963683094 (204h44m40.84709671s) [noise=true , address=77.90.31.16:4733 , piece_id=BLHFUC4PG32AR6UDKHGL5WAF4NYGPXNRYT6AJKNV77WQGATN45LQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.963862255 (204h44m40.847275868s) [noise=true , address=45.91.116.6:4973 , piece_id=3OROJ5W2C2FSBIFRW4FZV2IQDPAHL2AFSWT3VCSVL4TDBXFDPE6Q, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.964378671 (204h44m40.847792284s) [noise=true , address=45.91.116.14:4189 , piece_id=ZUMQUNIT5UB6LW4UEDIF4O7A4UJOQ6WSWCBCMZXXWA6EKJRXU7IQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.964462817 (204h44m40.847876445s) [noise=true , address=104.36.82.2:4730 , piece_id=HPGHQCT5Y7J6XQ7PAKVRWV7ACF5QP7YD2HRMPJ5ZZKCYISD7EGLA, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.965200515 (204h44m40.84861414s) [noise=true , address=45.91.116.12:4226 , piece_id=CHDORG6AH7J6OXNSWBOKHYUAUBFO5Z7PE5VPXNN6DZYN4WLAKMGQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.965315995 (204h44m40.848729623s) [noise=true , address=77.90.31.19:4843 , piece_id=7S5CQ24KNNT4FF5Z47T6JTPKENG3GDT6TH3L3HZY7O4BXU4D2MXQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.965724902 (204h44m40.849138528s) [noise=true , address=77.90.31.17:4772 , piece_id=LWPUINLPMEMWQPFVZ5QO66TIF6TLRVHUXOU2H3PVB36N2BVDPHBQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:40.966073775 (204h44m40.849487401s) [noise=true , address=77.90.31.11:4554 , piece_id=NZ23Y66G3XEXCZRVQHZE363UMCZHD5HKS4GYHDMD7OP3G6NBUNFQ, seg_pos={0 0}, upload=163813]: Uploading piece... Jul 1 21:55:41.577860363 (204h44m41.461273981s) [upload=163813]: Next returned nil segment Jul 1 21:55:41.577884796 (204h44m41.461298434s) [upload=163813]: Waiting for error group managing segments... Jul 1 21:55:41.702724908 (204h44m41.586138525s) [noise=true , address=77.90.31.13:4626 , piece_id=CJMZYOJG7LYBPIMDCFBXCZMK2FVHZU73GIGJIQHJQR5S5CDNB5DQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.711223054 (204h44m41.594636673s) [noise=true , address=77.90.31.16:4733 , piece_id=BLHFUC4PG32AR6UDKHGL5WAF4NYGPXNRYT6AJKNV77WQGATN45LQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.713793831 (204h44m41.597207458s) [noise=true , address=77.90.31.18:4806 , piece_id=3M6FHWPK65RHLWDKM6WUP62642BCPN2DEB5ZXYGO5XE5ISA73KAA, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.716457878 (204h44m41.599871495s) [noise=true , address=45.91.116.14:4189 , piece_id=ZUMQUNIT5UB6LW4UEDIF4O7A4UJOQ6WSWCBCMZXXWA6EKJRXU7IQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.716822202 (204h44m41.600235815s) [noise=true , address=77.90.31.14:4662 , piece_id=J65Z52J56UCJ4X35CFRUYDU7OSSXUTJY4UQVE4EUD44KGNHKG4EQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.719686465 (204h44m41.603100115s) [noise=true , address=45.91.116.13:4155 , piece_id=XIIZ2SSODWARQ65MP6FK2X3TLMOQWJ5C3QHMVAQUWGV3QMDTDOAA, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.720339789 (204h44m41.603753472s) [noise=true , address=45.91.116.5:5299 , piece_id=IC6WYGP7I6Z5QGUO2UA2YY2JCX3X5X64QFTFZ6XFZARZ2UAQHDHA, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.721538082 (204h44m41.604951695s) [noise=true , address=77.90.31.19:4843 , piece_id=7S5CQ24KNNT4FF5Z47T6JTPKENG3GDT6TH3L3HZY7O4BXU4D2MXQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.721589207 (204h44m41.605002824s) [noise=true , address=45.91.116.7:4009 , piece_id=SUKLORUZTKORJUXW5S5CXLLUS3SZEUUG4JTNRTVKJTHCSAEOQT6Q, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.721896624 (204h44m41.605310236s) [noise=true , address=77.90.31.17:4772 , piece_id=LWPUINLPMEMWQPFVZ5QO66TIF6TLRVHUXOU2H3PVB36N2BVDPHBQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.734719903 (204h44m41.618133519s) [noise=true , address=45.91.116.12:4226 , piece_id=CHDORG6AH7J6OXNSWBOKHYUAUBFO5Z7PE5VPXNN6DZYN4WLAKMGQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.735057052 (204h44m41.618470667s) [noise=true , address=45.91.116.6:4973 , piece_id=3OROJ5W2C2FSBIFRW4FZV2IQDPAHL2AFSWT3VCSVL4TDBXFDPE6Q, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.740402702 (204h44m41.623816316s) [noise=true , address=77.90.31.11:4555 , piece_id=UXFNOBSKZGP5DS7GR3CO3EC2BSCR7Q3I4LKDHM5YXN4GLT43XW7Q, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.740422137 (204h44m41.623835749s) [seg_pos={0 0}, upload=163813]: Segment reached optimal threshold of 13 pieces. Jul 1 21:55:41.740671603 (204h44m41.624085219s) [noise=true , address=77.90.31.15:4697 , piece_id=MQ4CE7CFM5PVLCOTGJGGOHNSCXPINBUDDPM4AW5KDNTWQOY2GSOA, seg_pos={0 0}, upload=163813]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12AwQ11hGrJg7dmGK4WkceFmt6VSXLC7FXgXH159pCAe2muwps5): protocol: expected piece hash; context canceled; EOF Jul 1 21:55:41.740878935 (204h44m41.624292548s) [noise=true , address=104.36.82.2:4730 , piece_id=HPGHQCT5Y7J6XQ7PAKVRWV7ACF5QP7YD2HRMPJ5ZZKCYISD7EGLA, seg_pos={0 0}, upload=163813]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom): protocol: write tcp 139.59.144.22:43370->104.36.82.2:4730: use of closed network connection; write tcp 139.59.144.22:43370->104.36.82.2:4730: use of closed network connection Jul 1 21:55:41.740951902 (204h44m41.624365519s) [noise=true , address=77.90.31.11:4554 , piece_id=NZ23Y66G3XEXCZRVQHZE363UMCZHD5HKS4GYHDMD7OP3G6NBUNFQ, seg_pos={0 0}, upload=163813]: Done uploading piece. err: <nil> Jul 1 21:55:41.740966291 (204h44m41.624379918s) [seg_pos={0 0}, upload=163813]: Done waiting for segment. successful: 14 optimal: 13 errs: <nil> Jul 1 21:55:41.741056758 (204h44m41.624470387s) [upload=163813]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 1 21:55:41.741062848 (204h44m41.624476465s) [upload=163813]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 1 21:55:41.928934333 (204h44m41.812347951s) [upload=163813]: Done uploading segments... Jul 1 21:55:41.928954364 (204h44m41.812367978s) [upload=163813]: Upload finished. err: <nil> Duration: 30.002224723s core uplink us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 192.969257ms FAIL (2025-07-01 21:56:59 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 193.005973ms core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 11.527023ms target: https://eu1.storj.io/login FAIL (2025-07-01 21:56:28 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused Duration: 11.558535ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 322.138444ms FAIL (2025-07-01 21:55:54 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 322.186879ms core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 11.337229ms target: https://eu1.storj.io/login FAIL (2025-07-01 21:55:42 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused Duration: 11.363615ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 259.641973ms FAIL (2025-07-01 21:55:09 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 259.675654ms core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 11.979266ms target: https://eu1.storj.io/login FAIL (2025-07-01 21:54:28 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused Duration: 12.007684ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 246.083244ms FAIL (2025-07-01 21:54:25 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 246.132064ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 184.199508ms FAIL (2025-07-01 21:53:29 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 184.235615ms core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 12.946347ms target: https://eu1.storj.io/login FAIL (2025-07-01 21:53:26 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused Duration: 12.976564ms core satellite eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 14.282711ms target: https://eu1.storj.io/login FAIL (2025-07-01 21:52:39 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused Duration: 14.309882ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 204.195655ms FAIL (2025-07-01 21:52:35 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 204.227722ms core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 10.374353ms target: https://eu1.storj.io/login FAIL (2025-07-01 21:51:59 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused Duration: 10.418199ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 214.22266ms FAIL (2025-07-01 21:51:41 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 214.253545ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 194.441144ms FAIL (2025-07-01 21:51:22 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 194.473605ms core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 24.036217ms target: https://eu1.storj.io/login FAIL (2025-07-01 21:51:07 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused Duration: 24.055359ms core satellite eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 11.04968ms target: https://eu1.storj.io/login FAIL (2025-07-01 21:50:20 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused Duration: 11.12889ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 238.040679ms FAIL (2025-07-01 21:50:15 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 238.108932ms core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 17.287196ms target: https://eu1.storj.io/login FAIL (2025-07-01 21:49:19 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused Duration: 17.460092ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 199.971404ms FAIL (2025-07-01 21:49:01 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 200.407328ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 157.488815ms FAIL (2025-07-01 21:48:37 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 157.54973ms core uplink eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 23.961876ms target: https://eu1.storj.io/login FAIL (2025-07-01 21:48:19 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused Duration: 23.989001ms core satellite eu1
checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 7.444527ms target: https://eu1.storj.io/login FAIL (2025-07-01 21:48:01 UTC) orbiter warning: Get "https://eu1.storj.io/login": dial tcp 34.159.134.91:443: connect: connection refused Duration: 7.485922ms core satellite eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 337.21139ms FAIL (2025-07-01 21:47:31 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 337.290601ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 216.442263ms FAIL (2025-07-01 21:46:36 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 216.478061ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 197.125582ms FAIL (2025-07-01 21:45:36 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 197.151476ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 543.054039ms FAIL (2025-07-01 21:45:15 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 543.105546ms core uplink eu1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 551.660212ms FAIL (2025-07-01 21:44:05 UTC) orbiter warning: uplink: metaclient: context deadline exceeded Duration: 551.688648ms core uplink eu1

Orbiter Check History

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.HTTP{"GET" "https://eu1.storj.io/login", TLSCertExpirationWarning: 672h0m0s, TLSCertExpirationError: 336h0m0s} failure (antiblip window 3/60): (http.eu1.satellite_login)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_eu_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.eu1.inline)