Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
1.000882032s
FAIL (2025-08-12 04:35:24 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 23a37bcf660173138aa48e37b953e7540e4ebbb82d1fd91cd4e9a1359ebaea58 != before 0b3a0fe2f47fd2acf257054a8b87a0368838d2abd1c3c966db2b0284383a3ce3 ======LOGS====== Aug 12 04:32:40.217998332 (83h7m2.177095589s) [upload=86631]: Starting upload Aug 12 04:32:40.218083453 (83h7m2.177180707s) [upload=86631]: Done starting upload Aug 12 04:32:40.218186162 (83h7m2.177283395s) [upload=86631]: Uploading segments... Aug 12 04:32:40.218241151 (83h7m2.177338411s) [upload=86631]: Got next segment. Inline: true Aug 12 04:32:40.218263885 (83h7m2.177361143s) [upload=86631]: Waiting for error group managing segments... Aug 12 04:32:40.218345817 (83h7m2.17744307s) [upload=86631]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 04:32:40.218355038 (83h7m2.177452294s) [upload=86631]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 04:32:40.218358905 (83h7m2.177456151s) [upload=86631]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 04:32:40.361629357 (83h7m2.320726603s) [upload=86631]: Done uploading segments... Aug 12 04:32:40.361653860 (83h7m2.320751107s) [upload=86631]: Upload finished. err: <nil>
Duration: 1.000934069s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
2.626917696s
FAIL (2025-08-12 04:35:03 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b16e79e6792c3fb04b8a14731e255f5021232646d28cb4196aa31f9989a30bf2 != before b8b40385173213ad8d45a63c42247bea90ce75ae9eb6690c781f40993cdfea90
======LOGS======
Aug 12 04:01:45.307279589 (82h36m7.266376824s) [upload=86071]: Starting upload
Aug 12 04:01:45.307335524 (82h36m7.266432777s) [upload=86071]: Done starting upload
Aug 12 04:01:45.307590001 (82h36m7.266687236s) [upload=86071]: Uploading segments...
Aug 12 04:01:45.307891832 (82h36m7.266989077s) [upload=86071]: Got next segment. Inline: false
Aug 12 04:01:45.307968802 (82h36m7.267066047s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 04:01:45.307974771 (82h36m7.267072016s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 04:01:45.509630647 (82h36m7.468727893s) [seg_pos={0 0}, upload=86071]: Begin upload segment...
Aug 12 04:01:45.509684496 (82h36m7.468781747s) [seg_pos={0 0}, upload=86071]: Done begin upload segment.
Aug 12 04:01:45.509709425 (82h36m7.468806672s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.509731441 (82h36m7.468828695s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510157560 (82h36m7.469254805s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510514896 (82h36m7.469612152s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510648540 (82h36m7.469745785s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.511612159 (82h36m7.470709414s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512401852 (82h36m7.471499107s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512479869 (82h36m7.471577122s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.513021220 (82h36m7.472118468s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514000576 (82h36m7.473097832s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514032674 (82h36m7.473129956s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515062795 (82h36m7.474160043s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515525960 (82h36m7.474623215s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515817593 (82h36m7.474914843s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.516441434 (82h36m7.475538683s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517130867 (82h36m7.476228122s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517644081 (82h36m7.476741328s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.518124853 (82h36m7.477222103s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:46.102799767 (82h36m8.061897004s) [upload=86071]: Next returned nil segment
Aug 12 04:01:46.102818568 (82h36m8.061915817s) [upload=86071]: Waiting for error group managing segments...
Aug 12 04:01:46.250235405 (82h36m8.209332669s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264501501 (82h36m8.223598752s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264530334 (82h36m8.223627585s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.266378764 (82h36m8.225475997s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.270849349 (82h36m8.229946604s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.274507347 (82h36m8.233604599s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.277605145 (82h36m8.236702381s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.278223832 (82h36m8.237321083s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.281724439 (82h36m8.240821694s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.283898152 (82h36m8.242995403s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.285389849 (82h36m8.244487096s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.294916360 (82h36m8.2540136s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.310058801 (82h36m8.26915605s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313824733 (82h36m8.272921986s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313863449 (82h36m8.272960698s) [seg_pos={0 0}, upload=86071]: Segment reached optimal threshold of 14 pieces.
Aug 12 04:01:46.314169035 (82h36m8.273266285s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ld1wZ9sxQVpKNNvPFs9oyGhxCPips2YCbq5FiPFwfmuP7U2bY): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314256510 (82h36m8.273353772s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wawfBLsb6Ltuw8eJkD5ksdyiVGSfkpgdf752947b6uH3EvP49): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314313820 (82h36m8.273411054s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection
Aug 12 04:01:46.314423746 (82h36m8.273520992s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection
Aug 12 04:01:46.314469557 (82h36m8.273566809s) [seg_pos={0 0}, upload=86071]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 04:01:46.314579091 (82h36m8.273676342s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 04:01:46.314585208 (82h36m8.273682462s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 04:01:46.463952881 (82h36m8.423050127s) [upload=86071]: Done uploading segments...
Aug 12 04:01:46.463974938 (82h36m8.423072183s) [upload=86071]: Upload finished. err: <nil>
Duration: 2.626972433s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
859.370064ms
FAIL (2025-08-12 04:34:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 23a37bcf660173138aa48e37b953e7540e4ebbb82d1fd91cd4e9a1359ebaea58 != before 0b3a0fe2f47fd2acf257054a8b87a0368838d2abd1c3c966db2b0284383a3ce3 ======LOGS====== Aug 12 04:32:40.217998332 (83h7m2.177095589s) [upload=86631]: Starting upload Aug 12 04:32:40.218083453 (83h7m2.177180707s) [upload=86631]: Done starting upload Aug 12 04:32:40.218186162 (83h7m2.177283395s) [upload=86631]: Uploading segments... Aug 12 04:32:40.218241151 (83h7m2.177338411s) [upload=86631]: Got next segment. Inline: true Aug 12 04:32:40.218263885 (83h7m2.177361143s) [upload=86631]: Waiting for error group managing segments... Aug 12 04:32:40.218345817 (83h7m2.17744307s) [upload=86631]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 04:32:40.218355038 (83h7m2.177452294s) [upload=86631]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 04:32:40.218358905 (83h7m2.177456151s) [upload=86631]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 04:32:40.361629357 (83h7m2.320726603s) [upload=86631]: Done uploading segments... Aug 12 04:32:40.361653860 (83h7m2.320751107s) [upload=86631]: Upload finished. err: <nil>
Duration: 859.417666ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
2.298086695s
FAIL (2025-08-12 04:34:21 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b16e79e6792c3fb04b8a14731e255f5021232646d28cb4196aa31f9989a30bf2 != before b8b40385173213ad8d45a63c42247bea90ce75ae9eb6690c781f40993cdfea90
======LOGS======
Aug 12 04:01:45.307279589 (82h36m7.266376824s) [upload=86071]: Starting upload
Aug 12 04:01:45.307335524 (82h36m7.266432777s) [upload=86071]: Done starting upload
Aug 12 04:01:45.307590001 (82h36m7.266687236s) [upload=86071]: Uploading segments...
Aug 12 04:01:45.307891832 (82h36m7.266989077s) [upload=86071]: Got next segment. Inline: false
Aug 12 04:01:45.307968802 (82h36m7.267066047s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 04:01:45.307974771 (82h36m7.267072016s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 04:01:45.509630647 (82h36m7.468727893s) [seg_pos={0 0}, upload=86071]: Begin upload segment...
Aug 12 04:01:45.509684496 (82h36m7.468781747s) [seg_pos={0 0}, upload=86071]: Done begin upload segment.
Aug 12 04:01:45.509709425 (82h36m7.468806672s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.509731441 (82h36m7.468828695s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510157560 (82h36m7.469254805s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510514896 (82h36m7.469612152s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510648540 (82h36m7.469745785s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.511612159 (82h36m7.470709414s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512401852 (82h36m7.471499107s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512479869 (82h36m7.471577122s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.513021220 (82h36m7.472118468s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514000576 (82h36m7.473097832s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514032674 (82h36m7.473129956s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515062795 (82h36m7.474160043s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515525960 (82h36m7.474623215s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515817593 (82h36m7.474914843s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.516441434 (82h36m7.475538683s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517130867 (82h36m7.476228122s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517644081 (82h36m7.476741328s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.518124853 (82h36m7.477222103s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:46.102799767 (82h36m8.061897004s) [upload=86071]: Next returned nil segment
Aug 12 04:01:46.102818568 (82h36m8.061915817s) [upload=86071]: Waiting for error group managing segments...
Aug 12 04:01:46.250235405 (82h36m8.209332669s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264501501 (82h36m8.223598752s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264530334 (82h36m8.223627585s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.266378764 (82h36m8.225475997s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.270849349 (82h36m8.229946604s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.274507347 (82h36m8.233604599s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.277605145 (82h36m8.236702381s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.278223832 (82h36m8.237321083s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.281724439 (82h36m8.240821694s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.283898152 (82h36m8.242995403s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.285389849 (82h36m8.244487096s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.294916360 (82h36m8.2540136s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.310058801 (82h36m8.26915605s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313824733 (82h36m8.272921986s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313863449 (82h36m8.272960698s) [seg_pos={0 0}, upload=86071]: Segment reached optimal threshold of 14 pieces.
Aug 12 04:01:46.314169035 (82h36m8.273266285s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ld1wZ9sxQVpKNNvPFs9oyGhxCPips2YCbq5FiPFwfmuP7U2bY): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314256510 (82h36m8.273353772s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wawfBLsb6Ltuw8eJkD5ksdyiVGSfkpgdf752947b6uH3EvP49): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314313820 (82h36m8.273411054s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection
Aug 12 04:01:46.314423746 (82h36m8.273520992s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection
Aug 12 04:01:46.314469557 (82h36m8.273566809s) [seg_pos={0 0}, upload=86071]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 04:01:46.314579091 (82h36m8.273676342s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 04:01:46.314585208 (82h36m8.273682462s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 04:01:46.463952881 (82h36m8.423050127s) [upload=86071]: Done uploading segments...
Aug 12 04:01:46.463974938 (82h36m8.423072183s) [upload=86071]: Upload finished. err: <nil>
Duration: 2.298122058s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
863.919741ms
FAIL (2025-08-12 04:34:16 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 23a37bcf660173138aa48e37b953e7540e4ebbb82d1fd91cd4e9a1359ebaea58 != before 0b3a0fe2f47fd2acf257054a8b87a0368838d2abd1c3c966db2b0284383a3ce3 ======LOGS====== Aug 12 04:32:40.217998332 (83h7m2.177095589s) [upload=86631]: Starting upload Aug 12 04:32:40.218083453 (83h7m2.177180707s) [upload=86631]: Done starting upload Aug 12 04:32:40.218186162 (83h7m2.177283395s) [upload=86631]: Uploading segments... Aug 12 04:32:40.218241151 (83h7m2.177338411s) [upload=86631]: Got next segment. Inline: true Aug 12 04:32:40.218263885 (83h7m2.177361143s) [upload=86631]: Waiting for error group managing segments... Aug 12 04:32:40.218345817 (83h7m2.17744307s) [upload=86631]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 04:32:40.218355038 (83h7m2.177452294s) [upload=86631]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 04:32:40.218358905 (83h7m2.177456151s) [upload=86631]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 04:32:40.361629357 (83h7m2.320726603s) [upload=86631]: Done uploading segments... Aug 12 04:32:40.361653860 (83h7m2.320751107s) [upload=86631]: Upload finished. err: <nil>
Duration: 863.968288ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
2.293571217s
FAIL (2025-08-12 04:33:38 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b16e79e6792c3fb04b8a14731e255f5021232646d28cb4196aa31f9989a30bf2 != before b8b40385173213ad8d45a63c42247bea90ce75ae9eb6690c781f40993cdfea90
======LOGS======
Aug 12 04:01:45.307279589 (82h36m7.266376824s) [upload=86071]: Starting upload
Aug 12 04:01:45.307335524 (82h36m7.266432777s) [upload=86071]: Done starting upload
Aug 12 04:01:45.307590001 (82h36m7.266687236s) [upload=86071]: Uploading segments...
Aug 12 04:01:45.307891832 (82h36m7.266989077s) [upload=86071]: Got next segment. Inline: false
Aug 12 04:01:45.307968802 (82h36m7.267066047s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 04:01:45.307974771 (82h36m7.267072016s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 04:01:45.509630647 (82h36m7.468727893s) [seg_pos={0 0}, upload=86071]: Begin upload segment...
Aug 12 04:01:45.509684496 (82h36m7.468781747s) [seg_pos={0 0}, upload=86071]: Done begin upload segment.
Aug 12 04:01:45.509709425 (82h36m7.468806672s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.509731441 (82h36m7.468828695s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510157560 (82h36m7.469254805s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510514896 (82h36m7.469612152s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510648540 (82h36m7.469745785s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.511612159 (82h36m7.470709414s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512401852 (82h36m7.471499107s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512479869 (82h36m7.471577122s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.513021220 (82h36m7.472118468s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514000576 (82h36m7.473097832s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514032674 (82h36m7.473129956s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515062795 (82h36m7.474160043s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515525960 (82h36m7.474623215s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515817593 (82h36m7.474914843s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.516441434 (82h36m7.475538683s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517130867 (82h36m7.476228122s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517644081 (82h36m7.476741328s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.518124853 (82h36m7.477222103s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:46.102799767 (82h36m8.061897004s) [upload=86071]: Next returned nil segment
Aug 12 04:01:46.102818568 (82h36m8.061915817s) [upload=86071]: Waiting for error group managing segments...
Aug 12 04:01:46.250235405 (82h36m8.209332669s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264501501 (82h36m8.223598752s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264530334 (82h36m8.223627585s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.266378764 (82h36m8.225475997s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.270849349 (82h36m8.229946604s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.274507347 (82h36m8.233604599s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.277605145 (82h36m8.236702381s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.278223832 (82h36m8.237321083s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.281724439 (82h36m8.240821694s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.283898152 (82h36m8.242995403s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.285389849 (82h36m8.244487096s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.294916360 (82h36m8.2540136s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.310058801 (82h36m8.26915605s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313824733 (82h36m8.272921986s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313863449 (82h36m8.272960698s) [seg_pos={0 0}, upload=86071]: Segment reached optimal threshold of 14 pieces.
Aug 12 04:01:46.314169035 (82h36m8.273266285s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ld1wZ9sxQVpKNNvPFs9oyGhxCPips2YCbq5FiPFwfmuP7U2bY): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314256510 (82h36m8.273353772s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wawfBLsb6Ltuw8eJkD5ksdyiVGSfkpgdf752947b6uH3EvP49): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314313820 (82h36m8.273411054s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection
Aug 12 04:01:46.314423746 (82h36m8.273520992s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection
Aug 12 04:01:46.314469557 (82h36m8.273566809s) [seg_pos={0 0}, upload=86071]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 04:01:46.314579091 (82h36m8.273676342s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 04:01:46.314585208 (82h36m8.273682462s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 04:01:46.463952881 (82h36m8.423050127s) [upload=86071]: Done uploading segments...
Aug 12 04:01:46.463974938 (82h36m8.423072183s) [upload=86071]: Upload finished. err: <nil>
Duration: 2.29359441s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
1.018642356s
FAIL (2025-08-12 04:33:30 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 23a37bcf660173138aa48e37b953e7540e4ebbb82d1fd91cd4e9a1359ebaea58 != before 0b3a0fe2f47fd2acf257054a8b87a0368838d2abd1c3c966db2b0284383a3ce3 ======LOGS====== Aug 12 04:32:40.217998332 (83h7m2.177095589s) [upload=86631]: Starting upload Aug 12 04:32:40.218083453 (83h7m2.177180707s) [upload=86631]: Done starting upload Aug 12 04:32:40.218186162 (83h7m2.177283395s) [upload=86631]: Uploading segments... Aug 12 04:32:40.218241151 (83h7m2.177338411s) [upload=86631]: Got next segment. Inline: true Aug 12 04:32:40.218263885 (83h7m2.177361143s) [upload=86631]: Waiting for error group managing segments... Aug 12 04:32:40.218345817 (83h7m2.17744307s) [upload=86631]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 04:32:40.218355038 (83h7m2.177452294s) [upload=86631]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 04:32:40.218358905 (83h7m2.177456151s) [upload=86631]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 04:32:40.361629357 (83h7m2.320726603s) [upload=86631]: Done uploading segments... Aug 12 04:32:40.361653860 (83h7m2.320751107s) [upload=86631]: Upload finished. err: <nil>
Duration: 1.018671318s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
2.408572634s
FAIL (2025-08-12 04:32:59 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b16e79e6792c3fb04b8a14731e255f5021232646d28cb4196aa31f9989a30bf2 != before b8b40385173213ad8d45a63c42247bea90ce75ae9eb6690c781f40993cdfea90
======LOGS======
Aug 12 04:01:45.307279589 (82h36m7.266376824s) [upload=86071]: Starting upload
Aug 12 04:01:45.307335524 (82h36m7.266432777s) [upload=86071]: Done starting upload
Aug 12 04:01:45.307590001 (82h36m7.266687236s) [upload=86071]: Uploading segments...
Aug 12 04:01:45.307891832 (82h36m7.266989077s) [upload=86071]: Got next segment. Inline: false
Aug 12 04:01:45.307968802 (82h36m7.267066047s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 04:01:45.307974771 (82h36m7.267072016s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 04:01:45.509630647 (82h36m7.468727893s) [seg_pos={0 0}, upload=86071]: Begin upload segment...
Aug 12 04:01:45.509684496 (82h36m7.468781747s) [seg_pos={0 0}, upload=86071]: Done begin upload segment.
Aug 12 04:01:45.509709425 (82h36m7.468806672s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.509731441 (82h36m7.468828695s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510157560 (82h36m7.469254805s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510514896 (82h36m7.469612152s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510648540 (82h36m7.469745785s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.511612159 (82h36m7.470709414s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512401852 (82h36m7.471499107s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512479869 (82h36m7.471577122s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.513021220 (82h36m7.472118468s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514000576 (82h36m7.473097832s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514032674 (82h36m7.473129956s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515062795 (82h36m7.474160043s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515525960 (82h36m7.474623215s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515817593 (82h36m7.474914843s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.516441434 (82h36m7.475538683s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517130867 (82h36m7.476228122s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517644081 (82h36m7.476741328s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.518124853 (82h36m7.477222103s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:46.102799767 (82h36m8.061897004s) [upload=86071]: Next returned nil segment
Aug 12 04:01:46.102818568 (82h36m8.061915817s) [upload=86071]: Waiting for error group managing segments...
Aug 12 04:01:46.250235405 (82h36m8.209332669s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264501501 (82h36m8.223598752s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264530334 (82h36m8.223627585s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.266378764 (82h36m8.225475997s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.270849349 (82h36m8.229946604s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.274507347 (82h36m8.233604599s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.277605145 (82h36m8.236702381s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.278223832 (82h36m8.237321083s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.281724439 (82h36m8.240821694s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.283898152 (82h36m8.242995403s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.285389849 (82h36m8.244487096s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.294916360 (82h36m8.2540136s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.310058801 (82h36m8.26915605s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313824733 (82h36m8.272921986s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313863449 (82h36m8.272960698s) [seg_pos={0 0}, upload=86071]: Segment reached optimal threshold of 14 pieces.
Aug 12 04:01:46.314169035 (82h36m8.273266285s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ld1wZ9sxQVpKNNvPFs9oyGhxCPips2YCbq5FiPFwfmuP7U2bY): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314256510 (82h36m8.273353772s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wawfBLsb6Ltuw8eJkD5ksdyiVGSfkpgdf752947b6uH3EvP49): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314313820 (82h36m8.273411054s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection
Aug 12 04:01:46.314423746 (82h36m8.273520992s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection
Aug 12 04:01:46.314469557 (82h36m8.273566809s) [seg_pos={0 0}, upload=86071]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 04:01:46.314579091 (82h36m8.273676342s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 04:01:46.314585208 (82h36m8.273682462s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 04:01:46.463952881 (82h36m8.423050127s) [upload=86071]: Done uploading segments...
Aug 12 04:01:46.463974938 (82h36m8.423072183s) [upload=86071]: Upload finished. err: <nil>
Duration: 2.408607803s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
735.395128ms
FAIL (2025-08-12 04:32:40 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 23a37bcf660173138aa48e37b953e7540e4ebbb82d1fd91cd4e9a1359ebaea58 != before 0b3a0fe2f47fd2acf257054a8b87a0368838d2abd1c3c966db2b0284383a3ce3 ======LOGS====== Aug 12 04:32:40.217998332 (83h7m2.177095589s) [upload=86631]: Starting upload Aug 12 04:32:40.218083453 (83h7m2.177180707s) [upload=86631]: Done starting upload Aug 12 04:32:40.218186162 (83h7m2.177283395s) [upload=86631]: Uploading segments... Aug 12 04:32:40.218241151 (83h7m2.177338411s) [upload=86631]: Got next segment. Inline: true Aug 12 04:32:40.218263885 (83h7m2.177361143s) [upload=86631]: Waiting for error group managing segments... Aug 12 04:32:40.218345817 (83h7m2.17744307s) [upload=86631]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 04:32:40.218355038 (83h7m2.177452294s) [upload=86631]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 04:32:40.218358905 (83h7m2.177456151s) [upload=86631]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 04:32:40.361629357 (83h7m2.320726603s) [upload=86631]: Done uploading segments... Aug 12 04:32:40.361653860 (83h7m2.320751107s) [upload=86631]: Upload finished. err: <nil>
Duration: 735.431155ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
2.359696436s
FAIL (2025-08-12 04:32:02 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b16e79e6792c3fb04b8a14731e255f5021232646d28cb4196aa31f9989a30bf2 != before b8b40385173213ad8d45a63c42247bea90ce75ae9eb6690c781f40993cdfea90
======LOGS======
Aug 12 04:01:45.307279589 (82h36m7.266376824s) [upload=86071]: Starting upload
Aug 12 04:01:45.307335524 (82h36m7.266432777s) [upload=86071]: Done starting upload
Aug 12 04:01:45.307590001 (82h36m7.266687236s) [upload=86071]: Uploading segments...
Aug 12 04:01:45.307891832 (82h36m7.266989077s) [upload=86071]: Got next segment. Inline: false
Aug 12 04:01:45.307968802 (82h36m7.267066047s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 04:01:45.307974771 (82h36m7.267072016s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 04:01:45.509630647 (82h36m7.468727893s) [seg_pos={0 0}, upload=86071]: Begin upload segment...
Aug 12 04:01:45.509684496 (82h36m7.468781747s) [seg_pos={0 0}, upload=86071]: Done begin upload segment.
Aug 12 04:01:45.509709425 (82h36m7.468806672s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.509731441 (82h36m7.468828695s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510157560 (82h36m7.469254805s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510514896 (82h36m7.469612152s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510648540 (82h36m7.469745785s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.511612159 (82h36m7.470709414s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512401852 (82h36m7.471499107s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512479869 (82h36m7.471577122s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.513021220 (82h36m7.472118468s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514000576 (82h36m7.473097832s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514032674 (82h36m7.473129956s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515062795 (82h36m7.474160043s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515525960 (82h36m7.474623215s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515817593 (82h36m7.474914843s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.516441434 (82h36m7.475538683s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517130867 (82h36m7.476228122s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517644081 (82h36m7.476741328s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.518124853 (82h36m7.477222103s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:46.102799767 (82h36m8.061897004s) [upload=86071]: Next returned nil segment
Aug 12 04:01:46.102818568 (82h36m8.061915817s) [upload=86071]: Waiting for error group managing segments...
Aug 12 04:01:46.250235405 (82h36m8.209332669s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264501501 (82h36m8.223598752s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264530334 (82h36m8.223627585s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.266378764 (82h36m8.225475997s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.270849349 (82h36m8.229946604s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.274507347 (82h36m8.233604599s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.277605145 (82h36m8.236702381s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.278223832 (82h36m8.237321083s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.281724439 (82h36m8.240821694s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.283898152 (82h36m8.242995403s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.285389849 (82h36m8.244487096s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.294916360 (82h36m8.2540136s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.310058801 (82h36m8.26915605s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313824733 (82h36m8.272921986s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313863449 (82h36m8.272960698s) [seg_pos={0 0}, upload=86071]: Segment reached optimal threshold of 14 pieces.
Aug 12 04:01:46.314169035 (82h36m8.273266285s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ld1wZ9sxQVpKNNvPFs9oyGhxCPips2YCbq5FiPFwfmuP7U2bY): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314256510 (82h36m8.273353772s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wawfBLsb6Ltuw8eJkD5ksdyiVGSfkpgdf752947b6uH3EvP49): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314313820 (82h36m8.273411054s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection
Aug 12 04:01:46.314423746 (82h36m8.273520992s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection
Aug 12 04:01:46.314469557 (82h36m8.273566809s) [seg_pos={0 0}, upload=86071]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 04:01:46.314579091 (82h36m8.273676342s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 04:01:46.314585208 (82h36m8.273682462s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 04:01:46.463952881 (82h36m8.423050127s) [upload=86071]: Done uploading segments...
Aug 12 04:01:46.463974938 (82h36m8.423072183s) [upload=86071]: Upload finished. err: <nil>
Duration: 2.359732358s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
2.452520844s
FAIL (2025-08-12 04:31:37 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b16e79e6792c3fb04b8a14731e255f5021232646d28cb4196aa31f9989a30bf2 != before b8b40385173213ad8d45a63c42247bea90ce75ae9eb6690c781f40993cdfea90
======LOGS======
Aug 12 04:01:45.307279589 (82h36m7.266376824s) [upload=86071]: Starting upload
Aug 12 04:01:45.307335524 (82h36m7.266432777s) [upload=86071]: Done starting upload
Aug 12 04:01:45.307590001 (82h36m7.266687236s) [upload=86071]: Uploading segments...
Aug 12 04:01:45.307891832 (82h36m7.266989077s) [upload=86071]: Got next segment. Inline: false
Aug 12 04:01:45.307968802 (82h36m7.267066047s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 04:01:45.307974771 (82h36m7.267072016s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 04:01:45.509630647 (82h36m7.468727893s) [seg_pos={0 0}, upload=86071]: Begin upload segment...
Aug 12 04:01:45.509684496 (82h36m7.468781747s) [seg_pos={0 0}, upload=86071]: Done begin upload segment.
Aug 12 04:01:45.509709425 (82h36m7.468806672s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.509731441 (82h36m7.468828695s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510157560 (82h36m7.469254805s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510514896 (82h36m7.469612152s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510648540 (82h36m7.469745785s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.511612159 (82h36m7.470709414s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512401852 (82h36m7.471499107s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512479869 (82h36m7.471577122s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.513021220 (82h36m7.472118468s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514000576 (82h36m7.473097832s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514032674 (82h36m7.473129956s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515062795 (82h36m7.474160043s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515525960 (82h36m7.474623215s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515817593 (82h36m7.474914843s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.516441434 (82h36m7.475538683s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517130867 (82h36m7.476228122s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517644081 (82h36m7.476741328s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.518124853 (82h36m7.477222103s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:46.102799767 (82h36m8.061897004s) [upload=86071]: Next returned nil segment
Aug 12 04:01:46.102818568 (82h36m8.061915817s) [upload=86071]: Waiting for error group managing segments...
Aug 12 04:01:46.250235405 (82h36m8.209332669s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264501501 (82h36m8.223598752s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264530334 (82h36m8.223627585s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.266378764 (82h36m8.225475997s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.270849349 (82h36m8.229946604s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.274507347 (82h36m8.233604599s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.277605145 (82h36m8.236702381s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.278223832 (82h36m8.237321083s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.281724439 (82h36m8.240821694s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.283898152 (82h36m8.242995403s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.285389849 (82h36m8.244487096s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.294916360 (82h36m8.2540136s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.310058801 (82h36m8.26915605s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313824733 (82h36m8.272921986s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313863449 (82h36m8.272960698s) [seg_pos={0 0}, upload=86071]: Segment reached optimal threshold of 14 pieces.
Aug 12 04:01:46.314169035 (82h36m8.273266285s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ld1wZ9sxQVpKNNvPFs9oyGhxCPips2YCbq5FiPFwfmuP7U2bY): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314256510 (82h36m8.273353772s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wawfBLsb6Ltuw8eJkD5ksdyiVGSfkpgdf752947b6uH3EvP49): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314313820 (82h36m8.273411054s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection
Aug 12 04:01:46.314423746 (82h36m8.273520992s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection
Aug 12 04:01:46.314469557 (82h36m8.273566809s) [seg_pos={0 0}, upload=86071]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 04:01:46.314579091 (82h36m8.273676342s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 04:01:46.314585208 (82h36m8.273682462s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 04:01:46.463952881 (82h36m8.423050127s) [upload=86071]: Done uploading segments...
Aug 12 04:01:46.463974938 (82h36m8.423072183s) [upload=86071]: Upload finished. err: <nil>
Duration: 2.452571137s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
2.433027536s
FAIL (2025-08-12 04:31:03 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b16e79e6792c3fb04b8a14731e255f5021232646d28cb4196aa31f9989a30bf2 != before b8b40385173213ad8d45a63c42247bea90ce75ae9eb6690c781f40993cdfea90
======LOGS======
Aug 12 04:01:45.307279589 (82h36m7.266376824s) [upload=86071]: Starting upload
Aug 12 04:01:45.307335524 (82h36m7.266432777s) [upload=86071]: Done starting upload
Aug 12 04:01:45.307590001 (82h36m7.266687236s) [upload=86071]: Uploading segments...
Aug 12 04:01:45.307891832 (82h36m7.266989077s) [upload=86071]: Got next segment. Inline: false
Aug 12 04:01:45.307968802 (82h36m7.267066047s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 04:01:45.307974771 (82h36m7.267072016s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 04:01:45.509630647 (82h36m7.468727893s) [seg_pos={0 0}, upload=86071]: Begin upload segment...
Aug 12 04:01:45.509684496 (82h36m7.468781747s) [seg_pos={0 0}, upload=86071]: Done begin upload segment.
Aug 12 04:01:45.509709425 (82h36m7.468806672s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.509731441 (82h36m7.468828695s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510157560 (82h36m7.469254805s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510514896 (82h36m7.469612152s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510648540 (82h36m7.469745785s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.511612159 (82h36m7.470709414s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512401852 (82h36m7.471499107s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512479869 (82h36m7.471577122s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.513021220 (82h36m7.472118468s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514000576 (82h36m7.473097832s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514032674 (82h36m7.473129956s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515062795 (82h36m7.474160043s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515525960 (82h36m7.474623215s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515817593 (82h36m7.474914843s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.516441434 (82h36m7.475538683s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517130867 (82h36m7.476228122s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517644081 (82h36m7.476741328s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.518124853 (82h36m7.477222103s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:46.102799767 (82h36m8.061897004s) [upload=86071]: Next returned nil segment
Aug 12 04:01:46.102818568 (82h36m8.061915817s) [upload=86071]: Waiting for error group managing segments...
Aug 12 04:01:46.250235405 (82h36m8.209332669s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264501501 (82h36m8.223598752s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264530334 (82h36m8.223627585s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.266378764 (82h36m8.225475997s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.270849349 (82h36m8.229946604s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.274507347 (82h36m8.233604599s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.277605145 (82h36m8.236702381s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.278223832 (82h36m8.237321083s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.281724439 (82h36m8.240821694s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.283898152 (82h36m8.242995403s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.285389849 (82h36m8.244487096s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.294916360 (82h36m8.2540136s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.310058801 (82h36m8.26915605s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313824733 (82h36m8.272921986s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313863449 (82h36m8.272960698s) [seg_pos={0 0}, upload=86071]: Segment reached optimal threshold of 14 pieces.
Aug 12 04:01:46.314169035 (82h36m8.273266285s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ld1wZ9sxQVpKNNvPFs9oyGhxCPips2YCbq5FiPFwfmuP7U2bY): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314256510 (82h36m8.273353772s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wawfBLsb6Ltuw8eJkD5ksdyiVGSfkpgdf752947b6uH3EvP49): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314313820 (82h36m8.273411054s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection
Aug 12 04:01:46.314423746 (82h36m8.273520992s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection
Aug 12 04:01:46.314469557 (82h36m8.273566809s) [seg_pos={0 0}, upload=86071]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 04:01:46.314579091 (82h36m8.273676342s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 04:01:46.314585208 (82h36m8.273682462s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 04:01:46.463952881 (82h36m8.423050127s) [upload=86071]: Done uploading segments...
Aug 12 04:01:46.463974938 (82h36m8.423072183s) [upload=86071]: Upload finished. err: <nil>
Duration: 2.433082874s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
2.372019251s
FAIL (2025-08-12 04:30:21 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b16e79e6792c3fb04b8a14731e255f5021232646d28cb4196aa31f9989a30bf2 != before b8b40385173213ad8d45a63c42247bea90ce75ae9eb6690c781f40993cdfea90
======LOGS======
Aug 12 04:01:45.307279589 (82h36m7.266376824s) [upload=86071]: Starting upload
Aug 12 04:01:45.307335524 (82h36m7.266432777s) [upload=86071]: Done starting upload
Aug 12 04:01:45.307590001 (82h36m7.266687236s) [upload=86071]: Uploading segments...
Aug 12 04:01:45.307891832 (82h36m7.266989077s) [upload=86071]: Got next segment. Inline: false
Aug 12 04:01:45.307968802 (82h36m7.267066047s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 04:01:45.307974771 (82h36m7.267072016s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 04:01:45.509630647 (82h36m7.468727893s) [seg_pos={0 0}, upload=86071]: Begin upload segment...
Aug 12 04:01:45.509684496 (82h36m7.468781747s) [seg_pos={0 0}, upload=86071]: Done begin upload segment.
Aug 12 04:01:45.509709425 (82h36m7.468806672s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.509731441 (82h36m7.468828695s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510157560 (82h36m7.469254805s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510514896 (82h36m7.469612152s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510648540 (82h36m7.469745785s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.511612159 (82h36m7.470709414s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512401852 (82h36m7.471499107s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512479869 (82h36m7.471577122s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.513021220 (82h36m7.472118468s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514000576 (82h36m7.473097832s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514032674 (82h36m7.473129956s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515062795 (82h36m7.474160043s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515525960 (82h36m7.474623215s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515817593 (82h36m7.474914843s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.516441434 (82h36m7.475538683s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517130867 (82h36m7.476228122s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517644081 (82h36m7.476741328s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.518124853 (82h36m7.477222103s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:46.102799767 (82h36m8.061897004s) [upload=86071]: Next returned nil segment
Aug 12 04:01:46.102818568 (82h36m8.061915817s) [upload=86071]: Waiting for error group managing segments...
Aug 12 04:01:46.250235405 (82h36m8.209332669s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264501501 (82h36m8.223598752s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264530334 (82h36m8.223627585s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.266378764 (82h36m8.225475997s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.270849349 (82h36m8.229946604s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.274507347 (82h36m8.233604599s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.277605145 (82h36m8.236702381s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.278223832 (82h36m8.237321083s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.281724439 (82h36m8.240821694s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.283898152 (82h36m8.242995403s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.285389849 (82h36m8.244487096s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.294916360 (82h36m8.2540136s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.310058801 (82h36m8.26915605s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313824733 (82h36m8.272921986s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313863449 (82h36m8.272960698s) [seg_pos={0 0}, upload=86071]: Segment reached optimal threshold of 14 pieces.
Aug 12 04:01:46.314169035 (82h36m8.273266285s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ld1wZ9sxQVpKNNvPFs9oyGhxCPips2YCbq5FiPFwfmuP7U2bY): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314256510 (82h36m8.273353772s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wawfBLsb6Ltuw8eJkD5ksdyiVGSfkpgdf752947b6uH3EvP49): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314313820 (82h36m8.273411054s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection
Aug 12 04:01:46.314423746 (82h36m8.273520992s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection
Aug 12 04:01:46.314469557 (82h36m8.273566809s) [seg_pos={0 0}, upload=86071]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 04:01:46.314579091 (82h36m8.273676342s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 04:01:46.314585208 (82h36m8.273682462s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 04:01:46.463952881 (82h36m8.423050127s) [upload=86071]: Done uploading segments...
Aug 12 04:01:46.463974938 (82h36m8.423072183s) [upload=86071]: Upload finished. err: <nil>
Duration: 2.372055225s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
2.726666941s
FAIL (2025-08-12 04:29:25 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b16e79e6792c3fb04b8a14731e255f5021232646d28cb4196aa31f9989a30bf2 != before b8b40385173213ad8d45a63c42247bea90ce75ae9eb6690c781f40993cdfea90
======LOGS======
Aug 12 04:01:45.307279589 (82h36m7.266376824s) [upload=86071]: Starting upload
Aug 12 04:01:45.307335524 (82h36m7.266432777s) [upload=86071]: Done starting upload
Aug 12 04:01:45.307590001 (82h36m7.266687236s) [upload=86071]: Uploading segments...
Aug 12 04:01:45.307891832 (82h36m7.266989077s) [upload=86071]: Got next segment. Inline: false
Aug 12 04:01:45.307968802 (82h36m7.267066047s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 04:01:45.307974771 (82h36m7.267072016s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 04:01:45.509630647 (82h36m7.468727893s) [seg_pos={0 0}, upload=86071]: Begin upload segment...
Aug 12 04:01:45.509684496 (82h36m7.468781747s) [seg_pos={0 0}, upload=86071]: Done begin upload segment.
Aug 12 04:01:45.509709425 (82h36m7.468806672s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.509731441 (82h36m7.468828695s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510157560 (82h36m7.469254805s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510514896 (82h36m7.469612152s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510648540 (82h36m7.469745785s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.511612159 (82h36m7.470709414s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512401852 (82h36m7.471499107s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512479869 (82h36m7.471577122s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.513021220 (82h36m7.472118468s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514000576 (82h36m7.473097832s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514032674 (82h36m7.473129956s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515062795 (82h36m7.474160043s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515525960 (82h36m7.474623215s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515817593 (82h36m7.474914843s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.516441434 (82h36m7.475538683s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517130867 (82h36m7.476228122s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517644081 (82h36m7.476741328s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.518124853 (82h36m7.477222103s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:46.102799767 (82h36m8.061897004s) [upload=86071]: Next returned nil segment
Aug 12 04:01:46.102818568 (82h36m8.061915817s) [upload=86071]: Waiting for error group managing segments...
Aug 12 04:01:46.250235405 (82h36m8.209332669s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264501501 (82h36m8.223598752s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264530334 (82h36m8.223627585s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.266378764 (82h36m8.225475997s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.270849349 (82h36m8.229946604s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.274507347 (82h36m8.233604599s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.277605145 (82h36m8.236702381s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.278223832 (82h36m8.237321083s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.281724439 (82h36m8.240821694s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.283898152 (82h36m8.242995403s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.285389849 (82h36m8.244487096s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.294916360 (82h36m8.2540136s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.310058801 (82h36m8.26915605s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313824733 (82h36m8.272921986s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313863449 (82h36m8.272960698s) [seg_pos={0 0}, upload=86071]: Segment reached optimal threshold of 14 pieces.
Aug 12 04:01:46.314169035 (82h36m8.273266285s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ld1wZ9sxQVpKNNvPFs9oyGhxCPips2YCbq5FiPFwfmuP7U2bY): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314256510 (82h36m8.273353772s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wawfBLsb6Ltuw8eJkD5ksdyiVGSfkpgdf752947b6uH3EvP49): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314313820 (82h36m8.273411054s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection
Aug 12 04:01:46.314423746 (82h36m8.273520992s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection
Aug 12 04:01:46.314469557 (82h36m8.273566809s) [seg_pos={0 0}, upload=86071]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 04:01:46.314579091 (82h36m8.273676342s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 04:01:46.314585208 (82h36m8.273682462s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 04:01:46.463952881 (82h36m8.423050127s) [upload=86071]: Done uploading segments...
Aug 12 04:01:46.463974938 (82h36m8.423072183s) [upload=86071]: Upload finished. err: <nil>
Duration: 2.726700058s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
2.470434994s
FAIL (2025-08-12 04:29:03 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b16e79e6792c3fb04b8a14731e255f5021232646d28cb4196aa31f9989a30bf2 != before b8b40385173213ad8d45a63c42247bea90ce75ae9eb6690c781f40993cdfea90
======LOGS======
Aug 12 04:01:45.307279589 (82h36m7.266376824s) [upload=86071]: Starting upload
Aug 12 04:01:45.307335524 (82h36m7.266432777s) [upload=86071]: Done starting upload
Aug 12 04:01:45.307590001 (82h36m7.266687236s) [upload=86071]: Uploading segments...
Aug 12 04:01:45.307891832 (82h36m7.266989077s) [upload=86071]: Got next segment. Inline: false
Aug 12 04:01:45.307968802 (82h36m7.267066047s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 04:01:45.307974771 (82h36m7.267072016s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 04:01:45.509630647 (82h36m7.468727893s) [seg_pos={0 0}, upload=86071]: Begin upload segment...
Aug 12 04:01:45.509684496 (82h36m7.468781747s) [seg_pos={0 0}, upload=86071]: Done begin upload segment.
Aug 12 04:01:45.509709425 (82h36m7.468806672s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.509731441 (82h36m7.468828695s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510157560 (82h36m7.469254805s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510514896 (82h36m7.469612152s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510648540 (82h36m7.469745785s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.511612159 (82h36m7.470709414s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512401852 (82h36m7.471499107s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512479869 (82h36m7.471577122s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.513021220 (82h36m7.472118468s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514000576 (82h36m7.473097832s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514032674 (82h36m7.473129956s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515062795 (82h36m7.474160043s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515525960 (82h36m7.474623215s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515817593 (82h36m7.474914843s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.516441434 (82h36m7.475538683s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517130867 (82h36m7.476228122s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517644081 (82h36m7.476741328s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.518124853 (82h36m7.477222103s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:46.102799767 (82h36m8.061897004s) [upload=86071]: Next returned nil segment
Aug 12 04:01:46.102818568 (82h36m8.061915817s) [upload=86071]: Waiting for error group managing segments...
Aug 12 04:01:46.250235405 (82h36m8.209332669s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264501501 (82h36m8.223598752s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264530334 (82h36m8.223627585s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.266378764 (82h36m8.225475997s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.270849349 (82h36m8.229946604s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.274507347 (82h36m8.233604599s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.277605145 (82h36m8.236702381s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.278223832 (82h36m8.237321083s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.281724439 (82h36m8.240821694s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.283898152 (82h36m8.242995403s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.285389849 (82h36m8.244487096s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.294916360 (82h36m8.2540136s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.310058801 (82h36m8.26915605s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313824733 (82h36m8.272921986s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313863449 (82h36m8.272960698s) [seg_pos={0 0}, upload=86071]: Segment reached optimal threshold of 14 pieces.
Aug 12 04:01:46.314169035 (82h36m8.273266285s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ld1wZ9sxQVpKNNvPFs9oyGhxCPips2YCbq5FiPFwfmuP7U2bY): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314256510 (82h36m8.273353772s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wawfBLsb6Ltuw8eJkD5ksdyiVGSfkpgdf752947b6uH3EvP49): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314313820 (82h36m8.273411054s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection
Aug 12 04:01:46.314423746 (82h36m8.273520992s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection
Aug 12 04:01:46.314469557 (82h36m8.273566809s) [seg_pos={0 0}, upload=86071]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 04:01:46.314579091 (82h36m8.273676342s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 04:01:46.314585208 (82h36m8.273682462s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 04:01:46.463952881 (82h36m8.423050127s) [upload=86071]: Done uploading segments...
Aug 12 04:01:46.463974938 (82h36m8.423072183s) [upload=86071]: Upload finished. err: <nil>
Duration: 2.47046882s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
3.005474404s
FAIL (2025-08-12 04:28:40 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b16e79e6792c3fb04b8a14731e255f5021232646d28cb4196aa31f9989a30bf2 != before b8b40385173213ad8d45a63c42247bea90ce75ae9eb6690c781f40993cdfea90
======LOGS======
Aug 12 04:01:45.307279589 (82h36m7.266376824s) [upload=86071]: Starting upload
Aug 12 04:01:45.307335524 (82h36m7.266432777s) [upload=86071]: Done starting upload
Aug 12 04:01:45.307590001 (82h36m7.266687236s) [upload=86071]: Uploading segments...
Aug 12 04:01:45.307891832 (82h36m7.266989077s) [upload=86071]: Got next segment. Inline: false
Aug 12 04:01:45.307968802 (82h36m7.267066047s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 04:01:45.307974771 (82h36m7.267072016s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 04:01:45.509630647 (82h36m7.468727893s) [seg_pos={0 0}, upload=86071]: Begin upload segment...
Aug 12 04:01:45.509684496 (82h36m7.468781747s) [seg_pos={0 0}, upload=86071]: Done begin upload segment.
Aug 12 04:01:45.509709425 (82h36m7.468806672s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.509731441 (82h36m7.468828695s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510157560 (82h36m7.469254805s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510514896 (82h36m7.469612152s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510648540 (82h36m7.469745785s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.511612159 (82h36m7.470709414s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512401852 (82h36m7.471499107s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512479869 (82h36m7.471577122s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.513021220 (82h36m7.472118468s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514000576 (82h36m7.473097832s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514032674 (82h36m7.473129956s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515062795 (82h36m7.474160043s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515525960 (82h36m7.474623215s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515817593 (82h36m7.474914843s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.516441434 (82h36m7.475538683s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517130867 (82h36m7.476228122s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517644081 (82h36m7.476741328s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.518124853 (82h36m7.477222103s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:46.102799767 (82h36m8.061897004s) [upload=86071]: Next returned nil segment
Aug 12 04:01:46.102818568 (82h36m8.061915817s) [upload=86071]: Waiting for error group managing segments...
Aug 12 04:01:46.250235405 (82h36m8.209332669s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264501501 (82h36m8.223598752s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264530334 (82h36m8.223627585s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.266378764 (82h36m8.225475997s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.270849349 (82h36m8.229946604s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.274507347 (82h36m8.233604599s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.277605145 (82h36m8.236702381s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.278223832 (82h36m8.237321083s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.281724439 (82h36m8.240821694s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.283898152 (82h36m8.242995403s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.285389849 (82h36m8.244487096s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.294916360 (82h36m8.2540136s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.310058801 (82h36m8.26915605s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313824733 (82h36m8.272921986s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313863449 (82h36m8.272960698s) [seg_pos={0 0}, upload=86071]: Segment reached optimal threshold of 14 pieces.
Aug 12 04:01:46.314169035 (82h36m8.273266285s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ld1wZ9sxQVpKNNvPFs9oyGhxCPips2YCbq5FiPFwfmuP7U2bY): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314256510 (82h36m8.273353772s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wawfBLsb6Ltuw8eJkD5ksdyiVGSfkpgdf752947b6uH3EvP49): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314313820 (82h36m8.273411054s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection
Aug 12 04:01:46.314423746 (82h36m8.273520992s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection
Aug 12 04:01:46.314469557 (82h36m8.273566809s) [seg_pos={0 0}, upload=86071]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 04:01:46.314579091 (82h36m8.273676342s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 04:01:46.314585208 (82h36m8.273682462s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 04:01:46.463952881 (82h36m8.423050127s) [upload=86071]: Done uploading segments...
Aug 12 04:01:46.463974938 (82h36m8.423072183s) [upload=86071]: Upload finished. err: <nil>
Duration: 3.005504198s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
2.61005162s
FAIL (2025-08-12 04:27:34 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b16e79e6792c3fb04b8a14731e255f5021232646d28cb4196aa31f9989a30bf2 != before b8b40385173213ad8d45a63c42247bea90ce75ae9eb6690c781f40993cdfea90
======LOGS======
Aug 12 04:01:45.307279589 (82h36m7.266376824s) [upload=86071]: Starting upload
Aug 12 04:01:45.307335524 (82h36m7.266432777s) [upload=86071]: Done starting upload
Aug 12 04:01:45.307590001 (82h36m7.266687236s) [upload=86071]: Uploading segments...
Aug 12 04:01:45.307891832 (82h36m7.266989077s) [upload=86071]: Got next segment. Inline: false
Aug 12 04:01:45.307968802 (82h36m7.267066047s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 04:01:45.307974771 (82h36m7.267072016s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 04:01:45.509630647 (82h36m7.468727893s) [seg_pos={0 0}, upload=86071]: Begin upload segment...
Aug 12 04:01:45.509684496 (82h36m7.468781747s) [seg_pos={0 0}, upload=86071]: Done begin upload segment.
Aug 12 04:01:45.509709425 (82h36m7.468806672s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.509731441 (82h36m7.468828695s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510157560 (82h36m7.469254805s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510514896 (82h36m7.469612152s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510648540 (82h36m7.469745785s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.511612159 (82h36m7.470709414s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512401852 (82h36m7.471499107s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512479869 (82h36m7.471577122s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.513021220 (82h36m7.472118468s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514000576 (82h36m7.473097832s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514032674 (82h36m7.473129956s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515062795 (82h36m7.474160043s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515525960 (82h36m7.474623215s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515817593 (82h36m7.474914843s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.516441434 (82h36m7.475538683s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517130867 (82h36m7.476228122s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517644081 (82h36m7.476741328s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.518124853 (82h36m7.477222103s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:46.102799767 (82h36m8.061897004s) [upload=86071]: Next returned nil segment
Aug 12 04:01:46.102818568 (82h36m8.061915817s) [upload=86071]: Waiting for error group managing segments...
Aug 12 04:01:46.250235405 (82h36m8.209332669s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264501501 (82h36m8.223598752s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264530334 (82h36m8.223627585s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.266378764 (82h36m8.225475997s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.270849349 (82h36m8.229946604s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.274507347 (82h36m8.233604599s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.277605145 (82h36m8.236702381s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.278223832 (82h36m8.237321083s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.281724439 (82h36m8.240821694s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.283898152 (82h36m8.242995403s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.285389849 (82h36m8.244487096s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.294916360 (82h36m8.2540136s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.310058801 (82h36m8.26915605s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313824733 (82h36m8.272921986s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313863449 (82h36m8.272960698s) [seg_pos={0 0}, upload=86071]: Segment reached optimal threshold of 14 pieces.
Aug 12 04:01:46.314169035 (82h36m8.273266285s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ld1wZ9sxQVpKNNvPFs9oyGhxCPips2YCbq5FiPFwfmuP7U2bY): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314256510 (82h36m8.273353772s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wawfBLsb6Ltuw8eJkD5ksdyiVGSfkpgdf752947b6uH3EvP49): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314313820 (82h36m8.273411054s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection
Aug 12 04:01:46.314423746 (82h36m8.273520992s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection
Aug 12 04:01:46.314469557 (82h36m8.273566809s) [seg_pos={0 0}, upload=86071]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 04:01:46.314579091 (82h36m8.273676342s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 04:01:46.314585208 (82h36m8.273682462s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 04:01:46.463952881 (82h36m8.423050127s) [upload=86071]: Done uploading segments...
Aug 12 04:01:46.463974938 (82h36m8.423072183s) [upload=86071]: Upload finished. err: <nil>
Duration: 2.610090679s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
856.249195ms
FAIL (2025-08-12 04:27:24 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 03:44:00.828648738 (82h18m22.787745987s) [upload=85758]: Starting upload Aug 12 03:44:00.828719930 (82h18m22.787817177s) [upload=85758]: Done starting upload Aug 12 03:44:00.828819767 (82h18m22.787917018s) [upload=85758]: Uploading segments... Aug 12 03:44:00.828939367 (82h18m22.788036622s) [upload=85758]: Got next segment. Inline: true Aug 12 03:44:00.828948819 (82h18m22.78804607s) [upload=85758]: Waiting for error group managing segments... Aug 12 03:44:00.829025247 (82h18m22.788122501s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 03:44:00.829032327 (82h18m22.788129577s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 03:44:00.829037590 (82h18m22.788134841s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 03:44:00.919603953 (82h18m22.878701198s) [upload=85758]: Done uploading segments... Aug 12 03:44:00.919623720 (82h18m22.878720952s) [upload=85758]: Upload finished. err: metaclient: Too Many Requests
Duration: 856.282821ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
2.676617739s
FAIL (2025-08-12 04:27:01 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b16e79e6792c3fb04b8a14731e255f5021232646d28cb4196aa31f9989a30bf2 != before b8b40385173213ad8d45a63c42247bea90ce75ae9eb6690c781f40993cdfea90
======LOGS======
Aug 12 04:01:45.307279589 (82h36m7.266376824s) [upload=86071]: Starting upload
Aug 12 04:01:45.307335524 (82h36m7.266432777s) [upload=86071]: Done starting upload
Aug 12 04:01:45.307590001 (82h36m7.266687236s) [upload=86071]: Uploading segments...
Aug 12 04:01:45.307891832 (82h36m7.266989077s) [upload=86071]: Got next segment. Inline: false
Aug 12 04:01:45.307968802 (82h36m7.267066047s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 04:01:45.307974771 (82h36m7.267072016s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 04:01:45.509630647 (82h36m7.468727893s) [seg_pos={0 0}, upload=86071]: Begin upload segment...
Aug 12 04:01:45.509684496 (82h36m7.468781747s) [seg_pos={0 0}, upload=86071]: Done begin upload segment.
Aug 12 04:01:45.509709425 (82h36m7.468806672s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.509731441 (82h36m7.468828695s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510157560 (82h36m7.469254805s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510514896 (82h36m7.469612152s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510648540 (82h36m7.469745785s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.511612159 (82h36m7.470709414s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512401852 (82h36m7.471499107s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512479869 (82h36m7.471577122s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.513021220 (82h36m7.472118468s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514000576 (82h36m7.473097832s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514032674 (82h36m7.473129956s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515062795 (82h36m7.474160043s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515525960 (82h36m7.474623215s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515817593 (82h36m7.474914843s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.516441434 (82h36m7.475538683s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517130867 (82h36m7.476228122s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517644081 (82h36m7.476741328s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.518124853 (82h36m7.477222103s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:46.102799767 (82h36m8.061897004s) [upload=86071]: Next returned nil segment
Aug 12 04:01:46.102818568 (82h36m8.061915817s) [upload=86071]: Waiting for error group managing segments...
Aug 12 04:01:46.250235405 (82h36m8.209332669s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264501501 (82h36m8.223598752s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264530334 (82h36m8.223627585s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.266378764 (82h36m8.225475997s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.270849349 (82h36m8.229946604s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.274507347 (82h36m8.233604599s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.277605145 (82h36m8.236702381s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.278223832 (82h36m8.237321083s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.281724439 (82h36m8.240821694s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.283898152 (82h36m8.242995403s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.285389849 (82h36m8.244487096s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.294916360 (82h36m8.2540136s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.310058801 (82h36m8.26915605s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313824733 (82h36m8.272921986s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313863449 (82h36m8.272960698s) [seg_pos={0 0}, upload=86071]: Segment reached optimal threshold of 14 pieces.
Aug 12 04:01:46.314169035 (82h36m8.273266285s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ld1wZ9sxQVpKNNvPFs9oyGhxCPips2YCbq5FiPFwfmuP7U2bY): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314256510 (82h36m8.273353772s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wawfBLsb6Ltuw8eJkD5ksdyiVGSfkpgdf752947b6uH3EvP49): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314313820 (82h36m8.273411054s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection
Aug 12 04:01:46.314423746 (82h36m8.273520992s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection
Aug 12 04:01:46.314469557 (82h36m8.273566809s) [seg_pos={0 0}, upload=86071]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 04:01:46.314579091 (82h36m8.273676342s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 04:01:46.314585208 (82h36m8.273682462s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 04:01:46.463952881 (82h36m8.423050127s) [upload=86071]: Done uploading segments...
Aug 12 04:01:46.463974938 (82h36m8.423072183s) [upload=86071]: Upload finished. err: <nil>
Duration: 2.676647216s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
2.087355334s
FAIL (2025-08-12 04:26:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 03:44:00.828648738 (82h18m22.787745987s) [upload=85758]: Starting upload Aug 12 03:44:00.828719930 (82h18m22.787817177s) [upload=85758]: Done starting upload Aug 12 03:44:00.828819767 (82h18m22.787917018s) [upload=85758]: Uploading segments... Aug 12 03:44:00.828939367 (82h18m22.788036622s) [upload=85758]: Got next segment. Inline: true Aug 12 03:44:00.828948819 (82h18m22.78804607s) [upload=85758]: Waiting for error group managing segments... Aug 12 03:44:00.829025247 (82h18m22.788122501s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 03:44:00.829032327 (82h18m22.788129577s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 03:44:00.829037590 (82h18m22.788134841s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 03:44:00.919603953 (82h18m22.878701198s) [upload=85758]: Done uploading segments... Aug 12 03:44:00.919623720 (82h18m22.878720952s) [upload=85758]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.08739848s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
2.433177125s
FAIL (2025-08-12 04:25:53 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b16e79e6792c3fb04b8a14731e255f5021232646d28cb4196aa31f9989a30bf2 != before b8b40385173213ad8d45a63c42247bea90ce75ae9eb6690c781f40993cdfea90
======LOGS======
Aug 12 04:01:45.307279589 (82h36m7.266376824s) [upload=86071]: Starting upload
Aug 12 04:01:45.307335524 (82h36m7.266432777s) [upload=86071]: Done starting upload
Aug 12 04:01:45.307590001 (82h36m7.266687236s) [upload=86071]: Uploading segments...
Aug 12 04:01:45.307891832 (82h36m7.266989077s) [upload=86071]: Got next segment. Inline: false
Aug 12 04:01:45.307968802 (82h36m7.267066047s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 04:01:45.307974771 (82h36m7.267072016s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 04:01:45.509630647 (82h36m7.468727893s) [seg_pos={0 0}, upload=86071]: Begin upload segment...
Aug 12 04:01:45.509684496 (82h36m7.468781747s) [seg_pos={0 0}, upload=86071]: Done begin upload segment.
Aug 12 04:01:45.509709425 (82h36m7.468806672s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.509731441 (82h36m7.468828695s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510157560 (82h36m7.469254805s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510514896 (82h36m7.469612152s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510648540 (82h36m7.469745785s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.511612159 (82h36m7.470709414s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512401852 (82h36m7.471499107s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512479869 (82h36m7.471577122s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.513021220 (82h36m7.472118468s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514000576 (82h36m7.473097832s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514032674 (82h36m7.473129956s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515062795 (82h36m7.474160043s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515525960 (82h36m7.474623215s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515817593 (82h36m7.474914843s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.516441434 (82h36m7.475538683s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517130867 (82h36m7.476228122s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517644081 (82h36m7.476741328s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.518124853 (82h36m7.477222103s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:46.102799767 (82h36m8.061897004s) [upload=86071]: Next returned nil segment
Aug 12 04:01:46.102818568 (82h36m8.061915817s) [upload=86071]: Waiting for error group managing segments...
Aug 12 04:01:46.250235405 (82h36m8.209332669s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264501501 (82h36m8.223598752s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264530334 (82h36m8.223627585s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.266378764 (82h36m8.225475997s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.270849349 (82h36m8.229946604s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.274507347 (82h36m8.233604599s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.277605145 (82h36m8.236702381s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.278223832 (82h36m8.237321083s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.281724439 (82h36m8.240821694s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.283898152 (82h36m8.242995403s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.285389849 (82h36m8.244487096s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.294916360 (82h36m8.2540136s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.310058801 (82h36m8.26915605s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313824733 (82h36m8.272921986s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313863449 (82h36m8.272960698s) [seg_pos={0 0}, upload=86071]: Segment reached optimal threshold of 14 pieces.
Aug 12 04:01:46.314169035 (82h36m8.273266285s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ld1wZ9sxQVpKNNvPFs9oyGhxCPips2YCbq5FiPFwfmuP7U2bY): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314256510 (82h36m8.273353772s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wawfBLsb6Ltuw8eJkD5ksdyiVGSfkpgdf752947b6uH3EvP49): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314313820 (82h36m8.273411054s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection
Aug 12 04:01:46.314423746 (82h36m8.273520992s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection
Aug 12 04:01:46.314469557 (82h36m8.273566809s) [seg_pos={0 0}, upload=86071]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 04:01:46.314579091 (82h36m8.273676342s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 04:01:46.314585208 (82h36m8.273682462s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 04:01:46.463952881 (82h36m8.423050127s) [upload=86071]: Done uploading segments...
Aug 12 04:01:46.463974938 (82h36m8.423072183s) [upload=86071]: Upload finished. err: <nil>
Duration: 2.433203901s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
2.284155415s
FAIL (2025-08-12 04:25:22 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b16e79e6792c3fb04b8a14731e255f5021232646d28cb4196aa31f9989a30bf2 != before b8b40385173213ad8d45a63c42247bea90ce75ae9eb6690c781f40993cdfea90
======LOGS======
Aug 12 04:01:45.307279589 (82h36m7.266376824s) [upload=86071]: Starting upload
Aug 12 04:01:45.307335524 (82h36m7.266432777s) [upload=86071]: Done starting upload
Aug 12 04:01:45.307590001 (82h36m7.266687236s) [upload=86071]: Uploading segments...
Aug 12 04:01:45.307891832 (82h36m7.266989077s) [upload=86071]: Got next segment. Inline: false
Aug 12 04:01:45.307968802 (82h36m7.267066047s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 04:01:45.307974771 (82h36m7.267072016s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 04:01:45.509630647 (82h36m7.468727893s) [seg_pos={0 0}, upload=86071]: Begin upload segment...
Aug 12 04:01:45.509684496 (82h36m7.468781747s) [seg_pos={0 0}, upload=86071]: Done begin upload segment.
Aug 12 04:01:45.509709425 (82h36m7.468806672s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.509731441 (82h36m7.468828695s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510157560 (82h36m7.469254805s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510514896 (82h36m7.469612152s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510648540 (82h36m7.469745785s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.511612159 (82h36m7.470709414s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512401852 (82h36m7.471499107s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512479869 (82h36m7.471577122s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.513021220 (82h36m7.472118468s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514000576 (82h36m7.473097832s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514032674 (82h36m7.473129956s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515062795 (82h36m7.474160043s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515525960 (82h36m7.474623215s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515817593 (82h36m7.474914843s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.516441434 (82h36m7.475538683s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517130867 (82h36m7.476228122s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517644081 (82h36m7.476741328s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.518124853 (82h36m7.477222103s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:46.102799767 (82h36m8.061897004s) [upload=86071]: Next returned nil segment
Aug 12 04:01:46.102818568 (82h36m8.061915817s) [upload=86071]: Waiting for error group managing segments...
Aug 12 04:01:46.250235405 (82h36m8.209332669s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264501501 (82h36m8.223598752s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264530334 (82h36m8.223627585s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.266378764 (82h36m8.225475997s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.270849349 (82h36m8.229946604s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.274507347 (82h36m8.233604599s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.277605145 (82h36m8.236702381s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.278223832 (82h36m8.237321083s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.281724439 (82h36m8.240821694s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.283898152 (82h36m8.242995403s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.285389849 (82h36m8.244487096s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.294916360 (82h36m8.2540136s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.310058801 (82h36m8.26915605s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313824733 (82h36m8.272921986s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313863449 (82h36m8.272960698s) [seg_pos={0 0}, upload=86071]: Segment reached optimal threshold of 14 pieces.
Aug 12 04:01:46.314169035 (82h36m8.273266285s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ld1wZ9sxQVpKNNvPFs9oyGhxCPips2YCbq5FiPFwfmuP7U2bY): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314256510 (82h36m8.273353772s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wawfBLsb6Ltuw8eJkD5ksdyiVGSfkpgdf752947b6uH3EvP49): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314313820 (82h36m8.273411054s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection
Aug 12 04:01:46.314423746 (82h36m8.273520992s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection
Aug 12 04:01:46.314469557 (82h36m8.273566809s) [seg_pos={0 0}, upload=86071]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 04:01:46.314579091 (82h36m8.273676342s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 04:01:46.314585208 (82h36m8.273682462s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 04:01:46.463952881 (82h36m8.423050127s) [upload=86071]: Done uploading segments...
Aug 12 04:01:46.463974938 (82h36m8.423072183s) [upload=86071]: Upload finished. err: <nil>
Duration: 2.284192013s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
853.54634ms
FAIL (2025-08-12 04:25:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 03:44:00.828648738 (82h18m22.787745987s) [upload=85758]: Starting upload Aug 12 03:44:00.828719930 (82h18m22.787817177s) [upload=85758]: Done starting upload Aug 12 03:44:00.828819767 (82h18m22.787917018s) [upload=85758]: Uploading segments... Aug 12 03:44:00.828939367 (82h18m22.788036622s) [upload=85758]: Got next segment. Inline: true Aug 12 03:44:00.828948819 (82h18m22.78804607s) [upload=85758]: Waiting for error group managing segments... Aug 12 03:44:00.829025247 (82h18m22.788122501s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 03:44:00.829032327 (82h18m22.788129577s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 03:44:00.829037590 (82h18m22.788134841s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 03:44:00.919603953 (82h18m22.878701198s) [upload=85758]: Done uploading segments... Aug 12 03:44:00.919623720 (82h18m22.878720952s) [upload=85758]: Upload finished. err: metaclient: Too Many Requests
Duration: 853.582494ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
920.888301ms
FAIL (2025-08-12 04:24:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 03:44:00.828648738 (82h18m22.787745987s) [upload=85758]: Starting upload Aug 12 03:44:00.828719930 (82h18m22.787817177s) [upload=85758]: Done starting upload Aug 12 03:44:00.828819767 (82h18m22.787917018s) [upload=85758]: Uploading segments... Aug 12 03:44:00.828939367 (82h18m22.788036622s) [upload=85758]: Got next segment. Inline: true Aug 12 03:44:00.828948819 (82h18m22.78804607s) [upload=85758]: Waiting for error group managing segments... Aug 12 03:44:00.829025247 (82h18m22.788122501s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 03:44:00.829032327 (82h18m22.788129577s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 03:44:00.829037590 (82h18m22.788134841s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 03:44:00.919603953 (82h18m22.878701198s) [upload=85758]: Done uploading segments... Aug 12 03:44:00.919623720 (82h18m22.878720952s) [upload=85758]: Upload finished. err: metaclient: Too Many Requests
Duration: 920.941601ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
2.392867094s
FAIL (2025-08-12 04:24:43 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b16e79e6792c3fb04b8a14731e255f5021232646d28cb4196aa31f9989a30bf2 != before b8b40385173213ad8d45a63c42247bea90ce75ae9eb6690c781f40993cdfea90
======LOGS======
Aug 12 04:01:45.307279589 (82h36m7.266376824s) [upload=86071]: Starting upload
Aug 12 04:01:45.307335524 (82h36m7.266432777s) [upload=86071]: Done starting upload
Aug 12 04:01:45.307590001 (82h36m7.266687236s) [upload=86071]: Uploading segments...
Aug 12 04:01:45.307891832 (82h36m7.266989077s) [upload=86071]: Got next segment. Inline: false
Aug 12 04:01:45.307968802 (82h36m7.267066047s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 04:01:45.307974771 (82h36m7.267072016s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 04:01:45.509630647 (82h36m7.468727893s) [seg_pos={0 0}, upload=86071]: Begin upload segment...
Aug 12 04:01:45.509684496 (82h36m7.468781747s) [seg_pos={0 0}, upload=86071]: Done begin upload segment.
Aug 12 04:01:45.509709425 (82h36m7.468806672s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.509731441 (82h36m7.468828695s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510157560 (82h36m7.469254805s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510514896 (82h36m7.469612152s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510648540 (82h36m7.469745785s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.511612159 (82h36m7.470709414s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512401852 (82h36m7.471499107s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512479869 (82h36m7.471577122s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.513021220 (82h36m7.472118468s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514000576 (82h36m7.473097832s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514032674 (82h36m7.473129956s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515062795 (82h36m7.474160043s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515525960 (82h36m7.474623215s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515817593 (82h36m7.474914843s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.516441434 (82h36m7.475538683s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517130867 (82h36m7.476228122s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517644081 (82h36m7.476741328s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.518124853 (82h36m7.477222103s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:46.102799767 (82h36m8.061897004s) [upload=86071]: Next returned nil segment
Aug 12 04:01:46.102818568 (82h36m8.061915817s) [upload=86071]: Waiting for error group managing segments...
Aug 12 04:01:46.250235405 (82h36m8.209332669s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264501501 (82h36m8.223598752s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264530334 (82h36m8.223627585s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.266378764 (82h36m8.225475997s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.270849349 (82h36m8.229946604s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.274507347 (82h36m8.233604599s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.277605145 (82h36m8.236702381s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.278223832 (82h36m8.237321083s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.281724439 (82h36m8.240821694s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.283898152 (82h36m8.242995403s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.285389849 (82h36m8.244487096s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.294916360 (82h36m8.2540136s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.310058801 (82h36m8.26915605s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313824733 (82h36m8.272921986s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313863449 (82h36m8.272960698s) [seg_pos={0 0}, upload=86071]: Segment reached optimal threshold of 14 pieces.
Aug 12 04:01:46.314169035 (82h36m8.273266285s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ld1wZ9sxQVpKNNvPFs9oyGhxCPips2YCbq5FiPFwfmuP7U2bY): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314256510 (82h36m8.273353772s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wawfBLsb6Ltuw8eJkD5ksdyiVGSfkpgdf752947b6uH3EvP49): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314313820 (82h36m8.273411054s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection
Aug 12 04:01:46.314423746 (82h36m8.273520992s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection
Aug 12 04:01:46.314469557 (82h36m8.273566809s) [seg_pos={0 0}, upload=86071]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 04:01:46.314579091 (82h36m8.273676342s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 04:01:46.314585208 (82h36m8.273682462s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 04:01:46.463952881 (82h36m8.423050127s) [upload=86071]: Done uploading segments...
Aug 12 04:01:46.463974938 (82h36m8.423072183s) [upload=86071]: Upload finished. err: <nil>
Duration: 2.392906951s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
1.007401078s
FAIL (2025-08-12 04:24:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 03:44:00.828648738 (82h18m22.787745987s) [upload=85758]: Starting upload Aug 12 03:44:00.828719930 (82h18m22.787817177s) [upload=85758]: Done starting upload Aug 12 03:44:00.828819767 (82h18m22.787917018s) [upload=85758]: Uploading segments... Aug 12 03:44:00.828939367 (82h18m22.788036622s) [upload=85758]: Got next segment. Inline: true Aug 12 03:44:00.828948819 (82h18m22.78804607s) [upload=85758]: Waiting for error group managing segments... Aug 12 03:44:00.829025247 (82h18m22.788122501s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 03:44:00.829032327 (82h18m22.788129577s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 03:44:00.829037590 (82h18m22.788134841s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 03:44:00.919603953 (82h18m22.878701198s) [upload=85758]: Done uploading segments... Aug 12 03:44:00.919623720 (82h18m22.878720952s) [upload=85758]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.007431021s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
869.615449ms
FAIL (2025-08-12 04:23:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 03:44:00.828648738 (82h18m22.787745987s) [upload=85758]: Starting upload Aug 12 03:44:00.828719930 (82h18m22.787817177s) [upload=85758]: Done starting upload Aug 12 03:44:00.828819767 (82h18m22.787917018s) [upload=85758]: Uploading segments... Aug 12 03:44:00.828939367 (82h18m22.788036622s) [upload=85758]: Got next segment. Inline: true Aug 12 03:44:00.828948819 (82h18m22.78804607s) [upload=85758]: Waiting for error group managing segments... Aug 12 03:44:00.829025247 (82h18m22.788122501s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 03:44:00.829032327 (82h18m22.788129577s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 03:44:00.829037590 (82h18m22.788134841s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 03:44:00.919603953 (82h18m22.878701198s) [upload=85758]: Done uploading segments... Aug 12 03:44:00.919623720 (82h18m22.878720952s) [upload=85758]: Upload finished. err: metaclient: Too Many Requests
Duration: 869.643805ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
2.563472226s
FAIL (2025-08-12 04:23:32 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b16e79e6792c3fb04b8a14731e255f5021232646d28cb4196aa31f9989a30bf2 != before b8b40385173213ad8d45a63c42247bea90ce75ae9eb6690c781f40993cdfea90
======LOGS======
Aug 12 04:01:45.307279589 (82h36m7.266376824s) [upload=86071]: Starting upload
Aug 12 04:01:45.307335524 (82h36m7.266432777s) [upload=86071]: Done starting upload
Aug 12 04:01:45.307590001 (82h36m7.266687236s) [upload=86071]: Uploading segments...
Aug 12 04:01:45.307891832 (82h36m7.266989077s) [upload=86071]: Got next segment. Inline: false
Aug 12 04:01:45.307968802 (82h36m7.267066047s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 04:01:45.307974771 (82h36m7.267072016s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 04:01:45.509630647 (82h36m7.468727893s) [seg_pos={0 0}, upload=86071]: Begin upload segment...
Aug 12 04:01:45.509684496 (82h36m7.468781747s) [seg_pos={0 0}, upload=86071]: Done begin upload segment.
Aug 12 04:01:45.509709425 (82h36m7.468806672s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.509731441 (82h36m7.468828695s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510157560 (82h36m7.469254805s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510514896 (82h36m7.469612152s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510648540 (82h36m7.469745785s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.511612159 (82h36m7.470709414s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512401852 (82h36m7.471499107s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512479869 (82h36m7.471577122s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.513021220 (82h36m7.472118468s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514000576 (82h36m7.473097832s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514032674 (82h36m7.473129956s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515062795 (82h36m7.474160043s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515525960 (82h36m7.474623215s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515817593 (82h36m7.474914843s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.516441434 (82h36m7.475538683s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517130867 (82h36m7.476228122s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517644081 (82h36m7.476741328s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.518124853 (82h36m7.477222103s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:46.102799767 (82h36m8.061897004s) [upload=86071]: Next returned nil segment
Aug 12 04:01:46.102818568 (82h36m8.061915817s) [upload=86071]: Waiting for error group managing segments...
Aug 12 04:01:46.250235405 (82h36m8.209332669s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264501501 (82h36m8.223598752s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264530334 (82h36m8.223627585s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.266378764 (82h36m8.225475997s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.270849349 (82h36m8.229946604s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.274507347 (82h36m8.233604599s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.277605145 (82h36m8.236702381s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.278223832 (82h36m8.237321083s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.281724439 (82h36m8.240821694s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.283898152 (82h36m8.242995403s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.285389849 (82h36m8.244487096s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.294916360 (82h36m8.2540136s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.310058801 (82h36m8.26915605s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313824733 (82h36m8.272921986s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313863449 (82h36m8.272960698s) [seg_pos={0 0}, upload=86071]: Segment reached optimal threshold of 14 pieces.
Aug 12 04:01:46.314169035 (82h36m8.273266285s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ld1wZ9sxQVpKNNvPFs9oyGhxCPips2YCbq5FiPFwfmuP7U2bY): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314256510 (82h36m8.273353772s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wawfBLsb6Ltuw8eJkD5ksdyiVGSfkpgdf752947b6uH3EvP49): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314313820 (82h36m8.273411054s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection
Aug 12 04:01:46.314423746 (82h36m8.273520992s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection
Aug 12 04:01:46.314469557 (82h36m8.273566809s) [seg_pos={0 0}, upload=86071]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 04:01:46.314579091 (82h36m8.273676342s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 04:01:46.314585208 (82h36m8.273682462s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 04:01:46.463952881 (82h36m8.423050127s) [upload=86071]: Done uploading segments...
Aug 12 04:01:46.463974938 (82h36m8.423072183s) [upload=86071]: Upload finished. err: <nil>
Duration: 2.563510912s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
890.698136ms
FAIL (2025-08-12 04:23:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 03:44:00.828648738 (82h18m22.787745987s) [upload=85758]: Starting upload Aug 12 03:44:00.828719930 (82h18m22.787817177s) [upload=85758]: Done starting upload Aug 12 03:44:00.828819767 (82h18m22.787917018s) [upload=85758]: Uploading segments... Aug 12 03:44:00.828939367 (82h18m22.788036622s) [upload=85758]: Got next segment. Inline: true Aug 12 03:44:00.828948819 (82h18m22.78804607s) [upload=85758]: Waiting for error group managing segments... Aug 12 03:44:00.829025247 (82h18m22.788122501s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 03:44:00.829032327 (82h18m22.788129577s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 03:44:00.829037590 (82h18m22.788134841s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 03:44:00.919603953 (82h18m22.878701198s) [upload=85758]: Done uploading segments... Aug 12 03:44:00.919623720 (82h18m22.878720952s) [upload=85758]: Upload finished. err: metaclient: Too Many Requests
Duration: 890.754169ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
842.59347ms
FAIL (2025-08-12 04:23:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 03:44:00.828648738 (82h18m22.787745987s) [upload=85758]: Starting upload Aug 12 03:44:00.828719930 (82h18m22.787817177s) [upload=85758]: Done starting upload Aug 12 03:44:00.828819767 (82h18m22.787917018s) [upload=85758]: Uploading segments... Aug 12 03:44:00.828939367 (82h18m22.788036622s) [upload=85758]: Got next segment. Inline: true Aug 12 03:44:00.828948819 (82h18m22.78804607s) [upload=85758]: Waiting for error group managing segments... Aug 12 03:44:00.829025247 (82h18m22.788122501s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 03:44:00.829032327 (82h18m22.788129577s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 03:44:00.829037590 (82h18m22.788134841s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 03:44:00.919603953 (82h18m22.878701198s) [upload=85758]: Done uploading segments... Aug 12 03:44:00.919623720 (82h18m22.878720952s) [upload=85758]: Upload finished. err: metaclient: Too Many Requests
Duration: 842.620171ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
2.677118491s
FAIL (2025-08-12 04:22:57 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b16e79e6792c3fb04b8a14731e255f5021232646d28cb4196aa31f9989a30bf2 != before b8b40385173213ad8d45a63c42247bea90ce75ae9eb6690c781f40993cdfea90
======LOGS======
Aug 12 04:01:45.307279589 (82h36m7.266376824s) [upload=86071]: Starting upload
Aug 12 04:01:45.307335524 (82h36m7.266432777s) [upload=86071]: Done starting upload
Aug 12 04:01:45.307590001 (82h36m7.266687236s) [upload=86071]: Uploading segments...
Aug 12 04:01:45.307891832 (82h36m7.266989077s) [upload=86071]: Got next segment. Inline: false
Aug 12 04:01:45.307968802 (82h36m7.267066047s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 04:01:45.307974771 (82h36m7.267072016s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 04:01:45.509630647 (82h36m7.468727893s) [seg_pos={0 0}, upload=86071]: Begin upload segment...
Aug 12 04:01:45.509684496 (82h36m7.468781747s) [seg_pos={0 0}, upload=86071]: Done begin upload segment.
Aug 12 04:01:45.509709425 (82h36m7.468806672s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.509731441 (82h36m7.468828695s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510157560 (82h36m7.469254805s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510514896 (82h36m7.469612152s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510648540 (82h36m7.469745785s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.511612159 (82h36m7.470709414s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512401852 (82h36m7.471499107s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512479869 (82h36m7.471577122s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.513021220 (82h36m7.472118468s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514000576 (82h36m7.473097832s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514032674 (82h36m7.473129956s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515062795 (82h36m7.474160043s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515525960 (82h36m7.474623215s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515817593 (82h36m7.474914843s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.516441434 (82h36m7.475538683s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517130867 (82h36m7.476228122s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517644081 (82h36m7.476741328s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.518124853 (82h36m7.477222103s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:46.102799767 (82h36m8.061897004s) [upload=86071]: Next returned nil segment
Aug 12 04:01:46.102818568 (82h36m8.061915817s) [upload=86071]: Waiting for error group managing segments...
Aug 12 04:01:46.250235405 (82h36m8.209332669s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264501501 (82h36m8.223598752s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264530334 (82h36m8.223627585s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.266378764 (82h36m8.225475997s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.270849349 (82h36m8.229946604s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.274507347 (82h36m8.233604599s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.277605145 (82h36m8.236702381s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.278223832 (82h36m8.237321083s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.281724439 (82h36m8.240821694s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.283898152 (82h36m8.242995403s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.285389849 (82h36m8.244487096s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.294916360 (82h36m8.2540136s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.310058801 (82h36m8.26915605s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313824733 (82h36m8.272921986s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313863449 (82h36m8.272960698s) [seg_pos={0 0}, upload=86071]: Segment reached optimal threshold of 14 pieces.
Aug 12 04:01:46.314169035 (82h36m8.273266285s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ld1wZ9sxQVpKNNvPFs9oyGhxCPips2YCbq5FiPFwfmuP7U2bY): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314256510 (82h36m8.273353772s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wawfBLsb6Ltuw8eJkD5ksdyiVGSfkpgdf752947b6uH3EvP49): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314313820 (82h36m8.273411054s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection
Aug 12 04:01:46.314423746 (82h36m8.273520992s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection
Aug 12 04:01:46.314469557 (82h36m8.273566809s) [seg_pos={0 0}, upload=86071]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 04:01:46.314579091 (82h36m8.273676342s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 04:01:46.314585208 (82h36m8.273682462s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 04:01:46.463952881 (82h36m8.423050127s) [upload=86071]: Done uploading segments...
Aug 12 04:01:46.463974938 (82h36m8.423072183s) [upload=86071]: Upload finished. err: <nil>
Duration: 2.677172936s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
3.010806123s
FAIL (2025-08-12 04:22:21 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b16e79e6792c3fb04b8a14731e255f5021232646d28cb4196aa31f9989a30bf2 != before b8b40385173213ad8d45a63c42247bea90ce75ae9eb6690c781f40993cdfea90
======LOGS======
Aug 12 04:01:45.307279589 (82h36m7.266376824s) [upload=86071]: Starting upload
Aug 12 04:01:45.307335524 (82h36m7.266432777s) [upload=86071]: Done starting upload
Aug 12 04:01:45.307590001 (82h36m7.266687236s) [upload=86071]: Uploading segments...
Aug 12 04:01:45.307891832 (82h36m7.266989077s) [upload=86071]: Got next segment. Inline: false
Aug 12 04:01:45.307968802 (82h36m7.267066047s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 04:01:45.307974771 (82h36m7.267072016s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 04:01:45.509630647 (82h36m7.468727893s) [seg_pos={0 0}, upload=86071]: Begin upload segment...
Aug 12 04:01:45.509684496 (82h36m7.468781747s) [seg_pos={0 0}, upload=86071]: Done begin upload segment.
Aug 12 04:01:45.509709425 (82h36m7.468806672s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.509731441 (82h36m7.468828695s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510157560 (82h36m7.469254805s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510514896 (82h36m7.469612152s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510648540 (82h36m7.469745785s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.511612159 (82h36m7.470709414s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512401852 (82h36m7.471499107s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512479869 (82h36m7.471577122s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.513021220 (82h36m7.472118468s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514000576 (82h36m7.473097832s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514032674 (82h36m7.473129956s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515062795 (82h36m7.474160043s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515525960 (82h36m7.474623215s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515817593 (82h36m7.474914843s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.516441434 (82h36m7.475538683s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517130867 (82h36m7.476228122s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517644081 (82h36m7.476741328s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.518124853 (82h36m7.477222103s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:46.102799767 (82h36m8.061897004s) [upload=86071]: Next returned nil segment
Aug 12 04:01:46.102818568 (82h36m8.061915817s) [upload=86071]: Waiting for error group managing segments...
Aug 12 04:01:46.250235405 (82h36m8.209332669s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264501501 (82h36m8.223598752s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264530334 (82h36m8.223627585s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.266378764 (82h36m8.225475997s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.270849349 (82h36m8.229946604s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.274507347 (82h36m8.233604599s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.277605145 (82h36m8.236702381s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.278223832 (82h36m8.237321083s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.281724439 (82h36m8.240821694s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.283898152 (82h36m8.242995403s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.285389849 (82h36m8.244487096s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.294916360 (82h36m8.2540136s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.310058801 (82h36m8.26915605s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313824733 (82h36m8.272921986s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313863449 (82h36m8.272960698s) [seg_pos={0 0}, upload=86071]: Segment reached optimal threshold of 14 pieces.
Aug 12 04:01:46.314169035 (82h36m8.273266285s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ld1wZ9sxQVpKNNvPFs9oyGhxCPips2YCbq5FiPFwfmuP7U2bY): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314256510 (82h36m8.273353772s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wawfBLsb6Ltuw8eJkD5ksdyiVGSfkpgdf752947b6uH3EvP49): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314313820 (82h36m8.273411054s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection
Aug 12 04:01:46.314423746 (82h36m8.273520992s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection
Aug 12 04:01:46.314469557 (82h36m8.273566809s) [seg_pos={0 0}, upload=86071]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 04:01:46.314579091 (82h36m8.273676342s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 04:01:46.314585208 (82h36m8.273682462s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 04:01:46.463952881 (82h36m8.423050127s) [upload=86071]: Done uploading segments...
Aug 12 04:01:46.463974938 (82h36m8.423072183s) [upload=86071]: Upload finished. err: <nil>
Duration: 3.010844003s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
1.065776574s
FAIL (2025-08-12 04:21:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 03:44:00.828648738 (82h18m22.787745987s) [upload=85758]: Starting upload Aug 12 03:44:00.828719930 (82h18m22.787817177s) [upload=85758]: Done starting upload Aug 12 03:44:00.828819767 (82h18m22.787917018s) [upload=85758]: Uploading segments... Aug 12 03:44:00.828939367 (82h18m22.788036622s) [upload=85758]: Got next segment. Inline: true Aug 12 03:44:00.828948819 (82h18m22.78804607s) [upload=85758]: Waiting for error group managing segments... Aug 12 03:44:00.829025247 (82h18m22.788122501s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 03:44:00.829032327 (82h18m22.788129577s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 03:44:00.829037590 (82h18m22.788134841s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 03:44:00.919603953 (82h18m22.878701198s) [upload=85758]: Done uploading segments... Aug 12 03:44:00.919623720 (82h18m22.878720952s) [upload=85758]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.065805672s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
2.434630331s
FAIL (2025-08-12 04:21:34 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b16e79e6792c3fb04b8a14731e255f5021232646d28cb4196aa31f9989a30bf2 != before b8b40385173213ad8d45a63c42247bea90ce75ae9eb6690c781f40993cdfea90
======LOGS======
Aug 12 04:01:45.307279589 (82h36m7.266376824s) [upload=86071]: Starting upload
Aug 12 04:01:45.307335524 (82h36m7.266432777s) [upload=86071]: Done starting upload
Aug 12 04:01:45.307590001 (82h36m7.266687236s) [upload=86071]: Uploading segments...
Aug 12 04:01:45.307891832 (82h36m7.266989077s) [upload=86071]: Got next segment. Inline: false
Aug 12 04:01:45.307968802 (82h36m7.267066047s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 04:01:45.307974771 (82h36m7.267072016s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 04:01:45.509630647 (82h36m7.468727893s) [seg_pos={0 0}, upload=86071]: Begin upload segment...
Aug 12 04:01:45.509684496 (82h36m7.468781747s) [seg_pos={0 0}, upload=86071]: Done begin upload segment.
Aug 12 04:01:45.509709425 (82h36m7.468806672s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.509731441 (82h36m7.468828695s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510157560 (82h36m7.469254805s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510514896 (82h36m7.469612152s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510648540 (82h36m7.469745785s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.511612159 (82h36m7.470709414s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512401852 (82h36m7.471499107s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512479869 (82h36m7.471577122s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.513021220 (82h36m7.472118468s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514000576 (82h36m7.473097832s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514032674 (82h36m7.473129956s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515062795 (82h36m7.474160043s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515525960 (82h36m7.474623215s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515817593 (82h36m7.474914843s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.516441434 (82h36m7.475538683s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517130867 (82h36m7.476228122s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517644081 (82h36m7.476741328s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.518124853 (82h36m7.477222103s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:46.102799767 (82h36m8.061897004s) [upload=86071]: Next returned nil segment
Aug 12 04:01:46.102818568 (82h36m8.061915817s) [upload=86071]: Waiting for error group managing segments...
Aug 12 04:01:46.250235405 (82h36m8.209332669s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264501501 (82h36m8.223598752s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264530334 (82h36m8.223627585s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.266378764 (82h36m8.225475997s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.270849349 (82h36m8.229946604s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.274507347 (82h36m8.233604599s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.277605145 (82h36m8.236702381s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.278223832 (82h36m8.237321083s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.281724439 (82h36m8.240821694s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.283898152 (82h36m8.242995403s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.285389849 (82h36m8.244487096s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.294916360 (82h36m8.2540136s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.310058801 (82h36m8.26915605s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313824733 (82h36m8.272921986s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313863449 (82h36m8.272960698s) [seg_pos={0 0}, upload=86071]: Segment reached optimal threshold of 14 pieces.
Aug 12 04:01:46.314169035 (82h36m8.273266285s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ld1wZ9sxQVpKNNvPFs9oyGhxCPips2YCbq5FiPFwfmuP7U2bY): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314256510 (82h36m8.273353772s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wawfBLsb6Ltuw8eJkD5ksdyiVGSfkpgdf752947b6uH3EvP49): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314313820 (82h36m8.273411054s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection
Aug 12 04:01:46.314423746 (82h36m8.273520992s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection
Aug 12 04:01:46.314469557 (82h36m8.273566809s) [seg_pos={0 0}, upload=86071]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 04:01:46.314579091 (82h36m8.273676342s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 04:01:46.314585208 (82h36m8.273682462s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 04:01:46.463952881 (82h36m8.423050127s) [upload=86071]: Done uploading segments...
Aug 12 04:01:46.463974938 (82h36m8.423072183s) [upload=86071]: Upload finished. err: <nil>
Duration: 2.434657451s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
1.041693205s
FAIL (2025-08-12 04:21:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 03:44:00.828648738 (82h18m22.787745987s) [upload=85758]: Starting upload Aug 12 03:44:00.828719930 (82h18m22.787817177s) [upload=85758]: Done starting upload Aug 12 03:44:00.828819767 (82h18m22.787917018s) [upload=85758]: Uploading segments... Aug 12 03:44:00.828939367 (82h18m22.788036622s) [upload=85758]: Got next segment. Inline: true Aug 12 03:44:00.828948819 (82h18m22.78804607s) [upload=85758]: Waiting for error group managing segments... Aug 12 03:44:00.829025247 (82h18m22.788122501s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 03:44:00.829032327 (82h18m22.788129577s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 03:44:00.829037590 (82h18m22.788134841s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 03:44:00.919603953 (82h18m22.878701198s) [upload=85758]: Done uploading segments... Aug 12 03:44:00.919623720 (82h18m22.878720952s) [upload=85758]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.041721503s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
902.566148ms
FAIL (2025-08-12 04:20:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 03:44:00.828648738 (82h18m22.787745987s) [upload=85758]: Starting upload Aug 12 03:44:00.828719930 (82h18m22.787817177s) [upload=85758]: Done starting upload Aug 12 03:44:00.828819767 (82h18m22.787917018s) [upload=85758]: Uploading segments... Aug 12 03:44:00.828939367 (82h18m22.788036622s) [upload=85758]: Got next segment. Inline: true Aug 12 03:44:00.828948819 (82h18m22.78804607s) [upload=85758]: Waiting for error group managing segments... Aug 12 03:44:00.829025247 (82h18m22.788122501s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 03:44:00.829032327 (82h18m22.788129577s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 03:44:00.829037590 (82h18m22.788134841s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 03:44:00.919603953 (82h18m22.878701198s) [upload=85758]: Done uploading segments... Aug 12 03:44:00.919623720 (82h18m22.878720952s) [upload=85758]: Upload finished. err: metaclient: Too Many Requests
Duration: 902.594161ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
2.340025901s
FAIL (2025-08-12 04:20:33 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b16e79e6792c3fb04b8a14731e255f5021232646d28cb4196aa31f9989a30bf2 != before b8b40385173213ad8d45a63c42247bea90ce75ae9eb6690c781f40993cdfea90
======LOGS======
Aug 12 04:01:45.307279589 (82h36m7.266376824s) [upload=86071]: Starting upload
Aug 12 04:01:45.307335524 (82h36m7.266432777s) [upload=86071]: Done starting upload
Aug 12 04:01:45.307590001 (82h36m7.266687236s) [upload=86071]: Uploading segments...
Aug 12 04:01:45.307891832 (82h36m7.266989077s) [upload=86071]: Got next segment. Inline: false
Aug 12 04:01:45.307968802 (82h36m7.267066047s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 04:01:45.307974771 (82h36m7.267072016s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 04:01:45.509630647 (82h36m7.468727893s) [seg_pos={0 0}, upload=86071]: Begin upload segment...
Aug 12 04:01:45.509684496 (82h36m7.468781747s) [seg_pos={0 0}, upload=86071]: Done begin upload segment.
Aug 12 04:01:45.509709425 (82h36m7.468806672s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.509731441 (82h36m7.468828695s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510157560 (82h36m7.469254805s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510514896 (82h36m7.469612152s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510648540 (82h36m7.469745785s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.511612159 (82h36m7.470709414s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512401852 (82h36m7.471499107s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512479869 (82h36m7.471577122s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.513021220 (82h36m7.472118468s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514000576 (82h36m7.473097832s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514032674 (82h36m7.473129956s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515062795 (82h36m7.474160043s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515525960 (82h36m7.474623215s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515817593 (82h36m7.474914843s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.516441434 (82h36m7.475538683s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517130867 (82h36m7.476228122s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517644081 (82h36m7.476741328s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.518124853 (82h36m7.477222103s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:46.102799767 (82h36m8.061897004s) [upload=86071]: Next returned nil segment
Aug 12 04:01:46.102818568 (82h36m8.061915817s) [upload=86071]: Waiting for error group managing segments...
Aug 12 04:01:46.250235405 (82h36m8.209332669s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264501501 (82h36m8.223598752s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264530334 (82h36m8.223627585s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.266378764 (82h36m8.225475997s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.270849349 (82h36m8.229946604s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.274507347 (82h36m8.233604599s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.277605145 (82h36m8.236702381s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.278223832 (82h36m8.237321083s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.281724439 (82h36m8.240821694s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.283898152 (82h36m8.242995403s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.285389849 (82h36m8.244487096s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.294916360 (82h36m8.2540136s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.310058801 (82h36m8.26915605s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313824733 (82h36m8.272921986s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313863449 (82h36m8.272960698s) [seg_pos={0 0}, upload=86071]: Segment reached optimal threshold of 14 pieces.
Aug 12 04:01:46.314169035 (82h36m8.273266285s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ld1wZ9sxQVpKNNvPFs9oyGhxCPips2YCbq5FiPFwfmuP7U2bY): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314256510 (82h36m8.273353772s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wawfBLsb6Ltuw8eJkD5ksdyiVGSfkpgdf752947b6uH3EvP49): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314313820 (82h36m8.273411054s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection
Aug 12 04:01:46.314423746 (82h36m8.273520992s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection
Aug 12 04:01:46.314469557 (82h36m8.273566809s) [seg_pos={0 0}, upload=86071]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 04:01:46.314579091 (82h36m8.273676342s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 04:01:46.314585208 (82h36m8.273682462s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 04:01:46.463952881 (82h36m8.423050127s) [upload=86071]: Done uploading segments...
Aug 12 04:01:46.463974938 (82h36m8.423072183s) [upload=86071]: Upload finished. err: <nil>
Duration: 2.340056678s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
897.053471ms
FAIL (2025-08-12 04:20:07 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 03:44:00.828648738 (82h18m22.787745987s) [upload=85758]: Starting upload Aug 12 03:44:00.828719930 (82h18m22.787817177s) [upload=85758]: Done starting upload Aug 12 03:44:00.828819767 (82h18m22.787917018s) [upload=85758]: Uploading segments... Aug 12 03:44:00.828939367 (82h18m22.788036622s) [upload=85758]: Got next segment. Inline: true Aug 12 03:44:00.828948819 (82h18m22.78804607s) [upload=85758]: Waiting for error group managing segments... Aug 12 03:44:00.829025247 (82h18m22.788122501s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 03:44:00.829032327 (82h18m22.788129577s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 03:44:00.829037590 (82h18m22.788134841s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 03:44:00.919603953 (82h18m22.878701198s) [upload=85758]: Done uploading segments... Aug 12 03:44:00.919623720 (82h18m22.878720952s) [upload=85758]: Upload finished. err: metaclient: Too Many Requests
Duration: 897.135044ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
1.059871566s
FAIL (2025-08-12 04:19:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 03:44:00.828648738 (82h18m22.787745987s) [upload=85758]: Starting upload Aug 12 03:44:00.828719930 (82h18m22.787817177s) [upload=85758]: Done starting upload Aug 12 03:44:00.828819767 (82h18m22.787917018s) [upload=85758]: Uploading segments... Aug 12 03:44:00.828939367 (82h18m22.788036622s) [upload=85758]: Got next segment. Inline: true Aug 12 03:44:00.828948819 (82h18m22.78804607s) [upload=85758]: Waiting for error group managing segments... Aug 12 03:44:00.829025247 (82h18m22.788122501s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 03:44:00.829032327 (82h18m22.788129577s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 03:44:00.829037590 (82h18m22.788134841s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 03:44:00.919603953 (82h18m22.878701198s) [upload=85758]: Done uploading segments... Aug 12 03:44:00.919623720 (82h18m22.878720952s) [upload=85758]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.059934018s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
2.345667328s
FAIL (2025-08-12 04:19:33 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b16e79e6792c3fb04b8a14731e255f5021232646d28cb4196aa31f9989a30bf2 != before b8b40385173213ad8d45a63c42247bea90ce75ae9eb6690c781f40993cdfea90
======LOGS======
Aug 12 04:01:45.307279589 (82h36m7.266376824s) [upload=86071]: Starting upload
Aug 12 04:01:45.307335524 (82h36m7.266432777s) [upload=86071]: Done starting upload
Aug 12 04:01:45.307590001 (82h36m7.266687236s) [upload=86071]: Uploading segments...
Aug 12 04:01:45.307891832 (82h36m7.266989077s) [upload=86071]: Got next segment. Inline: false
Aug 12 04:01:45.307968802 (82h36m7.267066047s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 04:01:45.307974771 (82h36m7.267072016s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 04:01:45.509630647 (82h36m7.468727893s) [seg_pos={0 0}, upload=86071]: Begin upload segment...
Aug 12 04:01:45.509684496 (82h36m7.468781747s) [seg_pos={0 0}, upload=86071]: Done begin upload segment.
Aug 12 04:01:45.509709425 (82h36m7.468806672s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.509731441 (82h36m7.468828695s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510157560 (82h36m7.469254805s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510514896 (82h36m7.469612152s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510648540 (82h36m7.469745785s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.511612159 (82h36m7.470709414s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512401852 (82h36m7.471499107s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512479869 (82h36m7.471577122s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.513021220 (82h36m7.472118468s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514000576 (82h36m7.473097832s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514032674 (82h36m7.473129956s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515062795 (82h36m7.474160043s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515525960 (82h36m7.474623215s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515817593 (82h36m7.474914843s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.516441434 (82h36m7.475538683s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517130867 (82h36m7.476228122s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517644081 (82h36m7.476741328s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.518124853 (82h36m7.477222103s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:46.102799767 (82h36m8.061897004s) [upload=86071]: Next returned nil segment
Aug 12 04:01:46.102818568 (82h36m8.061915817s) [upload=86071]: Waiting for error group managing segments...
Aug 12 04:01:46.250235405 (82h36m8.209332669s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264501501 (82h36m8.223598752s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264530334 (82h36m8.223627585s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.266378764 (82h36m8.225475997s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.270849349 (82h36m8.229946604s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.274507347 (82h36m8.233604599s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.277605145 (82h36m8.236702381s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.278223832 (82h36m8.237321083s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.281724439 (82h36m8.240821694s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.283898152 (82h36m8.242995403s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.285389849 (82h36m8.244487096s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.294916360 (82h36m8.2540136s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.310058801 (82h36m8.26915605s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313824733 (82h36m8.272921986s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313863449 (82h36m8.272960698s) [seg_pos={0 0}, upload=86071]: Segment reached optimal threshold of 14 pieces.
Aug 12 04:01:46.314169035 (82h36m8.273266285s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ld1wZ9sxQVpKNNvPFs9oyGhxCPips2YCbq5FiPFwfmuP7U2bY): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314256510 (82h36m8.273353772s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wawfBLsb6Ltuw8eJkD5ksdyiVGSfkpgdf752947b6uH3EvP49): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314313820 (82h36m8.273411054s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection
Aug 12 04:01:46.314423746 (82h36m8.273520992s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection
Aug 12 04:01:46.314469557 (82h36m8.273566809s) [seg_pos={0 0}, upload=86071]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 04:01:46.314579091 (82h36m8.273676342s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 04:01:46.314585208 (82h36m8.273682462s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 04:01:46.463952881 (82h36m8.423050127s) [upload=86071]: Done uploading segments...
Aug 12 04:01:46.463974938 (82h36m8.423072183s) [upload=86071]: Upload finished. err: <nil>
Duration: 2.345697431s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
1.039061575s
FAIL (2025-08-12 04:19:20 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 03:44:00.828648738 (82h18m22.787745987s) [upload=85758]: Starting upload Aug 12 03:44:00.828719930 (82h18m22.787817177s) [upload=85758]: Done starting upload Aug 12 03:44:00.828819767 (82h18m22.787917018s) [upload=85758]: Uploading segments... Aug 12 03:44:00.828939367 (82h18m22.788036622s) [upload=85758]: Got next segment. Inline: true Aug 12 03:44:00.828948819 (82h18m22.78804607s) [upload=85758]: Waiting for error group managing segments... Aug 12 03:44:00.829025247 (82h18m22.788122501s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 03:44:00.829032327 (82h18m22.788129577s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 03:44:00.829037590 (82h18m22.788134841s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 03:44:00.919603953 (82h18m22.878701198s) [upload=85758]: Done uploading segments... Aug 12 03:44:00.919623720 (82h18m22.878720952s) [upload=85758]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.039152319s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
1.056813979s
FAIL (2025-08-12 04:19:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 03:44:00.828648738 (82h18m22.787745987s) [upload=85758]: Starting upload Aug 12 03:44:00.828719930 (82h18m22.787817177s) [upload=85758]: Done starting upload Aug 12 03:44:00.828819767 (82h18m22.787917018s) [upload=85758]: Uploading segments... Aug 12 03:44:00.828939367 (82h18m22.788036622s) [upload=85758]: Got next segment. Inline: true Aug 12 03:44:00.828948819 (82h18m22.78804607s) [upload=85758]: Waiting for error group managing segments... Aug 12 03:44:00.829025247 (82h18m22.788122501s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 03:44:00.829032327 (82h18m22.788129577s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 03:44:00.829037590 (82h18m22.788134841s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 03:44:00.919603953 (82h18m22.878701198s) [upload=85758]: Done uploading segments... Aug 12 03:44:00.919623720 (82h18m22.878720952s) [upload=85758]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.056849213s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
2.382331678s
FAIL (2025-08-12 04:18:36 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b16e79e6792c3fb04b8a14731e255f5021232646d28cb4196aa31f9989a30bf2 != before b8b40385173213ad8d45a63c42247bea90ce75ae9eb6690c781f40993cdfea90
======LOGS======
Aug 12 04:01:45.307279589 (82h36m7.266376824s) [upload=86071]: Starting upload
Aug 12 04:01:45.307335524 (82h36m7.266432777s) [upload=86071]: Done starting upload
Aug 12 04:01:45.307590001 (82h36m7.266687236s) [upload=86071]: Uploading segments...
Aug 12 04:01:45.307891832 (82h36m7.266989077s) [upload=86071]: Got next segment. Inline: false
Aug 12 04:01:45.307968802 (82h36m7.267066047s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 04:01:45.307974771 (82h36m7.267072016s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 04:01:45.509630647 (82h36m7.468727893s) [seg_pos={0 0}, upload=86071]: Begin upload segment...
Aug 12 04:01:45.509684496 (82h36m7.468781747s) [seg_pos={0 0}, upload=86071]: Done begin upload segment.
Aug 12 04:01:45.509709425 (82h36m7.468806672s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.509731441 (82h36m7.468828695s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510157560 (82h36m7.469254805s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510514896 (82h36m7.469612152s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510648540 (82h36m7.469745785s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.511612159 (82h36m7.470709414s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512401852 (82h36m7.471499107s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512479869 (82h36m7.471577122s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.513021220 (82h36m7.472118468s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514000576 (82h36m7.473097832s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514032674 (82h36m7.473129956s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515062795 (82h36m7.474160043s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515525960 (82h36m7.474623215s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515817593 (82h36m7.474914843s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.516441434 (82h36m7.475538683s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517130867 (82h36m7.476228122s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517644081 (82h36m7.476741328s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.518124853 (82h36m7.477222103s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:46.102799767 (82h36m8.061897004s) [upload=86071]: Next returned nil segment
Aug 12 04:01:46.102818568 (82h36m8.061915817s) [upload=86071]: Waiting for error group managing segments...
Aug 12 04:01:46.250235405 (82h36m8.209332669s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264501501 (82h36m8.223598752s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264530334 (82h36m8.223627585s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.266378764 (82h36m8.225475997s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.270849349 (82h36m8.229946604s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.274507347 (82h36m8.233604599s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.277605145 (82h36m8.236702381s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.278223832 (82h36m8.237321083s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.281724439 (82h36m8.240821694s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.283898152 (82h36m8.242995403s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.285389849 (82h36m8.244487096s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.294916360 (82h36m8.2540136s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.310058801 (82h36m8.26915605s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313824733 (82h36m8.272921986s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313863449 (82h36m8.272960698s) [seg_pos={0 0}, upload=86071]: Segment reached optimal threshold of 14 pieces.
Aug 12 04:01:46.314169035 (82h36m8.273266285s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ld1wZ9sxQVpKNNvPFs9oyGhxCPips2YCbq5FiPFwfmuP7U2bY): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314256510 (82h36m8.273353772s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wawfBLsb6Ltuw8eJkD5ksdyiVGSfkpgdf752947b6uH3EvP49): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314313820 (82h36m8.273411054s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection
Aug 12 04:01:46.314423746 (82h36m8.273520992s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection
Aug 12 04:01:46.314469557 (82h36m8.273566809s) [seg_pos={0 0}, upload=86071]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 04:01:46.314579091 (82h36m8.273676342s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 04:01:46.314585208 (82h36m8.273682462s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 04:01:46.463952881 (82h36m8.423050127s) [upload=86071]: Done uploading segments...
Aug 12 04:01:46.463974938 (82h36m8.423072183s) [upload=86071]: Upload finished. err: <nil>
Duration: 2.382375104s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
869.501704ms
FAIL (2025-08-12 04:18:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 03:44:00.828648738 (82h18m22.787745987s) [upload=85758]: Starting upload Aug 12 03:44:00.828719930 (82h18m22.787817177s) [upload=85758]: Done starting upload Aug 12 03:44:00.828819767 (82h18m22.787917018s) [upload=85758]: Uploading segments... Aug 12 03:44:00.828939367 (82h18m22.788036622s) [upload=85758]: Got next segment. Inline: true Aug 12 03:44:00.828948819 (82h18m22.78804607s) [upload=85758]: Waiting for error group managing segments... Aug 12 03:44:00.829025247 (82h18m22.788122501s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 03:44:00.829032327 (82h18m22.788129577s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 03:44:00.829037590 (82h18m22.788134841s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 03:44:00.919603953 (82h18m22.878701198s) [upload=85758]: Done uploading segments... Aug 12 03:44:00.919623720 (82h18m22.878720952s) [upload=85758]: Upload finished. err: metaclient: Too Many Requests
Duration: 869.53257ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
2.584782377s
FAIL (2025-08-12 04:18:13 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b16e79e6792c3fb04b8a14731e255f5021232646d28cb4196aa31f9989a30bf2 != before b8b40385173213ad8d45a63c42247bea90ce75ae9eb6690c781f40993cdfea90
======LOGS======
Aug 12 04:01:45.307279589 (82h36m7.266376824s) [upload=86071]: Starting upload
Aug 12 04:01:45.307335524 (82h36m7.266432777s) [upload=86071]: Done starting upload
Aug 12 04:01:45.307590001 (82h36m7.266687236s) [upload=86071]: Uploading segments...
Aug 12 04:01:45.307891832 (82h36m7.266989077s) [upload=86071]: Got next segment. Inline: false
Aug 12 04:01:45.307968802 (82h36m7.267066047s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 04:01:45.307974771 (82h36m7.267072016s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 04:01:45.509630647 (82h36m7.468727893s) [seg_pos={0 0}, upload=86071]: Begin upload segment...
Aug 12 04:01:45.509684496 (82h36m7.468781747s) [seg_pos={0 0}, upload=86071]: Done begin upload segment.
Aug 12 04:01:45.509709425 (82h36m7.468806672s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.509731441 (82h36m7.468828695s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510157560 (82h36m7.469254805s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510514896 (82h36m7.469612152s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510648540 (82h36m7.469745785s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.511612159 (82h36m7.470709414s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512401852 (82h36m7.471499107s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512479869 (82h36m7.471577122s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.513021220 (82h36m7.472118468s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514000576 (82h36m7.473097832s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514032674 (82h36m7.473129956s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515062795 (82h36m7.474160043s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515525960 (82h36m7.474623215s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515817593 (82h36m7.474914843s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.516441434 (82h36m7.475538683s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517130867 (82h36m7.476228122s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517644081 (82h36m7.476741328s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.518124853 (82h36m7.477222103s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:46.102799767 (82h36m8.061897004s) [upload=86071]: Next returned nil segment
Aug 12 04:01:46.102818568 (82h36m8.061915817s) [upload=86071]: Waiting for error group managing segments...
Aug 12 04:01:46.250235405 (82h36m8.209332669s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264501501 (82h36m8.223598752s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264530334 (82h36m8.223627585s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.266378764 (82h36m8.225475997s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.270849349 (82h36m8.229946604s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.274507347 (82h36m8.233604599s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.277605145 (82h36m8.236702381s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.278223832 (82h36m8.237321083s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.281724439 (82h36m8.240821694s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.283898152 (82h36m8.242995403s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.285389849 (82h36m8.244487096s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.294916360 (82h36m8.2540136s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.310058801 (82h36m8.26915605s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313824733 (82h36m8.272921986s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313863449 (82h36m8.272960698s) [seg_pos={0 0}, upload=86071]: Segment reached optimal threshold of 14 pieces.
Aug 12 04:01:46.314169035 (82h36m8.273266285s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ld1wZ9sxQVpKNNvPFs9oyGhxCPips2YCbq5FiPFwfmuP7U2bY): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314256510 (82h36m8.273353772s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wawfBLsb6Ltuw8eJkD5ksdyiVGSfkpgdf752947b6uH3EvP49): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314313820 (82h36m8.273411054s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection
Aug 12 04:01:46.314423746 (82h36m8.273520992s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection
Aug 12 04:01:46.314469557 (82h36m8.273566809s) [seg_pos={0 0}, upload=86071]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 04:01:46.314579091 (82h36m8.273676342s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 04:01:46.314585208 (82h36m8.273682462s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 04:01:46.463952881 (82h36m8.423050127s) [upload=86071]: Done uploading segments...
Aug 12 04:01:46.463974938 (82h36m8.423072183s) [upload=86071]: Upload finished. err: <nil>
Duration: 2.584823351s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
822.445444ms
FAIL (2025-08-12 04:18:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 03:44:00.828648738 (82h18m22.787745987s) [upload=85758]: Starting upload Aug 12 03:44:00.828719930 (82h18m22.787817177s) [upload=85758]: Done starting upload Aug 12 03:44:00.828819767 (82h18m22.787917018s) [upload=85758]: Uploading segments... Aug 12 03:44:00.828939367 (82h18m22.788036622s) [upload=85758]: Got next segment. Inline: true Aug 12 03:44:00.828948819 (82h18m22.78804607s) [upload=85758]: Waiting for error group managing segments... Aug 12 03:44:00.829025247 (82h18m22.788122501s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 03:44:00.829032327 (82h18m22.788129577s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 03:44:00.829037590 (82h18m22.788134841s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 03:44:00.919603953 (82h18m22.878701198s) [upload=85758]: Done uploading segments... Aug 12 03:44:00.919623720 (82h18m22.878720952s) [upload=85758]: Upload finished. err: metaclient: Too Many Requests
Duration: 822.47036ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
842.966918ms
FAIL (2025-08-12 04:17:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 03:44:00.828648738 (82h18m22.787745987s) [upload=85758]: Starting upload Aug 12 03:44:00.828719930 (82h18m22.787817177s) [upload=85758]: Done starting upload Aug 12 03:44:00.828819767 (82h18m22.787917018s) [upload=85758]: Uploading segments... Aug 12 03:44:00.828939367 (82h18m22.788036622s) [upload=85758]: Got next segment. Inline: true Aug 12 03:44:00.828948819 (82h18m22.78804607s) [upload=85758]: Waiting for error group managing segments... Aug 12 03:44:00.829025247 (82h18m22.788122501s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 03:44:00.829032327 (82h18m22.788129577s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 03:44:00.829037590 (82h18m22.788134841s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 03:44:00.919603953 (82h18m22.878701198s) [upload=85758]: Done uploading segments... Aug 12 03:44:00.919623720 (82h18m22.878720952s) [upload=85758]: Upload finished. err: metaclient: Too Many Requests
Duration: 843.001903ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
2.543031992s
FAIL (2025-08-12 04:17:47 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b16e79e6792c3fb04b8a14731e255f5021232646d28cb4196aa31f9989a30bf2 != before b8b40385173213ad8d45a63c42247bea90ce75ae9eb6690c781f40993cdfea90
======LOGS======
Aug 12 04:01:45.307279589 (82h36m7.266376824s) [upload=86071]: Starting upload
Aug 12 04:01:45.307335524 (82h36m7.266432777s) [upload=86071]: Done starting upload
Aug 12 04:01:45.307590001 (82h36m7.266687236s) [upload=86071]: Uploading segments...
Aug 12 04:01:45.307891832 (82h36m7.266989077s) [upload=86071]: Got next segment. Inline: false
Aug 12 04:01:45.307968802 (82h36m7.267066047s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 04:01:45.307974771 (82h36m7.267072016s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 04:01:45.509630647 (82h36m7.468727893s) [seg_pos={0 0}, upload=86071]: Begin upload segment...
Aug 12 04:01:45.509684496 (82h36m7.468781747s) [seg_pos={0 0}, upload=86071]: Done begin upload segment.
Aug 12 04:01:45.509709425 (82h36m7.468806672s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.509731441 (82h36m7.468828695s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510157560 (82h36m7.469254805s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510514896 (82h36m7.469612152s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510648540 (82h36m7.469745785s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.511612159 (82h36m7.470709414s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512401852 (82h36m7.471499107s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512479869 (82h36m7.471577122s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.513021220 (82h36m7.472118468s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514000576 (82h36m7.473097832s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514032674 (82h36m7.473129956s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515062795 (82h36m7.474160043s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515525960 (82h36m7.474623215s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515817593 (82h36m7.474914843s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.516441434 (82h36m7.475538683s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517130867 (82h36m7.476228122s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517644081 (82h36m7.476741328s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.518124853 (82h36m7.477222103s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:46.102799767 (82h36m8.061897004s) [upload=86071]: Next returned nil segment
Aug 12 04:01:46.102818568 (82h36m8.061915817s) [upload=86071]: Waiting for error group managing segments...
Aug 12 04:01:46.250235405 (82h36m8.209332669s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264501501 (82h36m8.223598752s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264530334 (82h36m8.223627585s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.266378764 (82h36m8.225475997s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.270849349 (82h36m8.229946604s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.274507347 (82h36m8.233604599s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.277605145 (82h36m8.236702381s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.278223832 (82h36m8.237321083s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.281724439 (82h36m8.240821694s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.283898152 (82h36m8.242995403s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.285389849 (82h36m8.244487096s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.294916360 (82h36m8.2540136s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.310058801 (82h36m8.26915605s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313824733 (82h36m8.272921986s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313863449 (82h36m8.272960698s) [seg_pos={0 0}, upload=86071]: Segment reached optimal threshold of 14 pieces.
Aug 12 04:01:46.314169035 (82h36m8.273266285s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ld1wZ9sxQVpKNNvPFs9oyGhxCPips2YCbq5FiPFwfmuP7U2bY): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314256510 (82h36m8.273353772s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wawfBLsb6Ltuw8eJkD5ksdyiVGSfkpgdf752947b6uH3EvP49): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314313820 (82h36m8.273411054s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection
Aug 12 04:01:46.314423746 (82h36m8.273520992s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection
Aug 12 04:01:46.314469557 (82h36m8.273566809s) [seg_pos={0 0}, upload=86071]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 04:01:46.314579091 (82h36m8.273676342s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 04:01:46.314585208 (82h36m8.273682462s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 04:01:46.463952881 (82h36m8.423050127s) [upload=86071]: Done uploading segments...
Aug 12 04:01:46.463974938 (82h36m8.423072183s) [upload=86071]: Upload finished. err: <nil>
Duration: 2.543061824s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
2.408846606s
FAIL (2025-08-12 04:17:31 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b16e79e6792c3fb04b8a14731e255f5021232646d28cb4196aa31f9989a30bf2 != before b8b40385173213ad8d45a63c42247bea90ce75ae9eb6690c781f40993cdfea90
======LOGS======
Aug 12 04:01:45.307279589 (82h36m7.266376824s) [upload=86071]: Starting upload
Aug 12 04:01:45.307335524 (82h36m7.266432777s) [upload=86071]: Done starting upload
Aug 12 04:01:45.307590001 (82h36m7.266687236s) [upload=86071]: Uploading segments...
Aug 12 04:01:45.307891832 (82h36m7.266989077s) [upload=86071]: Got next segment. Inline: false
Aug 12 04:01:45.307968802 (82h36m7.267066047s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 04:01:45.307974771 (82h36m7.267072016s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 04:01:45.509630647 (82h36m7.468727893s) [seg_pos={0 0}, upload=86071]: Begin upload segment...
Aug 12 04:01:45.509684496 (82h36m7.468781747s) [seg_pos={0 0}, upload=86071]: Done begin upload segment.
Aug 12 04:01:45.509709425 (82h36m7.468806672s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.509731441 (82h36m7.468828695s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510157560 (82h36m7.469254805s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510514896 (82h36m7.469612152s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.510648540 (82h36m7.469745785s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.511612159 (82h36m7.470709414s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512401852 (82h36m7.471499107s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.512479869 (82h36m7.471577122s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.513021220 (82h36m7.472118468s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514000576 (82h36m7.473097832s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.514032674 (82h36m7.473129956s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515062795 (82h36m7.474160043s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515525960 (82h36m7.474623215s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.515817593 (82h36m7.474914843s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.516441434 (82h36m7.475538683s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517130867 (82h36m7.476228122s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.517644081 (82h36m7.476741328s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:45.518124853 (82h36m7.477222103s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Uploading piece...
Aug 12 04:01:46.102799767 (82h36m8.061897004s) [upload=86071]: Next returned nil segment
Aug 12 04:01:46.102818568 (82h36m8.061915817s) [upload=86071]: Waiting for error group managing segments...
Aug 12 04:01:46.250235405 (82h36m8.209332669s) [noise=true , address=104.36.82.58:4275 , piece_id=C2PVKLL6YNCMIHGMYZFKNWOX576E2IV3GZDWY5B6UIOUZVLF2GXQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264501501 (82h36m8.223598752s) [noise=true , address=104.36.82.34:4553 , piece_id=5DTOUANMGQYNPAFD2EWCIUW7MM6WP23N3JK4WEEPQASCHI6BL2WQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.264530334 (82h36m8.223627585s) [noise=true , address=77.90.31.10:4535 , piece_id=VXYGARZIMJP53UKLVQQEZPKMFCXB4GTXLLW5VOUXJBH2OY4QWACA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.266378764 (82h36m8.225475997s) [noise=true , address=104.36.82.6:4895 , piece_id=B46ZJXGMGXK7YUQNIA6XVUA2LP526E3OQ6TKJSY3MPOEOXHNEDKQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.270849349 (82h36m8.229946604s) [noise=true , address=104.36.82.17:4340 , piece_id=7LB56LD5WWL5UYCT5HLTMYSWPZXXM5255QAHBG24QZ36AZVHJXWQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.274507347 (82h36m8.233604599s) [noise=true , address=104.36.82.35:4583 , piece_id=2YXA6X7VKLH3CIMURWWFC4SXEHMPT4L4IRM4B5TCIMH65MLAIDBQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.277605145 (82h36m8.236702381s) [noise=true , address=104.36.82.37:4674 , piece_id=T77VNUIXH7JVAHBP7KQG5WNV5YZZEDVZTWUJ6PLEAMQ4DPEAHZOQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.278223832 (82h36m8.237321083s) [noise=true , address=104.36.82.61:4373 , piece_id=227FBTJ6SBI72LLB3OZNLWZIOKXSFVSROUAXSRQLGXNIVXKZRJBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.281724439 (82h36m8.240821694s) [noise=true , address=104.36.82.2:4751 , piece_id=KVKICCO2FTHEPM62H775NFDBZTX6G5B7LEYPSC7WRSGOMOULHWBA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.283898152 (82h36m8.242995403s) [noise=true , address=104.36.82.46:4511 , piece_id=SQT4Z72XNUSEVQHVHTP3ZXBJPLUDBMD3JD3JDZGQD5R6N6ACZACQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.285389849 (82h36m8.244487096s) [noise=true , address=104.36.82.62:4409 , piece_id=JSS6V3QEROD4OVPM22KPEQAB76P6ZEBVE62WHHNVEA2LN4L3MUCQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.294916360 (82h36m8.2540136s) [noise=true , address=104.36.82.23:4467 , piece_id=WWKJMQGWWFU45OIKYZVOFXGTP3LDF2VLP4TOLRJVY6ILBQRE5NRQ, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.310058801 (82h36m8.26915605s) [noise=true , address=104.36.82.60:4362 , piece_id=O65DIGNP2XJDIEACPCA77MNMUT7YOTRGDXRBRBXKYD4EGSL6CSLA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313824733 (82h36m8.272921986s) [noise=true , address=104.36.82.5:4869 , piece_id=DHFAZGPO6OTP5IAXA7M5TYBYQOEMZQHV2EYC5GXPKCK7KLIK6A6A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: <nil>
Aug 12 04:01:46.313863449 (82h36m8.272960698s) [seg_pos={0 0}, upload=86071]: Segment reached optimal threshold of 14 pieces.
Aug 12 04:01:46.314169035 (82h36m8.273266285s) [noise=true , address=104.36.82.36:4649 , piece_id=QLTRKIXHOGGSGXEXGFJISPPCECU2YIYBOLFPNNX5YFLMM6ZSYEDA, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ld1wZ9sxQVpKNNvPFs9oyGhxCPips2YCbq5FiPFwfmuP7U2bY): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314256510 (82h36m8.273353772s) [noise=true , address=79.127.201.215:4359 , piece_id=MQBYIXCTJLV43GSREOQVZB67WYQYHHBOJOJLV2JM7ZPM3CZT5D6Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wawfBLsb6Ltuw8eJkD5ksdyiVGSfkpgdf752947b6uH3EvP49): protocol: expected piece hash; context canceled; EOF
Aug 12 04:01:46.314313820 (82h36m8.273411054s) [noise=true , address=66.23.193.175:4562 , piece_id=4TCKUBV2USYAADYBEPKEWSBT4SKZOYMIJKXGQVWCAFM4EIJC3O3A, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1iXXTKFCy3W3p3hTrHSBPFmcq7LfGnFKg4o76iFSvzFhf1vK6y): protocol: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:56252->66.23.193.175:4562: use of closed network connection
Aug 12 04:01:46.314423746 (82h36m8.273520992s) [noise=true , address=64.49.13.169:4713 , piece_id=BL657ATAUIOQCXWVGCXZ52C255HB4X5SEV5DN52YAVZLYJK5R35Q, seg_pos={0 0}, upload=86071]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17z3AiUfbxBX2eMDnUnqo1bbgojuQxJro7PsEaPjYzQjHQ3D6K): protocol: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52654->64.49.13.169:4713: use of closed network connection
Aug 12 04:01:46.314469557 (82h36m8.273566809s) [seg_pos={0 0}, upload=86071]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 04:01:46.314579091 (82h36m8.273676342s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 04:01:46.314585208 (82h36m8.273682462s) [upload=86071]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 04:01:46.463952881 (82h36m8.423050127s) [upload=86071]: Done uploading segments...
Aug 12 04:01:46.463974938 (82h36m8.423072183s) [upload=86071]: Upload finished. err: <nil>
Duration: 2.40887807s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
873.886731ms
FAIL (2025-08-12 04:16:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 12 03:44:00.828648738 (82h18m22.787745987s) [upload=85758]: Starting upload Aug 12 03:44:00.828719930 (82h18m22.787817177s) [upload=85758]: Done starting upload Aug 12 03:44:00.828819767 (82h18m22.787917018s) [upload=85758]: Uploading segments... Aug 12 03:44:00.828939367 (82h18m22.788036622s) [upload=85758]: Got next segment. Inline: true Aug 12 03:44:00.828948819 (82h18m22.78804607s) [upload=85758]: Waiting for error group managing segments... Aug 12 03:44:00.829025247 (82h18m22.788122501s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 12 03:44:00.829032327 (82h18m22.788129577s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 12 03:44:00.829037590 (82h18m22.788134841s) [upload=85758]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 12 03:44:00.919603953 (82h18m22.878701198s) [upload=85758]: Done uploading segments... Aug 12 03:44:00.919623720 (82h18m22.878720952s) [upload=85758]: Upload finished. err: metaclient: Too Many Requests
Duration: 873.919302ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|