Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........X.........................................X........] duration:
2.398384052s
FAIL (2025-08-09 02:16:16 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 9 02:10:37.079080615 (8h44m59.038177867s) [upload=9072]: Starting upload
Aug 9 02:10:37.079168398 (8h44m59.038265647s) [upload=9072]: Done starting upload
Aug 9 02:10:37.079251655 (8h44m59.038348893s) [upload=9072]: Uploading segments...
Aug 9 02:10:37.079463912 (8h44m59.038561158s) [upload=9072]: Got next segment. Inline: false
Aug 9 02:10:37.079516285 (8h44m59.03861353s) [upload=9072]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 02:10:37.079521467 (8h44m59.038618702s) [upload=9072]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 02:10:37.281443152 (8h44m59.240540403s) [seg_pos={0 0}, upload=9072]: Begin upload segment...
Aug 9 02:10:37.281501467 (8h44m59.240598711s) [seg_pos={0 0}, upload=9072]: Done begin upload segment.
Aug 9 02:10:37.281533149 (8h44m59.240630384s) [noise=true , address=79.127.219.51:4185 , piece_id=YEKJOTAO5GNJJ4EXXZQ67PBOEVF5CMRWS2YILIWEYH7SPCYDJDFQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.281542503 (8h44m59.24063975s) [noise=true , address=45.91.116.13:4157 , piece_id=NF2U6KEPFJJES3LLLPMEXW2D4TQGIRZXCBZKYRKP6WDVTQZG3Z5A, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.281978435 (8h44m59.241075686s) [noise=true , address=104.36.82.38:4700 , piece_id=MOOI5GCJ6U2SOZ6CXSFCXJ3EM33ILXQKUKZGHDNQAWFQZCR6FA5A, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.282035638 (8h44m59.24113289s) [noise=true , address=104.36.82.36:4628 , piece_id=NXQCJWOKEPWPHWLUA2LN33NY2K4T6MBADP6UZHDXCOSZ3IVTU7QA, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.282365897 (8h44m59.241463153s) [noise=true , address=104.36.82.8:4983 , piece_id=7Z3ESXBUZPGZ4B3UOBGJMQTLIORRPYGISSWBVBGPJ5NZLBUSYQQQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.282519577 (8h44m59.241616826s) [noise=true , address=104.36.82.3:4792 , piece_id=3EICKVTJG3WKIVW7NSTAOJF6MHIR535WZ2DWPBZWGDBEKAW2UAIQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.282775377 (8h44m59.241872638s) [noise=true , address=64.49.13.27:4965 , piece_id=RY6ZCWIZLZJ5ODB5VQL5HHLAWMVCPR3DGFA2EHJK7YX3PD64ICCQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.282945943 (8h44m59.242043197s) [noise=true , address=79.127.201.215:4346 , piece_id=A4ZZJR37JVXZJENDXEPEWRHOXWGJJIQWMNDJDP3K4AYTFWBBRZVA, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.283249037 (8h44m59.242346294s) [noise=true , address=104.36.82.34:4555 , piece_id=FDBGAOUH2TNFRWOUVOUITLKDMEF3DTR7LZ366XU7IIBLPM7754MQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.283497868 (8h44m59.242595117s) [noise=true , address=104.36.82.47:4535 , piece_id=GSW3JTWTFKGNPBQESXRFXE4MJMURCGR3CWA5A5X2NHE3WBQXW7MQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.283697787 (8h44m59.242795043s) [noise=true , address=104.36.82.37:4667 , piece_id=CAYYHPWFW3WMLNS4U4LKB7ZBDTS4XK7R2ECH6B4JLFECFVEG4J2A, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.283923629 (8h44m59.243020879s) [noise=true , address=79.127.201.215:4344 , piece_id=GMLUHW4RJO2B5CA3FRJXREMPPA3GI5UAJ75MCKSPWCMDB4XZTB3A, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.284070531 (8h44m59.2431678s) [noise=true , address=104.36.82.59:4336 , piece_id=XKEMPPIYH3H3G2MBNNTTFLOYDNTLH6XZIDS3GAMJBRBTUSRPD2IA, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.284320294 (8h44m59.243417527s) [noise=true , address=104.36.82.62:4433 , piece_id=A5M2AO7CLC4GED6GT3ZW72NXSHTFAADOBWAPIQCDMKIJWSQSM7OQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.284484469 (8h44m59.243581723s) [noise=true , address=104.36.82.44:4896 , piece_id=LH3KS6YE4VX4TNUPTJSGMKQZH6XNFIGEG4QCI6RSEZCGTGRGUKIA, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.284875568 (8h44m59.243972872s) [noise=true , address=104.36.82.14:4238 , piece_id=TKXGQSYKRGK4APMPZ2SM62LE7SBLDLNBNQJKGQQNROVQC3V57XEQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.285200545 (8h44m59.244297797s) [noise=true , address=104.36.82.42:4825 , piece_id=CLIXDVX5I3Z7AMDAJH7YDSIM4HURCGTTNUOKPGKWUS44GXFWWGHQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.285531356 (8h44m59.244628595s) [noise=true , address=104.36.82.39:4746 , piece_id=6RWW23FF6YXXHCW6C6NPQUE5VZQT5PVKVSI3QIILPNVJHYYBA4FA, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.857401850 (8h44m59.816499088s) [upload=9072]: Next returned nil segment
Aug 9 02:10:37.857420190 (8h44m59.816517435s) [upload=9072]: Waiting for error group managing segments...
Aug 9 02:10:38.002192174 (8h44m59.961289461s) [noise=true , address=45.91.116.13:4157 , piece_id=NF2U6KEPFJJES3LLLPMEXW2D4TQGIRZXCBZKYRKP6WDVTQZG3Z5A, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.008516068 (8h44m59.967613307s) [noise=true , address=104.36.82.37:4667 , piece_id=CAYYHPWFW3WMLNS4U4LKB7ZBDTS4XK7R2ECH6B4JLFECFVEG4J2A, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.010892791 (8h44m59.969990029s) [noise=true , address=104.36.82.38:4700 , piece_id=MOOI5GCJ6U2SOZ6CXSFCXJ3EM33ILXQKUKZGHDNQAWFQZCR6FA5A, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.015403350 (8h44m59.974500596s) [noise=true , address=104.36.82.3:4792 , piece_id=3EICKVTJG3WKIVW7NSTAOJF6MHIR535WZ2DWPBZWGDBEKAW2UAIQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.021945896 (8h44m59.981043141s) [noise=true , address=104.36.82.62:4433 , piece_id=A5M2AO7CLC4GED6GT3ZW72NXSHTFAADOBWAPIQCDMKIJWSQSM7OQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.022623812 (8h44m59.981721043s) [noise=true , address=104.36.82.36:4628 , piece_id=NXQCJWOKEPWPHWLUA2LN33NY2K4T6MBADP6UZHDXCOSZ3IVTU7QA, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.025268193 (8h44m59.984365438s) [noise=true , address=104.36.82.47:4535 , piece_id=GSW3JTWTFKGNPBQESXRFXE4MJMURCGR3CWA5A5X2NHE3WBQXW7MQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.029831147 (8h44m59.988928379s) [noise=true , address=104.36.82.42:4825 , piece_id=CLIXDVX5I3Z7AMDAJH7YDSIM4HURCGTTNUOKPGKWUS44GXFWWGHQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.031361897 (8h44m59.990459143s) [noise=true , address=104.36.82.39:4746 , piece_id=6RWW23FF6YXXHCW6C6NPQUE5VZQT5PVKVSI3QIILPNVJHYYBA4FA, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.031724328 (8h44m59.990821567s) [noise=true , address=104.36.82.14:4238 , piece_id=TKXGQSYKRGK4APMPZ2SM62LE7SBLDLNBNQJKGQQNROVQC3V57XEQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.034015821 (8h44m59.993113059s) [noise=true , address=104.36.82.8:4983 , piece_id=7Z3ESXBUZPGZ4B3UOBGJMQTLIORRPYGISSWBVBGPJ5NZLBUSYQQQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.039241260 (8h44m59.998338494s) [noise=true , address=104.36.82.34:4555 , piece_id=FDBGAOUH2TNFRWOUVOUITLKDMEF3DTR7LZ366XU7IIBLPM7754MQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.084935610 (8h45m0.044032847s) [noise=true , address=79.127.219.51:4185 , piece_id=YEKJOTAO5GNJJ4EXXZQ67PBOEVF5CMRWS2YILIWEYH7SPCYDJDFQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.094851780 (8h45m0.053949012s) [noise=true , address=104.36.82.59:4336 , piece_id=XKEMPPIYH3H3G2MBNNTTFLOYDNTLH6XZIDS3GAMJBRBTUSRPD2IA, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.094888338 (8h45m0.053985583s) [seg_pos={0 0}, upload=9072]: Segment reached optimal threshold of 14 pieces.
Aug 9 02:10:38.095192665 (8h45m0.054289897s) [noise=true , address=104.36.82.44:4896 , piece_id=LH3KS6YE4VX4TNUPTJSGMKQZH6XNFIGEG4QCI6RSEZCGTGRGUKIA, seg_pos={0 0}, upload=9072]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o): protocol: expected piece hash; context canceled; EOF
Aug 9 02:10:38.095235469 (8h45m0.054332713s) [noise=true , address=79.127.201.215:4344 , piece_id=GMLUHW4RJO2B5CA3FRJXREMPPA3GI5UAJ75MCKSPWCMDB4XZTB3A, seg_pos={0 0}, upload=9072]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 9 02:10:38.095344994 (8h45m0.054442225s) [noise=true , address=79.127.201.215:4346 , piece_id=A4ZZJR37JVXZJENDXEPEWRHOXWGJJIQWMNDJDP3K4AYTFWBBRZVA, seg_pos={0 0}, upload=9072]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: expected piece hash; context canceled; EOF
Aug 9 02:10:38.095490516 (8h45m0.054587748s) [noise=true , address=64.49.13.27:4965 , piece_id=RY6ZCWIZLZJ5ODB5VQL5HHLAWMVCPR3DGFA2EHJK7YX3PD64ICCQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WVhm2QyhAf1y6HXRpyChMLbDLhZJQHEE2kQpstZH2dkwNhd7P): protocol: write tcp 139.59.144.22:60048->64.49.13.27:4965: use of closed network connection; write tcp 139.59.144.22:60048->64.49.13.27:4965: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60048->64.49.13.27:4965: use of closed network connection
Aug 9 02:10:38.095501617 (8h45m0.054598848s) [seg_pos={0 0}, upload=9072]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 02:10:38.095587096 (8h45m0.054684328s) [upload=9072]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 02:10:38.095591184 (8h45m0.054688416s) [upload=9072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 02:10:38.283711477 (8h45m0.242808728s) [upload=9072]: Done uploading segments...
Aug 9 02:10:38.283731544 (8h45m0.242828775s) [upload=9072]: Upload finished. err: <nil>
Duration: 2.398417832s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........X.........................................X.......] duration:
2.400681836s
FAIL (2025-08-09 02:15:49 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 9 02:10:37.079080615 (8h44m59.038177867s) [upload=9072]: Starting upload
Aug 9 02:10:37.079168398 (8h44m59.038265647s) [upload=9072]: Done starting upload
Aug 9 02:10:37.079251655 (8h44m59.038348893s) [upload=9072]: Uploading segments...
Aug 9 02:10:37.079463912 (8h44m59.038561158s) [upload=9072]: Got next segment. Inline: false
Aug 9 02:10:37.079516285 (8h44m59.03861353s) [upload=9072]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 02:10:37.079521467 (8h44m59.038618702s) [upload=9072]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 02:10:37.281443152 (8h44m59.240540403s) [seg_pos={0 0}, upload=9072]: Begin upload segment...
Aug 9 02:10:37.281501467 (8h44m59.240598711s) [seg_pos={0 0}, upload=9072]: Done begin upload segment.
Aug 9 02:10:37.281533149 (8h44m59.240630384s) [noise=true , address=79.127.219.51:4185 , piece_id=YEKJOTAO5GNJJ4EXXZQ67PBOEVF5CMRWS2YILIWEYH7SPCYDJDFQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.281542503 (8h44m59.24063975s) [noise=true , address=45.91.116.13:4157 , piece_id=NF2U6KEPFJJES3LLLPMEXW2D4TQGIRZXCBZKYRKP6WDVTQZG3Z5A, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.281978435 (8h44m59.241075686s) [noise=true , address=104.36.82.38:4700 , piece_id=MOOI5GCJ6U2SOZ6CXSFCXJ3EM33ILXQKUKZGHDNQAWFQZCR6FA5A, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.282035638 (8h44m59.24113289s) [noise=true , address=104.36.82.36:4628 , piece_id=NXQCJWOKEPWPHWLUA2LN33NY2K4T6MBADP6UZHDXCOSZ3IVTU7QA, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.282365897 (8h44m59.241463153s) [noise=true , address=104.36.82.8:4983 , piece_id=7Z3ESXBUZPGZ4B3UOBGJMQTLIORRPYGISSWBVBGPJ5NZLBUSYQQQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.282519577 (8h44m59.241616826s) [noise=true , address=104.36.82.3:4792 , piece_id=3EICKVTJG3WKIVW7NSTAOJF6MHIR535WZ2DWPBZWGDBEKAW2UAIQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.282775377 (8h44m59.241872638s) [noise=true , address=64.49.13.27:4965 , piece_id=RY6ZCWIZLZJ5ODB5VQL5HHLAWMVCPR3DGFA2EHJK7YX3PD64ICCQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.282945943 (8h44m59.242043197s) [noise=true , address=79.127.201.215:4346 , piece_id=A4ZZJR37JVXZJENDXEPEWRHOXWGJJIQWMNDJDP3K4AYTFWBBRZVA, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.283249037 (8h44m59.242346294s) [noise=true , address=104.36.82.34:4555 , piece_id=FDBGAOUH2TNFRWOUVOUITLKDMEF3DTR7LZ366XU7IIBLPM7754MQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.283497868 (8h44m59.242595117s) [noise=true , address=104.36.82.47:4535 , piece_id=GSW3JTWTFKGNPBQESXRFXE4MJMURCGR3CWA5A5X2NHE3WBQXW7MQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.283697787 (8h44m59.242795043s) [noise=true , address=104.36.82.37:4667 , piece_id=CAYYHPWFW3WMLNS4U4LKB7ZBDTS4XK7R2ECH6B4JLFECFVEG4J2A, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.283923629 (8h44m59.243020879s) [noise=true , address=79.127.201.215:4344 , piece_id=GMLUHW4RJO2B5CA3FRJXREMPPA3GI5UAJ75MCKSPWCMDB4XZTB3A, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.284070531 (8h44m59.2431678s) [noise=true , address=104.36.82.59:4336 , piece_id=XKEMPPIYH3H3G2MBNNTTFLOYDNTLH6XZIDS3GAMJBRBTUSRPD2IA, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.284320294 (8h44m59.243417527s) [noise=true , address=104.36.82.62:4433 , piece_id=A5M2AO7CLC4GED6GT3ZW72NXSHTFAADOBWAPIQCDMKIJWSQSM7OQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.284484469 (8h44m59.243581723s) [noise=true , address=104.36.82.44:4896 , piece_id=LH3KS6YE4VX4TNUPTJSGMKQZH6XNFIGEG4QCI6RSEZCGTGRGUKIA, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.284875568 (8h44m59.243972872s) [noise=true , address=104.36.82.14:4238 , piece_id=TKXGQSYKRGK4APMPZ2SM62LE7SBLDLNBNQJKGQQNROVQC3V57XEQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.285200545 (8h44m59.244297797s) [noise=true , address=104.36.82.42:4825 , piece_id=CLIXDVX5I3Z7AMDAJH7YDSIM4HURCGTTNUOKPGKWUS44GXFWWGHQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.285531356 (8h44m59.244628595s) [noise=true , address=104.36.82.39:4746 , piece_id=6RWW23FF6YXXHCW6C6NPQUE5VZQT5PVKVSI3QIILPNVJHYYBA4FA, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.857401850 (8h44m59.816499088s) [upload=9072]: Next returned nil segment
Aug 9 02:10:37.857420190 (8h44m59.816517435s) [upload=9072]: Waiting for error group managing segments...
Aug 9 02:10:38.002192174 (8h44m59.961289461s) [noise=true , address=45.91.116.13:4157 , piece_id=NF2U6KEPFJJES3LLLPMEXW2D4TQGIRZXCBZKYRKP6WDVTQZG3Z5A, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.008516068 (8h44m59.967613307s) [noise=true , address=104.36.82.37:4667 , piece_id=CAYYHPWFW3WMLNS4U4LKB7ZBDTS4XK7R2ECH6B4JLFECFVEG4J2A, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.010892791 (8h44m59.969990029s) [noise=true , address=104.36.82.38:4700 , piece_id=MOOI5GCJ6U2SOZ6CXSFCXJ3EM33ILXQKUKZGHDNQAWFQZCR6FA5A, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.015403350 (8h44m59.974500596s) [noise=true , address=104.36.82.3:4792 , piece_id=3EICKVTJG3WKIVW7NSTAOJF6MHIR535WZ2DWPBZWGDBEKAW2UAIQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.021945896 (8h44m59.981043141s) [noise=true , address=104.36.82.62:4433 , piece_id=A5M2AO7CLC4GED6GT3ZW72NXSHTFAADOBWAPIQCDMKIJWSQSM7OQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.022623812 (8h44m59.981721043s) [noise=true , address=104.36.82.36:4628 , piece_id=NXQCJWOKEPWPHWLUA2LN33NY2K4T6MBADP6UZHDXCOSZ3IVTU7QA, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.025268193 (8h44m59.984365438s) [noise=true , address=104.36.82.47:4535 , piece_id=GSW3JTWTFKGNPBQESXRFXE4MJMURCGR3CWA5A5X2NHE3WBQXW7MQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.029831147 (8h44m59.988928379s) [noise=true , address=104.36.82.42:4825 , piece_id=CLIXDVX5I3Z7AMDAJH7YDSIM4HURCGTTNUOKPGKWUS44GXFWWGHQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.031361897 (8h44m59.990459143s) [noise=true , address=104.36.82.39:4746 , piece_id=6RWW23FF6YXXHCW6C6NPQUE5VZQT5PVKVSI3QIILPNVJHYYBA4FA, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.031724328 (8h44m59.990821567s) [noise=true , address=104.36.82.14:4238 , piece_id=TKXGQSYKRGK4APMPZ2SM62LE7SBLDLNBNQJKGQQNROVQC3V57XEQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.034015821 (8h44m59.993113059s) [noise=true , address=104.36.82.8:4983 , piece_id=7Z3ESXBUZPGZ4B3UOBGJMQTLIORRPYGISSWBVBGPJ5NZLBUSYQQQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.039241260 (8h44m59.998338494s) [noise=true , address=104.36.82.34:4555 , piece_id=FDBGAOUH2TNFRWOUVOUITLKDMEF3DTR7LZ366XU7IIBLPM7754MQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.084935610 (8h45m0.044032847s) [noise=true , address=79.127.219.51:4185 , piece_id=YEKJOTAO5GNJJ4EXXZQ67PBOEVF5CMRWS2YILIWEYH7SPCYDJDFQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.094851780 (8h45m0.053949012s) [noise=true , address=104.36.82.59:4336 , piece_id=XKEMPPIYH3H3G2MBNNTTFLOYDNTLH6XZIDS3GAMJBRBTUSRPD2IA, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.094888338 (8h45m0.053985583s) [seg_pos={0 0}, upload=9072]: Segment reached optimal threshold of 14 pieces.
Aug 9 02:10:38.095192665 (8h45m0.054289897s) [noise=true , address=104.36.82.44:4896 , piece_id=LH3KS6YE4VX4TNUPTJSGMKQZH6XNFIGEG4QCI6RSEZCGTGRGUKIA, seg_pos={0 0}, upload=9072]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o): protocol: expected piece hash; context canceled; EOF
Aug 9 02:10:38.095235469 (8h45m0.054332713s) [noise=true , address=79.127.201.215:4344 , piece_id=GMLUHW4RJO2B5CA3FRJXREMPPA3GI5UAJ75MCKSPWCMDB4XZTB3A, seg_pos={0 0}, upload=9072]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 9 02:10:38.095344994 (8h45m0.054442225s) [noise=true , address=79.127.201.215:4346 , piece_id=A4ZZJR37JVXZJENDXEPEWRHOXWGJJIQWMNDJDP3K4AYTFWBBRZVA, seg_pos={0 0}, upload=9072]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: expected piece hash; context canceled; EOF
Aug 9 02:10:38.095490516 (8h45m0.054587748s) [noise=true , address=64.49.13.27:4965 , piece_id=RY6ZCWIZLZJ5ODB5VQL5HHLAWMVCPR3DGFA2EHJK7YX3PD64ICCQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WVhm2QyhAf1y6HXRpyChMLbDLhZJQHEE2kQpstZH2dkwNhd7P): protocol: write tcp 139.59.144.22:60048->64.49.13.27:4965: use of closed network connection; write tcp 139.59.144.22:60048->64.49.13.27:4965: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60048->64.49.13.27:4965: use of closed network connection
Aug 9 02:10:38.095501617 (8h45m0.054598848s) [seg_pos={0 0}, upload=9072]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 02:10:38.095587096 (8h45m0.054684328s) [upload=9072]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 02:10:38.095591184 (8h45m0.054688416s) [upload=9072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 02:10:38.283711477 (8h45m0.242808728s) [upload=9072]: Done uploading segments...
Aug 9 02:10:38.283731544 (8h45m0.242828775s) [upload=9072]: Upload finished. err: <nil>
Duration: 2.400710901s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....X.....................................X................] duration:
869.465424ms
FAIL (2025-08-09 02:15:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:04:31.977231824 (8h38m53.93632908s) [upload=8967]: Starting upload Aug 9 02:04:31.977318166 (8h38m53.936415419s) [upload=8967]: Done starting upload Aug 9 02:04:31.977468417 (8h38m53.936565654s) [upload=8967]: Uploading segments... Aug 9 02:04:31.977561216 (8h38m53.93665847s) [upload=8967]: Got next segment. Inline: true Aug 9 02:04:31.977569010 (8h38m53.936666256s) [upload=8967]: Waiting for error group managing segments... Aug 9 02:04:31.977632258 (8h38m53.936729507s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 02:04:31.977637624 (8h38m53.936734872s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 02:04:31.977641013 (8h38m53.936738258s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 02:04:32.067582835 (8h38m54.02668009s) [upload=8967]: Done uploading segments... Aug 9 02:04:32.067611492 (8h38m54.026708745s) [upload=8967]: Upload finished. err: metaclient: Too Many Requests
Duration: 869.492449ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [X..........X.........................................X......] duration:
3.248283033s
FAIL (2025-08-09 02:15:11 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 9 02:10:37.079080615 (8h44m59.038177867s) [upload=9072]: Starting upload
Aug 9 02:10:37.079168398 (8h44m59.038265647s) [upload=9072]: Done starting upload
Aug 9 02:10:37.079251655 (8h44m59.038348893s) [upload=9072]: Uploading segments...
Aug 9 02:10:37.079463912 (8h44m59.038561158s) [upload=9072]: Got next segment. Inline: false
Aug 9 02:10:37.079516285 (8h44m59.03861353s) [upload=9072]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 02:10:37.079521467 (8h44m59.038618702s) [upload=9072]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 02:10:37.281443152 (8h44m59.240540403s) [seg_pos={0 0}, upload=9072]: Begin upload segment...
Aug 9 02:10:37.281501467 (8h44m59.240598711s) [seg_pos={0 0}, upload=9072]: Done begin upload segment.
Aug 9 02:10:37.281533149 (8h44m59.240630384s) [noise=true , address=79.127.219.51:4185 , piece_id=YEKJOTAO5GNJJ4EXXZQ67PBOEVF5CMRWS2YILIWEYH7SPCYDJDFQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.281542503 (8h44m59.24063975s) [noise=true , address=45.91.116.13:4157 , piece_id=NF2U6KEPFJJES3LLLPMEXW2D4TQGIRZXCBZKYRKP6WDVTQZG3Z5A, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.281978435 (8h44m59.241075686s) [noise=true , address=104.36.82.38:4700 , piece_id=MOOI5GCJ6U2SOZ6CXSFCXJ3EM33ILXQKUKZGHDNQAWFQZCR6FA5A, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.282035638 (8h44m59.24113289s) [noise=true , address=104.36.82.36:4628 , piece_id=NXQCJWOKEPWPHWLUA2LN33NY2K4T6MBADP6UZHDXCOSZ3IVTU7QA, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.282365897 (8h44m59.241463153s) [noise=true , address=104.36.82.8:4983 , piece_id=7Z3ESXBUZPGZ4B3UOBGJMQTLIORRPYGISSWBVBGPJ5NZLBUSYQQQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.282519577 (8h44m59.241616826s) [noise=true , address=104.36.82.3:4792 , piece_id=3EICKVTJG3WKIVW7NSTAOJF6MHIR535WZ2DWPBZWGDBEKAW2UAIQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.282775377 (8h44m59.241872638s) [noise=true , address=64.49.13.27:4965 , piece_id=RY6ZCWIZLZJ5ODB5VQL5HHLAWMVCPR3DGFA2EHJK7YX3PD64ICCQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.282945943 (8h44m59.242043197s) [noise=true , address=79.127.201.215:4346 , piece_id=A4ZZJR37JVXZJENDXEPEWRHOXWGJJIQWMNDJDP3K4AYTFWBBRZVA, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.283249037 (8h44m59.242346294s) [noise=true , address=104.36.82.34:4555 , piece_id=FDBGAOUH2TNFRWOUVOUITLKDMEF3DTR7LZ366XU7IIBLPM7754MQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.283497868 (8h44m59.242595117s) [noise=true , address=104.36.82.47:4535 , piece_id=GSW3JTWTFKGNPBQESXRFXE4MJMURCGR3CWA5A5X2NHE3WBQXW7MQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.283697787 (8h44m59.242795043s) [noise=true , address=104.36.82.37:4667 , piece_id=CAYYHPWFW3WMLNS4U4LKB7ZBDTS4XK7R2ECH6B4JLFECFVEG4J2A, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.283923629 (8h44m59.243020879s) [noise=true , address=79.127.201.215:4344 , piece_id=GMLUHW4RJO2B5CA3FRJXREMPPA3GI5UAJ75MCKSPWCMDB4XZTB3A, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.284070531 (8h44m59.2431678s) [noise=true , address=104.36.82.59:4336 , piece_id=XKEMPPIYH3H3G2MBNNTTFLOYDNTLH6XZIDS3GAMJBRBTUSRPD2IA, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.284320294 (8h44m59.243417527s) [noise=true , address=104.36.82.62:4433 , piece_id=A5M2AO7CLC4GED6GT3ZW72NXSHTFAADOBWAPIQCDMKIJWSQSM7OQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.284484469 (8h44m59.243581723s) [noise=true , address=104.36.82.44:4896 , piece_id=LH3KS6YE4VX4TNUPTJSGMKQZH6XNFIGEG4QCI6RSEZCGTGRGUKIA, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.284875568 (8h44m59.243972872s) [noise=true , address=104.36.82.14:4238 , piece_id=TKXGQSYKRGK4APMPZ2SM62LE7SBLDLNBNQJKGQQNROVQC3V57XEQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.285200545 (8h44m59.244297797s) [noise=true , address=104.36.82.42:4825 , piece_id=CLIXDVX5I3Z7AMDAJH7YDSIM4HURCGTTNUOKPGKWUS44GXFWWGHQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.285531356 (8h44m59.244628595s) [noise=true , address=104.36.82.39:4746 , piece_id=6RWW23FF6YXXHCW6C6NPQUE5VZQT5PVKVSI3QIILPNVJHYYBA4FA, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.857401850 (8h44m59.816499088s) [upload=9072]: Next returned nil segment
Aug 9 02:10:37.857420190 (8h44m59.816517435s) [upload=9072]: Waiting for error group managing segments...
Aug 9 02:10:38.002192174 (8h44m59.961289461s) [noise=true , address=45.91.116.13:4157 , piece_id=NF2U6KEPFJJES3LLLPMEXW2D4TQGIRZXCBZKYRKP6WDVTQZG3Z5A, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.008516068 (8h44m59.967613307s) [noise=true , address=104.36.82.37:4667 , piece_id=CAYYHPWFW3WMLNS4U4LKB7ZBDTS4XK7R2ECH6B4JLFECFVEG4J2A, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.010892791 (8h44m59.969990029s) [noise=true , address=104.36.82.38:4700 , piece_id=MOOI5GCJ6U2SOZ6CXSFCXJ3EM33ILXQKUKZGHDNQAWFQZCR6FA5A, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.015403350 (8h44m59.974500596s) [noise=true , address=104.36.82.3:4792 , piece_id=3EICKVTJG3WKIVW7NSTAOJF6MHIR535WZ2DWPBZWGDBEKAW2UAIQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.021945896 (8h44m59.981043141s) [noise=true , address=104.36.82.62:4433 , piece_id=A5M2AO7CLC4GED6GT3ZW72NXSHTFAADOBWAPIQCDMKIJWSQSM7OQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.022623812 (8h44m59.981721043s) [noise=true , address=104.36.82.36:4628 , piece_id=NXQCJWOKEPWPHWLUA2LN33NY2K4T6MBADP6UZHDXCOSZ3IVTU7QA, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.025268193 (8h44m59.984365438s) [noise=true , address=104.36.82.47:4535 , piece_id=GSW3JTWTFKGNPBQESXRFXE4MJMURCGR3CWA5A5X2NHE3WBQXW7MQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.029831147 (8h44m59.988928379s) [noise=true , address=104.36.82.42:4825 , piece_id=CLIXDVX5I3Z7AMDAJH7YDSIM4HURCGTTNUOKPGKWUS44GXFWWGHQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.031361897 (8h44m59.990459143s) [noise=true , address=104.36.82.39:4746 , piece_id=6RWW23FF6YXXHCW6C6NPQUE5VZQT5PVKVSI3QIILPNVJHYYBA4FA, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.031724328 (8h44m59.990821567s) [noise=true , address=104.36.82.14:4238 , piece_id=TKXGQSYKRGK4APMPZ2SM62LE7SBLDLNBNQJKGQQNROVQC3V57XEQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.034015821 (8h44m59.993113059s) [noise=true , address=104.36.82.8:4983 , piece_id=7Z3ESXBUZPGZ4B3UOBGJMQTLIORRPYGISSWBVBGPJ5NZLBUSYQQQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.039241260 (8h44m59.998338494s) [noise=true , address=104.36.82.34:4555 , piece_id=FDBGAOUH2TNFRWOUVOUITLKDMEF3DTR7LZ366XU7IIBLPM7754MQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.084935610 (8h45m0.044032847s) [noise=true , address=79.127.219.51:4185 , piece_id=YEKJOTAO5GNJJ4EXXZQ67PBOEVF5CMRWS2YILIWEYH7SPCYDJDFQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.094851780 (8h45m0.053949012s) [noise=true , address=104.36.82.59:4336 , piece_id=XKEMPPIYH3H3G2MBNNTTFLOYDNTLH6XZIDS3GAMJBRBTUSRPD2IA, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.094888338 (8h45m0.053985583s) [seg_pos={0 0}, upload=9072]: Segment reached optimal threshold of 14 pieces.
Aug 9 02:10:38.095192665 (8h45m0.054289897s) [noise=true , address=104.36.82.44:4896 , piece_id=LH3KS6YE4VX4TNUPTJSGMKQZH6XNFIGEG4QCI6RSEZCGTGRGUKIA, seg_pos={0 0}, upload=9072]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o): protocol: expected piece hash; context canceled; EOF
Aug 9 02:10:38.095235469 (8h45m0.054332713s) [noise=true , address=79.127.201.215:4344 , piece_id=GMLUHW4RJO2B5CA3FRJXREMPPA3GI5UAJ75MCKSPWCMDB4XZTB3A, seg_pos={0 0}, upload=9072]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 9 02:10:38.095344994 (8h45m0.054442225s) [noise=true , address=79.127.201.215:4346 , piece_id=A4ZZJR37JVXZJENDXEPEWRHOXWGJJIQWMNDJDP3K4AYTFWBBRZVA, seg_pos={0 0}, upload=9072]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: expected piece hash; context canceled; EOF
Aug 9 02:10:38.095490516 (8h45m0.054587748s) [noise=true , address=64.49.13.27:4965 , piece_id=RY6ZCWIZLZJ5ODB5VQL5HHLAWMVCPR3DGFA2EHJK7YX3PD64ICCQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WVhm2QyhAf1y6HXRpyChMLbDLhZJQHEE2kQpstZH2dkwNhd7P): protocol: write tcp 139.59.144.22:60048->64.49.13.27:4965: use of closed network connection; write tcp 139.59.144.22:60048->64.49.13.27:4965: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60048->64.49.13.27:4965: use of closed network connection
Aug 9 02:10:38.095501617 (8h45m0.054598848s) [seg_pos={0 0}, upload=9072]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 02:10:38.095587096 (8h45m0.054684328s) [upload=9072]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 02:10:38.095591184 (8h45m0.054688416s) [upload=9072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 02:10:38.283711477 (8h45m0.242808728s) [upload=9072]: Done uploading segments...
Aug 9 02:10:38.283731544 (8h45m0.242828775s) [upload=9072]: Upload finished. err: <nil>
Duration: 3.248330184s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......X.....................................X...............] duration:
918.336963ms
FAIL (2025-08-09 02:14:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:04:31.977231824 (8h38m53.93632908s) [upload=8967]: Starting upload Aug 9 02:04:31.977318166 (8h38m53.936415419s) [upload=8967]: Done starting upload Aug 9 02:04:31.977468417 (8h38m53.936565654s) [upload=8967]: Uploading segments... Aug 9 02:04:31.977561216 (8h38m53.93665847s) [upload=8967]: Got next segment. Inline: true Aug 9 02:04:31.977569010 (8h38m53.936666256s) [upload=8967]: Waiting for error group managing segments... Aug 9 02:04:31.977632258 (8h38m53.936729507s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 02:04:31.977637624 (8h38m53.936734872s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 02:04:31.977641013 (8h38m53.936738258s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 02:04:32.067582835 (8h38m54.02668009s) [upload=8967]: Done uploading segments... Aug 9 02:04:32.067611492 (8h38m54.026708745s) [upload=8967]: Upload finished. err: metaclient: Too Many Requests
Duration: 918.365093ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X..........X.........................................X.....] duration:
2.451015226s
FAIL (2025-08-09 02:14:39 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 9 02:10:37.079080615 (8h44m59.038177867s) [upload=9072]: Starting upload
Aug 9 02:10:37.079168398 (8h44m59.038265647s) [upload=9072]: Done starting upload
Aug 9 02:10:37.079251655 (8h44m59.038348893s) [upload=9072]: Uploading segments...
Aug 9 02:10:37.079463912 (8h44m59.038561158s) [upload=9072]: Got next segment. Inline: false
Aug 9 02:10:37.079516285 (8h44m59.03861353s) [upload=9072]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 02:10:37.079521467 (8h44m59.038618702s) [upload=9072]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 02:10:37.281443152 (8h44m59.240540403s) [seg_pos={0 0}, upload=9072]: Begin upload segment...
Aug 9 02:10:37.281501467 (8h44m59.240598711s) [seg_pos={0 0}, upload=9072]: Done begin upload segment.
Aug 9 02:10:37.281533149 (8h44m59.240630384s) [noise=true , address=79.127.219.51:4185 , piece_id=YEKJOTAO5GNJJ4EXXZQ67PBOEVF5CMRWS2YILIWEYH7SPCYDJDFQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.281542503 (8h44m59.24063975s) [noise=true , address=45.91.116.13:4157 , piece_id=NF2U6KEPFJJES3LLLPMEXW2D4TQGIRZXCBZKYRKP6WDVTQZG3Z5A, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.281978435 (8h44m59.241075686s) [noise=true , address=104.36.82.38:4700 , piece_id=MOOI5GCJ6U2SOZ6CXSFCXJ3EM33ILXQKUKZGHDNQAWFQZCR6FA5A, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.282035638 (8h44m59.24113289s) [noise=true , address=104.36.82.36:4628 , piece_id=NXQCJWOKEPWPHWLUA2LN33NY2K4T6MBADP6UZHDXCOSZ3IVTU7QA, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.282365897 (8h44m59.241463153s) [noise=true , address=104.36.82.8:4983 , piece_id=7Z3ESXBUZPGZ4B3UOBGJMQTLIORRPYGISSWBVBGPJ5NZLBUSYQQQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.282519577 (8h44m59.241616826s) [noise=true , address=104.36.82.3:4792 , piece_id=3EICKVTJG3WKIVW7NSTAOJF6MHIR535WZ2DWPBZWGDBEKAW2UAIQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.282775377 (8h44m59.241872638s) [noise=true , address=64.49.13.27:4965 , piece_id=RY6ZCWIZLZJ5ODB5VQL5HHLAWMVCPR3DGFA2EHJK7YX3PD64ICCQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.282945943 (8h44m59.242043197s) [noise=true , address=79.127.201.215:4346 , piece_id=A4ZZJR37JVXZJENDXEPEWRHOXWGJJIQWMNDJDP3K4AYTFWBBRZVA, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.283249037 (8h44m59.242346294s) [noise=true , address=104.36.82.34:4555 , piece_id=FDBGAOUH2TNFRWOUVOUITLKDMEF3DTR7LZ366XU7IIBLPM7754MQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.283497868 (8h44m59.242595117s) [noise=true , address=104.36.82.47:4535 , piece_id=GSW3JTWTFKGNPBQESXRFXE4MJMURCGR3CWA5A5X2NHE3WBQXW7MQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.283697787 (8h44m59.242795043s) [noise=true , address=104.36.82.37:4667 , piece_id=CAYYHPWFW3WMLNS4U4LKB7ZBDTS4XK7R2ECH6B4JLFECFVEG4J2A, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.283923629 (8h44m59.243020879s) [noise=true , address=79.127.201.215:4344 , piece_id=GMLUHW4RJO2B5CA3FRJXREMPPA3GI5UAJ75MCKSPWCMDB4XZTB3A, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.284070531 (8h44m59.2431678s) [noise=true , address=104.36.82.59:4336 , piece_id=XKEMPPIYH3H3G2MBNNTTFLOYDNTLH6XZIDS3GAMJBRBTUSRPD2IA, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.284320294 (8h44m59.243417527s) [noise=true , address=104.36.82.62:4433 , piece_id=A5M2AO7CLC4GED6GT3ZW72NXSHTFAADOBWAPIQCDMKIJWSQSM7OQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.284484469 (8h44m59.243581723s) [noise=true , address=104.36.82.44:4896 , piece_id=LH3KS6YE4VX4TNUPTJSGMKQZH6XNFIGEG4QCI6RSEZCGTGRGUKIA, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.284875568 (8h44m59.243972872s) [noise=true , address=104.36.82.14:4238 , piece_id=TKXGQSYKRGK4APMPZ2SM62LE7SBLDLNBNQJKGQQNROVQC3V57XEQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.285200545 (8h44m59.244297797s) [noise=true , address=104.36.82.42:4825 , piece_id=CLIXDVX5I3Z7AMDAJH7YDSIM4HURCGTTNUOKPGKWUS44GXFWWGHQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.285531356 (8h44m59.244628595s) [noise=true , address=104.36.82.39:4746 , piece_id=6RWW23FF6YXXHCW6C6NPQUE5VZQT5PVKVSI3QIILPNVJHYYBA4FA, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.857401850 (8h44m59.816499088s) [upload=9072]: Next returned nil segment
Aug 9 02:10:37.857420190 (8h44m59.816517435s) [upload=9072]: Waiting for error group managing segments...
Aug 9 02:10:38.002192174 (8h44m59.961289461s) [noise=true , address=45.91.116.13:4157 , piece_id=NF2U6KEPFJJES3LLLPMEXW2D4TQGIRZXCBZKYRKP6WDVTQZG3Z5A, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.008516068 (8h44m59.967613307s) [noise=true , address=104.36.82.37:4667 , piece_id=CAYYHPWFW3WMLNS4U4LKB7ZBDTS4XK7R2ECH6B4JLFECFVEG4J2A, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.010892791 (8h44m59.969990029s) [noise=true , address=104.36.82.38:4700 , piece_id=MOOI5GCJ6U2SOZ6CXSFCXJ3EM33ILXQKUKZGHDNQAWFQZCR6FA5A, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.015403350 (8h44m59.974500596s) [noise=true , address=104.36.82.3:4792 , piece_id=3EICKVTJG3WKIVW7NSTAOJF6MHIR535WZ2DWPBZWGDBEKAW2UAIQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.021945896 (8h44m59.981043141s) [noise=true , address=104.36.82.62:4433 , piece_id=A5M2AO7CLC4GED6GT3ZW72NXSHTFAADOBWAPIQCDMKIJWSQSM7OQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.022623812 (8h44m59.981721043s) [noise=true , address=104.36.82.36:4628 , piece_id=NXQCJWOKEPWPHWLUA2LN33NY2K4T6MBADP6UZHDXCOSZ3IVTU7QA, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.025268193 (8h44m59.984365438s) [noise=true , address=104.36.82.47:4535 , piece_id=GSW3JTWTFKGNPBQESXRFXE4MJMURCGR3CWA5A5X2NHE3WBQXW7MQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.029831147 (8h44m59.988928379s) [noise=true , address=104.36.82.42:4825 , piece_id=CLIXDVX5I3Z7AMDAJH7YDSIM4HURCGTTNUOKPGKWUS44GXFWWGHQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.031361897 (8h44m59.990459143s) [noise=true , address=104.36.82.39:4746 , piece_id=6RWW23FF6YXXHCW6C6NPQUE5VZQT5PVKVSI3QIILPNVJHYYBA4FA, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.031724328 (8h44m59.990821567s) [noise=true , address=104.36.82.14:4238 , piece_id=TKXGQSYKRGK4APMPZ2SM62LE7SBLDLNBNQJKGQQNROVQC3V57XEQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.034015821 (8h44m59.993113059s) [noise=true , address=104.36.82.8:4983 , piece_id=7Z3ESXBUZPGZ4B3UOBGJMQTLIORRPYGISSWBVBGPJ5NZLBUSYQQQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.039241260 (8h44m59.998338494s) [noise=true , address=104.36.82.34:4555 , piece_id=FDBGAOUH2TNFRWOUVOUITLKDMEF3DTR7LZ366XU7IIBLPM7754MQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.084935610 (8h45m0.044032847s) [noise=true , address=79.127.219.51:4185 , piece_id=YEKJOTAO5GNJJ4EXXZQ67PBOEVF5CMRWS2YILIWEYH7SPCYDJDFQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.094851780 (8h45m0.053949012s) [noise=true , address=104.36.82.59:4336 , piece_id=XKEMPPIYH3H3G2MBNNTTFLOYDNTLH6XZIDS3GAMJBRBTUSRPD2IA, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.094888338 (8h45m0.053985583s) [seg_pos={0 0}, upload=9072]: Segment reached optimal threshold of 14 pieces.
Aug 9 02:10:38.095192665 (8h45m0.054289897s) [noise=true , address=104.36.82.44:4896 , piece_id=LH3KS6YE4VX4TNUPTJSGMKQZH6XNFIGEG4QCI6RSEZCGTGRGUKIA, seg_pos={0 0}, upload=9072]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o): protocol: expected piece hash; context canceled; EOF
Aug 9 02:10:38.095235469 (8h45m0.054332713s) [noise=true , address=79.127.201.215:4344 , piece_id=GMLUHW4RJO2B5CA3FRJXREMPPA3GI5UAJ75MCKSPWCMDB4XZTB3A, seg_pos={0 0}, upload=9072]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 9 02:10:38.095344994 (8h45m0.054442225s) [noise=true , address=79.127.201.215:4346 , piece_id=A4ZZJR37JVXZJENDXEPEWRHOXWGJJIQWMNDJDP3K4AYTFWBBRZVA, seg_pos={0 0}, upload=9072]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: expected piece hash; context canceled; EOF
Aug 9 02:10:38.095490516 (8h45m0.054587748s) [noise=true , address=64.49.13.27:4965 , piece_id=RY6ZCWIZLZJ5ODB5VQL5HHLAWMVCPR3DGFA2EHJK7YX3PD64ICCQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WVhm2QyhAf1y6HXRpyChMLbDLhZJQHEE2kQpstZH2dkwNhd7P): protocol: write tcp 139.59.144.22:60048->64.49.13.27:4965: use of closed network connection; write tcp 139.59.144.22:60048->64.49.13.27:4965: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60048->64.49.13.27:4965: use of closed network connection
Aug 9 02:10:38.095501617 (8h45m0.054598848s) [seg_pos={0 0}, upload=9072]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 02:10:38.095587096 (8h45m0.054684328s) [upload=9072]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 02:10:38.095591184 (8h45m0.054688416s) [upload=9072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 02:10:38.283711477 (8h45m0.242808728s) [upload=9072]: Done uploading segments...
Aug 9 02:10:38.283731544 (8h45m0.242828775s) [upload=9072]: Upload finished. err: <nil>
Duration: 2.451073309s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......X.....................................X..............] duration:
864.354279ms
FAIL (2025-08-09 02:13:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:04:31.977231824 (8h38m53.93632908s) [upload=8967]: Starting upload Aug 9 02:04:31.977318166 (8h38m53.936415419s) [upload=8967]: Done starting upload Aug 9 02:04:31.977468417 (8h38m53.936565654s) [upload=8967]: Uploading segments... Aug 9 02:04:31.977561216 (8h38m53.93665847s) [upload=8967]: Got next segment. Inline: true Aug 9 02:04:31.977569010 (8h38m53.936666256s) [upload=8967]: Waiting for error group managing segments... Aug 9 02:04:31.977632258 (8h38m53.936729507s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 02:04:31.977637624 (8h38m53.936734872s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 02:04:31.977641013 (8h38m53.936738258s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 02:04:32.067582835 (8h38m54.02668009s) [upload=8967]: Done uploading segments... Aug 9 02:04:32.067611492 (8h38m54.026708745s) [upload=8967]: Upload finished. err: metaclient: Too Many Requests
Duration: 864.384974ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X..........X.........................................X....] duration:
2.435556909s
FAIL (2025-08-09 02:13:46 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 9 02:10:37.079080615 (8h44m59.038177867s) [upload=9072]: Starting upload
Aug 9 02:10:37.079168398 (8h44m59.038265647s) [upload=9072]: Done starting upload
Aug 9 02:10:37.079251655 (8h44m59.038348893s) [upload=9072]: Uploading segments...
Aug 9 02:10:37.079463912 (8h44m59.038561158s) [upload=9072]: Got next segment. Inline: false
Aug 9 02:10:37.079516285 (8h44m59.03861353s) [upload=9072]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 02:10:37.079521467 (8h44m59.038618702s) [upload=9072]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 02:10:37.281443152 (8h44m59.240540403s) [seg_pos={0 0}, upload=9072]: Begin upload segment...
Aug 9 02:10:37.281501467 (8h44m59.240598711s) [seg_pos={0 0}, upload=9072]: Done begin upload segment.
Aug 9 02:10:37.281533149 (8h44m59.240630384s) [noise=true , address=79.127.219.51:4185 , piece_id=YEKJOTAO5GNJJ4EXXZQ67PBOEVF5CMRWS2YILIWEYH7SPCYDJDFQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.281542503 (8h44m59.24063975s) [noise=true , address=45.91.116.13:4157 , piece_id=NF2U6KEPFJJES3LLLPMEXW2D4TQGIRZXCBZKYRKP6WDVTQZG3Z5A, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.281978435 (8h44m59.241075686s) [noise=true , address=104.36.82.38:4700 , piece_id=MOOI5GCJ6U2SOZ6CXSFCXJ3EM33ILXQKUKZGHDNQAWFQZCR6FA5A, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.282035638 (8h44m59.24113289s) [noise=true , address=104.36.82.36:4628 , piece_id=NXQCJWOKEPWPHWLUA2LN33NY2K4T6MBADP6UZHDXCOSZ3IVTU7QA, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.282365897 (8h44m59.241463153s) [noise=true , address=104.36.82.8:4983 , piece_id=7Z3ESXBUZPGZ4B3UOBGJMQTLIORRPYGISSWBVBGPJ5NZLBUSYQQQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.282519577 (8h44m59.241616826s) [noise=true , address=104.36.82.3:4792 , piece_id=3EICKVTJG3WKIVW7NSTAOJF6MHIR535WZ2DWPBZWGDBEKAW2UAIQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.282775377 (8h44m59.241872638s) [noise=true , address=64.49.13.27:4965 , piece_id=RY6ZCWIZLZJ5ODB5VQL5HHLAWMVCPR3DGFA2EHJK7YX3PD64ICCQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.282945943 (8h44m59.242043197s) [noise=true , address=79.127.201.215:4346 , piece_id=A4ZZJR37JVXZJENDXEPEWRHOXWGJJIQWMNDJDP3K4AYTFWBBRZVA, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.283249037 (8h44m59.242346294s) [noise=true , address=104.36.82.34:4555 , piece_id=FDBGAOUH2TNFRWOUVOUITLKDMEF3DTR7LZ366XU7IIBLPM7754MQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.283497868 (8h44m59.242595117s) [noise=true , address=104.36.82.47:4535 , piece_id=GSW3JTWTFKGNPBQESXRFXE4MJMURCGR3CWA5A5X2NHE3WBQXW7MQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.283697787 (8h44m59.242795043s) [noise=true , address=104.36.82.37:4667 , piece_id=CAYYHPWFW3WMLNS4U4LKB7ZBDTS4XK7R2ECH6B4JLFECFVEG4J2A, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.283923629 (8h44m59.243020879s) [noise=true , address=79.127.201.215:4344 , piece_id=GMLUHW4RJO2B5CA3FRJXREMPPA3GI5UAJ75MCKSPWCMDB4XZTB3A, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.284070531 (8h44m59.2431678s) [noise=true , address=104.36.82.59:4336 , piece_id=XKEMPPIYH3H3G2MBNNTTFLOYDNTLH6XZIDS3GAMJBRBTUSRPD2IA, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.284320294 (8h44m59.243417527s) [noise=true , address=104.36.82.62:4433 , piece_id=A5M2AO7CLC4GED6GT3ZW72NXSHTFAADOBWAPIQCDMKIJWSQSM7OQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.284484469 (8h44m59.243581723s) [noise=true , address=104.36.82.44:4896 , piece_id=LH3KS6YE4VX4TNUPTJSGMKQZH6XNFIGEG4QCI6RSEZCGTGRGUKIA, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.284875568 (8h44m59.243972872s) [noise=true , address=104.36.82.14:4238 , piece_id=TKXGQSYKRGK4APMPZ2SM62LE7SBLDLNBNQJKGQQNROVQC3V57XEQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.285200545 (8h44m59.244297797s) [noise=true , address=104.36.82.42:4825 , piece_id=CLIXDVX5I3Z7AMDAJH7YDSIM4HURCGTTNUOKPGKWUS44GXFWWGHQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.285531356 (8h44m59.244628595s) [noise=true , address=104.36.82.39:4746 , piece_id=6RWW23FF6YXXHCW6C6NPQUE5VZQT5PVKVSI3QIILPNVJHYYBA4FA, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.857401850 (8h44m59.816499088s) [upload=9072]: Next returned nil segment
Aug 9 02:10:37.857420190 (8h44m59.816517435s) [upload=9072]: Waiting for error group managing segments...
Aug 9 02:10:38.002192174 (8h44m59.961289461s) [noise=true , address=45.91.116.13:4157 , piece_id=NF2U6KEPFJJES3LLLPMEXW2D4TQGIRZXCBZKYRKP6WDVTQZG3Z5A, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.008516068 (8h44m59.967613307s) [noise=true , address=104.36.82.37:4667 , piece_id=CAYYHPWFW3WMLNS4U4LKB7ZBDTS4XK7R2ECH6B4JLFECFVEG4J2A, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.010892791 (8h44m59.969990029s) [noise=true , address=104.36.82.38:4700 , piece_id=MOOI5GCJ6U2SOZ6CXSFCXJ3EM33ILXQKUKZGHDNQAWFQZCR6FA5A, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.015403350 (8h44m59.974500596s) [noise=true , address=104.36.82.3:4792 , piece_id=3EICKVTJG3WKIVW7NSTAOJF6MHIR535WZ2DWPBZWGDBEKAW2UAIQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.021945896 (8h44m59.981043141s) [noise=true , address=104.36.82.62:4433 , piece_id=A5M2AO7CLC4GED6GT3ZW72NXSHTFAADOBWAPIQCDMKIJWSQSM7OQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.022623812 (8h44m59.981721043s) [noise=true , address=104.36.82.36:4628 , piece_id=NXQCJWOKEPWPHWLUA2LN33NY2K4T6MBADP6UZHDXCOSZ3IVTU7QA, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.025268193 (8h44m59.984365438s) [noise=true , address=104.36.82.47:4535 , piece_id=GSW3JTWTFKGNPBQESXRFXE4MJMURCGR3CWA5A5X2NHE3WBQXW7MQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.029831147 (8h44m59.988928379s) [noise=true , address=104.36.82.42:4825 , piece_id=CLIXDVX5I3Z7AMDAJH7YDSIM4HURCGTTNUOKPGKWUS44GXFWWGHQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.031361897 (8h44m59.990459143s) [noise=true , address=104.36.82.39:4746 , piece_id=6RWW23FF6YXXHCW6C6NPQUE5VZQT5PVKVSI3QIILPNVJHYYBA4FA, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.031724328 (8h44m59.990821567s) [noise=true , address=104.36.82.14:4238 , piece_id=TKXGQSYKRGK4APMPZ2SM62LE7SBLDLNBNQJKGQQNROVQC3V57XEQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.034015821 (8h44m59.993113059s) [noise=true , address=104.36.82.8:4983 , piece_id=7Z3ESXBUZPGZ4B3UOBGJMQTLIORRPYGISSWBVBGPJ5NZLBUSYQQQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.039241260 (8h44m59.998338494s) [noise=true , address=104.36.82.34:4555 , piece_id=FDBGAOUH2TNFRWOUVOUITLKDMEF3DTR7LZ366XU7IIBLPM7754MQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.084935610 (8h45m0.044032847s) [noise=true , address=79.127.219.51:4185 , piece_id=YEKJOTAO5GNJJ4EXXZQ67PBOEVF5CMRWS2YILIWEYH7SPCYDJDFQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.094851780 (8h45m0.053949012s) [noise=true , address=104.36.82.59:4336 , piece_id=XKEMPPIYH3H3G2MBNNTTFLOYDNTLH6XZIDS3GAMJBRBTUSRPD2IA, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.094888338 (8h45m0.053985583s) [seg_pos={0 0}, upload=9072]: Segment reached optimal threshold of 14 pieces.
Aug 9 02:10:38.095192665 (8h45m0.054289897s) [noise=true , address=104.36.82.44:4896 , piece_id=LH3KS6YE4VX4TNUPTJSGMKQZH6XNFIGEG4QCI6RSEZCGTGRGUKIA, seg_pos={0 0}, upload=9072]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o): protocol: expected piece hash; context canceled; EOF
Aug 9 02:10:38.095235469 (8h45m0.054332713s) [noise=true , address=79.127.201.215:4344 , piece_id=GMLUHW4RJO2B5CA3FRJXREMPPA3GI5UAJ75MCKSPWCMDB4XZTB3A, seg_pos={0 0}, upload=9072]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 9 02:10:38.095344994 (8h45m0.054442225s) [noise=true , address=79.127.201.215:4346 , piece_id=A4ZZJR37JVXZJENDXEPEWRHOXWGJJIQWMNDJDP3K4AYTFWBBRZVA, seg_pos={0 0}, upload=9072]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: expected piece hash; context canceled; EOF
Aug 9 02:10:38.095490516 (8h45m0.054587748s) [noise=true , address=64.49.13.27:4965 , piece_id=RY6ZCWIZLZJ5ODB5VQL5HHLAWMVCPR3DGFA2EHJK7YX3PD64ICCQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WVhm2QyhAf1y6HXRpyChMLbDLhZJQHEE2kQpstZH2dkwNhd7P): protocol: write tcp 139.59.144.22:60048->64.49.13.27:4965: use of closed network connection; write tcp 139.59.144.22:60048->64.49.13.27:4965: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60048->64.49.13.27:4965: use of closed network connection
Aug 9 02:10:38.095501617 (8h45m0.054598848s) [seg_pos={0 0}, upload=9072]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 02:10:38.095587096 (8h45m0.054684328s) [upload=9072]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 02:10:38.095591184 (8h45m0.054688416s) [upload=9072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 02:10:38.283711477 (8h45m0.242808728s) [upload=9072]: Done uploading segments...
Aug 9 02:10:38.283731544 (8h45m0.242828775s) [upload=9072]: Upload finished. err: <nil>
Duration: 2.435601483s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X..........X.........................................X...] duration:
2.470421835s
FAIL (2025-08-09 02:13:30 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 9 02:10:37.079080615 (8h44m59.038177867s) [upload=9072]: Starting upload
Aug 9 02:10:37.079168398 (8h44m59.038265647s) [upload=9072]: Done starting upload
Aug 9 02:10:37.079251655 (8h44m59.038348893s) [upload=9072]: Uploading segments...
Aug 9 02:10:37.079463912 (8h44m59.038561158s) [upload=9072]: Got next segment. Inline: false
Aug 9 02:10:37.079516285 (8h44m59.03861353s) [upload=9072]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 02:10:37.079521467 (8h44m59.038618702s) [upload=9072]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 02:10:37.281443152 (8h44m59.240540403s) [seg_pos={0 0}, upload=9072]: Begin upload segment...
Aug 9 02:10:37.281501467 (8h44m59.240598711s) [seg_pos={0 0}, upload=9072]: Done begin upload segment.
Aug 9 02:10:37.281533149 (8h44m59.240630384s) [noise=true , address=79.127.219.51:4185 , piece_id=YEKJOTAO5GNJJ4EXXZQ67PBOEVF5CMRWS2YILIWEYH7SPCYDJDFQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.281542503 (8h44m59.24063975s) [noise=true , address=45.91.116.13:4157 , piece_id=NF2U6KEPFJJES3LLLPMEXW2D4TQGIRZXCBZKYRKP6WDVTQZG3Z5A, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.281978435 (8h44m59.241075686s) [noise=true , address=104.36.82.38:4700 , piece_id=MOOI5GCJ6U2SOZ6CXSFCXJ3EM33ILXQKUKZGHDNQAWFQZCR6FA5A, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.282035638 (8h44m59.24113289s) [noise=true , address=104.36.82.36:4628 , piece_id=NXQCJWOKEPWPHWLUA2LN33NY2K4T6MBADP6UZHDXCOSZ3IVTU7QA, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.282365897 (8h44m59.241463153s) [noise=true , address=104.36.82.8:4983 , piece_id=7Z3ESXBUZPGZ4B3UOBGJMQTLIORRPYGISSWBVBGPJ5NZLBUSYQQQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.282519577 (8h44m59.241616826s) [noise=true , address=104.36.82.3:4792 , piece_id=3EICKVTJG3WKIVW7NSTAOJF6MHIR535WZ2DWPBZWGDBEKAW2UAIQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.282775377 (8h44m59.241872638s) [noise=true , address=64.49.13.27:4965 , piece_id=RY6ZCWIZLZJ5ODB5VQL5HHLAWMVCPR3DGFA2EHJK7YX3PD64ICCQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.282945943 (8h44m59.242043197s) [noise=true , address=79.127.201.215:4346 , piece_id=A4ZZJR37JVXZJENDXEPEWRHOXWGJJIQWMNDJDP3K4AYTFWBBRZVA, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.283249037 (8h44m59.242346294s) [noise=true , address=104.36.82.34:4555 , piece_id=FDBGAOUH2TNFRWOUVOUITLKDMEF3DTR7LZ366XU7IIBLPM7754MQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.283497868 (8h44m59.242595117s) [noise=true , address=104.36.82.47:4535 , piece_id=GSW3JTWTFKGNPBQESXRFXE4MJMURCGR3CWA5A5X2NHE3WBQXW7MQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.283697787 (8h44m59.242795043s) [noise=true , address=104.36.82.37:4667 , piece_id=CAYYHPWFW3WMLNS4U4LKB7ZBDTS4XK7R2ECH6B4JLFECFVEG4J2A, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.283923629 (8h44m59.243020879s) [noise=true , address=79.127.201.215:4344 , piece_id=GMLUHW4RJO2B5CA3FRJXREMPPA3GI5UAJ75MCKSPWCMDB4XZTB3A, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.284070531 (8h44m59.2431678s) [noise=true , address=104.36.82.59:4336 , piece_id=XKEMPPIYH3H3G2MBNNTTFLOYDNTLH6XZIDS3GAMJBRBTUSRPD2IA, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.284320294 (8h44m59.243417527s) [noise=true , address=104.36.82.62:4433 , piece_id=A5M2AO7CLC4GED6GT3ZW72NXSHTFAADOBWAPIQCDMKIJWSQSM7OQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.284484469 (8h44m59.243581723s) [noise=true , address=104.36.82.44:4896 , piece_id=LH3KS6YE4VX4TNUPTJSGMKQZH6XNFIGEG4QCI6RSEZCGTGRGUKIA, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.284875568 (8h44m59.243972872s) [noise=true , address=104.36.82.14:4238 , piece_id=TKXGQSYKRGK4APMPZ2SM62LE7SBLDLNBNQJKGQQNROVQC3V57XEQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.285200545 (8h44m59.244297797s) [noise=true , address=104.36.82.42:4825 , piece_id=CLIXDVX5I3Z7AMDAJH7YDSIM4HURCGTTNUOKPGKWUS44GXFWWGHQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.285531356 (8h44m59.244628595s) [noise=true , address=104.36.82.39:4746 , piece_id=6RWW23FF6YXXHCW6C6NPQUE5VZQT5PVKVSI3QIILPNVJHYYBA4FA, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.857401850 (8h44m59.816499088s) [upload=9072]: Next returned nil segment
Aug 9 02:10:37.857420190 (8h44m59.816517435s) [upload=9072]: Waiting for error group managing segments...
Aug 9 02:10:38.002192174 (8h44m59.961289461s) [noise=true , address=45.91.116.13:4157 , piece_id=NF2U6KEPFJJES3LLLPMEXW2D4TQGIRZXCBZKYRKP6WDVTQZG3Z5A, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.008516068 (8h44m59.967613307s) [noise=true , address=104.36.82.37:4667 , piece_id=CAYYHPWFW3WMLNS4U4LKB7ZBDTS4XK7R2ECH6B4JLFECFVEG4J2A, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.010892791 (8h44m59.969990029s) [noise=true , address=104.36.82.38:4700 , piece_id=MOOI5GCJ6U2SOZ6CXSFCXJ3EM33ILXQKUKZGHDNQAWFQZCR6FA5A, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.015403350 (8h44m59.974500596s) [noise=true , address=104.36.82.3:4792 , piece_id=3EICKVTJG3WKIVW7NSTAOJF6MHIR535WZ2DWPBZWGDBEKAW2UAIQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.021945896 (8h44m59.981043141s) [noise=true , address=104.36.82.62:4433 , piece_id=A5M2AO7CLC4GED6GT3ZW72NXSHTFAADOBWAPIQCDMKIJWSQSM7OQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.022623812 (8h44m59.981721043s) [noise=true , address=104.36.82.36:4628 , piece_id=NXQCJWOKEPWPHWLUA2LN33NY2K4T6MBADP6UZHDXCOSZ3IVTU7QA, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.025268193 (8h44m59.984365438s) [noise=true , address=104.36.82.47:4535 , piece_id=GSW3JTWTFKGNPBQESXRFXE4MJMURCGR3CWA5A5X2NHE3WBQXW7MQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.029831147 (8h44m59.988928379s) [noise=true , address=104.36.82.42:4825 , piece_id=CLIXDVX5I3Z7AMDAJH7YDSIM4HURCGTTNUOKPGKWUS44GXFWWGHQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.031361897 (8h44m59.990459143s) [noise=true , address=104.36.82.39:4746 , piece_id=6RWW23FF6YXXHCW6C6NPQUE5VZQT5PVKVSI3QIILPNVJHYYBA4FA, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.031724328 (8h44m59.990821567s) [noise=true , address=104.36.82.14:4238 , piece_id=TKXGQSYKRGK4APMPZ2SM62LE7SBLDLNBNQJKGQQNROVQC3V57XEQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.034015821 (8h44m59.993113059s) [noise=true , address=104.36.82.8:4983 , piece_id=7Z3ESXBUZPGZ4B3UOBGJMQTLIORRPYGISSWBVBGPJ5NZLBUSYQQQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.039241260 (8h44m59.998338494s) [noise=true , address=104.36.82.34:4555 , piece_id=FDBGAOUH2TNFRWOUVOUITLKDMEF3DTR7LZ366XU7IIBLPM7754MQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.084935610 (8h45m0.044032847s) [noise=true , address=79.127.219.51:4185 , piece_id=YEKJOTAO5GNJJ4EXXZQ67PBOEVF5CMRWS2YILIWEYH7SPCYDJDFQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.094851780 (8h45m0.053949012s) [noise=true , address=104.36.82.59:4336 , piece_id=XKEMPPIYH3H3G2MBNNTTFLOYDNTLH6XZIDS3GAMJBRBTUSRPD2IA, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.094888338 (8h45m0.053985583s) [seg_pos={0 0}, upload=9072]: Segment reached optimal threshold of 14 pieces.
Aug 9 02:10:38.095192665 (8h45m0.054289897s) [noise=true , address=104.36.82.44:4896 , piece_id=LH3KS6YE4VX4TNUPTJSGMKQZH6XNFIGEG4QCI6RSEZCGTGRGUKIA, seg_pos={0 0}, upload=9072]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o): protocol: expected piece hash; context canceled; EOF
Aug 9 02:10:38.095235469 (8h45m0.054332713s) [noise=true , address=79.127.201.215:4344 , piece_id=GMLUHW4RJO2B5CA3FRJXREMPPA3GI5UAJ75MCKSPWCMDB4XZTB3A, seg_pos={0 0}, upload=9072]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 9 02:10:38.095344994 (8h45m0.054442225s) [noise=true , address=79.127.201.215:4346 , piece_id=A4ZZJR37JVXZJENDXEPEWRHOXWGJJIQWMNDJDP3K4AYTFWBBRZVA, seg_pos={0 0}, upload=9072]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: expected piece hash; context canceled; EOF
Aug 9 02:10:38.095490516 (8h45m0.054587748s) [noise=true , address=64.49.13.27:4965 , piece_id=RY6ZCWIZLZJ5ODB5VQL5HHLAWMVCPR3DGFA2EHJK7YX3PD64ICCQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WVhm2QyhAf1y6HXRpyChMLbDLhZJQHEE2kQpstZH2dkwNhd7P): protocol: write tcp 139.59.144.22:60048->64.49.13.27:4965: use of closed network connection; write tcp 139.59.144.22:60048->64.49.13.27:4965: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60048->64.49.13.27:4965: use of closed network connection
Aug 9 02:10:38.095501617 (8h45m0.054598848s) [seg_pos={0 0}, upload=9072]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 02:10:38.095587096 (8h45m0.054684328s) [upload=9072]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 02:10:38.095591184 (8h45m0.054688416s) [upload=9072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 02:10:38.283711477 (8h45m0.242808728s) [upload=9072]: Done uploading segments...
Aug 9 02:10:38.283731544 (8h45m0.242828775s) [upload=9072]: Upload finished. err: <nil>
Duration: 2.470455158s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........X.....................................X.............] duration:
844.701512ms
FAIL (2025-08-09 02:13:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:04:31.977231824 (8h38m53.93632908s) [upload=8967]: Starting upload Aug 9 02:04:31.977318166 (8h38m53.936415419s) [upload=8967]: Done starting upload Aug 9 02:04:31.977468417 (8h38m53.936565654s) [upload=8967]: Uploading segments... Aug 9 02:04:31.977561216 (8h38m53.93665847s) [upload=8967]: Got next segment. Inline: true Aug 9 02:04:31.977569010 (8h38m53.936666256s) [upload=8967]: Waiting for error group managing segments... Aug 9 02:04:31.977632258 (8h38m53.936729507s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 02:04:31.977637624 (8h38m53.936734872s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 02:04:31.977641013 (8h38m53.936738258s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 02:04:32.067582835 (8h38m54.02668009s) [upload=8967]: Done uploading segments... Aug 9 02:04:32.067611492 (8h38m54.026708745s) [upload=8967]: Upload finished. err: metaclient: Too Many Requests
Duration: 844.730221ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [X........X.....................................X............] duration:
953.042032ms
FAIL (2025-08-09 02:12:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:04:31.977231824 (8h38m53.93632908s) [upload=8967]: Starting upload Aug 9 02:04:31.977318166 (8h38m53.936415419s) [upload=8967]: Done starting upload Aug 9 02:04:31.977468417 (8h38m53.936565654s) [upload=8967]: Uploading segments... Aug 9 02:04:31.977561216 (8h38m53.93665847s) [upload=8967]: Got next segment. Inline: true Aug 9 02:04:31.977569010 (8h38m53.936666256s) [upload=8967]: Waiting for error group managing segments... Aug 9 02:04:31.977632258 (8h38m53.936729507s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 02:04:31.977637624 (8h38m53.936734872s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 02:04:31.977641013 (8h38m53.936738258s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 02:04:32.067582835 (8h38m54.02668009s) [upload=8967]: Done uploading segments... Aug 9 02:04:32.067611492 (8h38m54.026708745s) [upload=8967]: Upload finished. err: metaclient: Too Many Requests
Duration: 953.065005ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X..........X.........................................X..] duration:
2.352554012s
FAIL (2025-08-09 02:12:19 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 9 02:10:37.079080615 (8h44m59.038177867s) [upload=9072]: Starting upload
Aug 9 02:10:37.079168398 (8h44m59.038265647s) [upload=9072]: Done starting upload
Aug 9 02:10:37.079251655 (8h44m59.038348893s) [upload=9072]: Uploading segments...
Aug 9 02:10:37.079463912 (8h44m59.038561158s) [upload=9072]: Got next segment. Inline: false
Aug 9 02:10:37.079516285 (8h44m59.03861353s) [upload=9072]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 02:10:37.079521467 (8h44m59.038618702s) [upload=9072]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 02:10:37.281443152 (8h44m59.240540403s) [seg_pos={0 0}, upload=9072]: Begin upload segment...
Aug 9 02:10:37.281501467 (8h44m59.240598711s) [seg_pos={0 0}, upload=9072]: Done begin upload segment.
Aug 9 02:10:37.281533149 (8h44m59.240630384s) [noise=true , address=79.127.219.51:4185 , piece_id=YEKJOTAO5GNJJ4EXXZQ67PBOEVF5CMRWS2YILIWEYH7SPCYDJDFQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.281542503 (8h44m59.24063975s) [noise=true , address=45.91.116.13:4157 , piece_id=NF2U6KEPFJJES3LLLPMEXW2D4TQGIRZXCBZKYRKP6WDVTQZG3Z5A, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.281978435 (8h44m59.241075686s) [noise=true , address=104.36.82.38:4700 , piece_id=MOOI5GCJ6U2SOZ6CXSFCXJ3EM33ILXQKUKZGHDNQAWFQZCR6FA5A, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.282035638 (8h44m59.24113289s) [noise=true , address=104.36.82.36:4628 , piece_id=NXQCJWOKEPWPHWLUA2LN33NY2K4T6MBADP6UZHDXCOSZ3IVTU7QA, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.282365897 (8h44m59.241463153s) [noise=true , address=104.36.82.8:4983 , piece_id=7Z3ESXBUZPGZ4B3UOBGJMQTLIORRPYGISSWBVBGPJ5NZLBUSYQQQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.282519577 (8h44m59.241616826s) [noise=true , address=104.36.82.3:4792 , piece_id=3EICKVTJG3WKIVW7NSTAOJF6MHIR535WZ2DWPBZWGDBEKAW2UAIQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.282775377 (8h44m59.241872638s) [noise=true , address=64.49.13.27:4965 , piece_id=RY6ZCWIZLZJ5ODB5VQL5HHLAWMVCPR3DGFA2EHJK7YX3PD64ICCQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.282945943 (8h44m59.242043197s) [noise=true , address=79.127.201.215:4346 , piece_id=A4ZZJR37JVXZJENDXEPEWRHOXWGJJIQWMNDJDP3K4AYTFWBBRZVA, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.283249037 (8h44m59.242346294s) [noise=true , address=104.36.82.34:4555 , piece_id=FDBGAOUH2TNFRWOUVOUITLKDMEF3DTR7LZ366XU7IIBLPM7754MQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.283497868 (8h44m59.242595117s) [noise=true , address=104.36.82.47:4535 , piece_id=GSW3JTWTFKGNPBQESXRFXE4MJMURCGR3CWA5A5X2NHE3WBQXW7MQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.283697787 (8h44m59.242795043s) [noise=true , address=104.36.82.37:4667 , piece_id=CAYYHPWFW3WMLNS4U4LKB7ZBDTS4XK7R2ECH6B4JLFECFVEG4J2A, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.283923629 (8h44m59.243020879s) [noise=true , address=79.127.201.215:4344 , piece_id=GMLUHW4RJO2B5CA3FRJXREMPPA3GI5UAJ75MCKSPWCMDB4XZTB3A, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.284070531 (8h44m59.2431678s) [noise=true , address=104.36.82.59:4336 , piece_id=XKEMPPIYH3H3G2MBNNTTFLOYDNTLH6XZIDS3GAMJBRBTUSRPD2IA, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.284320294 (8h44m59.243417527s) [noise=true , address=104.36.82.62:4433 , piece_id=A5M2AO7CLC4GED6GT3ZW72NXSHTFAADOBWAPIQCDMKIJWSQSM7OQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.284484469 (8h44m59.243581723s) [noise=true , address=104.36.82.44:4896 , piece_id=LH3KS6YE4VX4TNUPTJSGMKQZH6XNFIGEG4QCI6RSEZCGTGRGUKIA, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.284875568 (8h44m59.243972872s) [noise=true , address=104.36.82.14:4238 , piece_id=TKXGQSYKRGK4APMPZ2SM62LE7SBLDLNBNQJKGQQNROVQC3V57XEQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.285200545 (8h44m59.244297797s) [noise=true , address=104.36.82.42:4825 , piece_id=CLIXDVX5I3Z7AMDAJH7YDSIM4HURCGTTNUOKPGKWUS44GXFWWGHQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.285531356 (8h44m59.244628595s) [noise=true , address=104.36.82.39:4746 , piece_id=6RWW23FF6YXXHCW6C6NPQUE5VZQT5PVKVSI3QIILPNVJHYYBA4FA, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.857401850 (8h44m59.816499088s) [upload=9072]: Next returned nil segment
Aug 9 02:10:37.857420190 (8h44m59.816517435s) [upload=9072]: Waiting for error group managing segments...
Aug 9 02:10:38.002192174 (8h44m59.961289461s) [noise=true , address=45.91.116.13:4157 , piece_id=NF2U6KEPFJJES3LLLPMEXW2D4TQGIRZXCBZKYRKP6WDVTQZG3Z5A, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.008516068 (8h44m59.967613307s) [noise=true , address=104.36.82.37:4667 , piece_id=CAYYHPWFW3WMLNS4U4LKB7ZBDTS4XK7R2ECH6B4JLFECFVEG4J2A, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.010892791 (8h44m59.969990029s) [noise=true , address=104.36.82.38:4700 , piece_id=MOOI5GCJ6U2SOZ6CXSFCXJ3EM33ILXQKUKZGHDNQAWFQZCR6FA5A, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.015403350 (8h44m59.974500596s) [noise=true , address=104.36.82.3:4792 , piece_id=3EICKVTJG3WKIVW7NSTAOJF6MHIR535WZ2DWPBZWGDBEKAW2UAIQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.021945896 (8h44m59.981043141s) [noise=true , address=104.36.82.62:4433 , piece_id=A5M2AO7CLC4GED6GT3ZW72NXSHTFAADOBWAPIQCDMKIJWSQSM7OQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.022623812 (8h44m59.981721043s) [noise=true , address=104.36.82.36:4628 , piece_id=NXQCJWOKEPWPHWLUA2LN33NY2K4T6MBADP6UZHDXCOSZ3IVTU7QA, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.025268193 (8h44m59.984365438s) [noise=true , address=104.36.82.47:4535 , piece_id=GSW3JTWTFKGNPBQESXRFXE4MJMURCGR3CWA5A5X2NHE3WBQXW7MQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.029831147 (8h44m59.988928379s) [noise=true , address=104.36.82.42:4825 , piece_id=CLIXDVX5I3Z7AMDAJH7YDSIM4HURCGTTNUOKPGKWUS44GXFWWGHQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.031361897 (8h44m59.990459143s) [noise=true , address=104.36.82.39:4746 , piece_id=6RWW23FF6YXXHCW6C6NPQUE5VZQT5PVKVSI3QIILPNVJHYYBA4FA, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.031724328 (8h44m59.990821567s) [noise=true , address=104.36.82.14:4238 , piece_id=TKXGQSYKRGK4APMPZ2SM62LE7SBLDLNBNQJKGQQNROVQC3V57XEQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.034015821 (8h44m59.993113059s) [noise=true , address=104.36.82.8:4983 , piece_id=7Z3ESXBUZPGZ4B3UOBGJMQTLIORRPYGISSWBVBGPJ5NZLBUSYQQQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.039241260 (8h44m59.998338494s) [noise=true , address=104.36.82.34:4555 , piece_id=FDBGAOUH2TNFRWOUVOUITLKDMEF3DTR7LZ366XU7IIBLPM7754MQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.084935610 (8h45m0.044032847s) [noise=true , address=79.127.219.51:4185 , piece_id=YEKJOTAO5GNJJ4EXXZQ67PBOEVF5CMRWS2YILIWEYH7SPCYDJDFQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.094851780 (8h45m0.053949012s) [noise=true , address=104.36.82.59:4336 , piece_id=XKEMPPIYH3H3G2MBNNTTFLOYDNTLH6XZIDS3GAMJBRBTUSRPD2IA, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.094888338 (8h45m0.053985583s) [seg_pos={0 0}, upload=9072]: Segment reached optimal threshold of 14 pieces.
Aug 9 02:10:38.095192665 (8h45m0.054289897s) [noise=true , address=104.36.82.44:4896 , piece_id=LH3KS6YE4VX4TNUPTJSGMKQZH6XNFIGEG4QCI6RSEZCGTGRGUKIA, seg_pos={0 0}, upload=9072]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o): protocol: expected piece hash; context canceled; EOF
Aug 9 02:10:38.095235469 (8h45m0.054332713s) [noise=true , address=79.127.201.215:4344 , piece_id=GMLUHW4RJO2B5CA3FRJXREMPPA3GI5UAJ75MCKSPWCMDB4XZTB3A, seg_pos={0 0}, upload=9072]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 9 02:10:38.095344994 (8h45m0.054442225s) [noise=true , address=79.127.201.215:4346 , piece_id=A4ZZJR37JVXZJENDXEPEWRHOXWGJJIQWMNDJDP3K4AYTFWBBRZVA, seg_pos={0 0}, upload=9072]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: expected piece hash; context canceled; EOF
Aug 9 02:10:38.095490516 (8h45m0.054587748s) [noise=true , address=64.49.13.27:4965 , piece_id=RY6ZCWIZLZJ5ODB5VQL5HHLAWMVCPR3DGFA2EHJK7YX3PD64ICCQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WVhm2QyhAf1y6HXRpyChMLbDLhZJQHEE2kQpstZH2dkwNhd7P): protocol: write tcp 139.59.144.22:60048->64.49.13.27:4965: use of closed network connection; write tcp 139.59.144.22:60048->64.49.13.27:4965: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60048->64.49.13.27:4965: use of closed network connection
Aug 9 02:10:38.095501617 (8h45m0.054598848s) [seg_pos={0 0}, upload=9072]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 02:10:38.095587096 (8h45m0.054684328s) [upload=9072]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 02:10:38.095591184 (8h45m0.054688416s) [upload=9072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 02:10:38.283711477 (8h45m0.242808728s) [upload=9072]: Done uploading segments...
Aug 9 02:10:38.283731544 (8h45m0.242828775s) [upload=9072]: Upload finished. err: <nil>
Duration: 2.35258279s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.X........X.....................................X...........] duration:
996.464068ms
FAIL (2025-08-09 02:11:56 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:04:31.977231824 (8h38m53.93632908s) [upload=8967]: Starting upload Aug 9 02:04:31.977318166 (8h38m53.936415419s) [upload=8967]: Done starting upload Aug 9 02:04:31.977468417 (8h38m53.936565654s) [upload=8967]: Uploading segments... Aug 9 02:04:31.977561216 (8h38m53.93665847s) [upload=8967]: Got next segment. Inline: true Aug 9 02:04:31.977569010 (8h38m53.936666256s) [upload=8967]: Waiting for error group managing segments... Aug 9 02:04:31.977632258 (8h38m53.936729507s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 02:04:31.977637624 (8h38m53.936734872s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 02:04:31.977641013 (8h38m53.936738258s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 02:04:32.067582835 (8h38m54.02668009s) [upload=8967]: Done uploading segments... Aug 9 02:04:32.067611492 (8h38m54.026708745s) [upload=8967]: Upload finished. err: metaclient: Too Many Requests
Duration: 996.496296ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X..........X.........................................X.] duration:
2.425698179s
FAIL (2025-08-09 02:11:44 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 9 02:10:37.079080615 (8h44m59.038177867s) [upload=9072]: Starting upload
Aug 9 02:10:37.079168398 (8h44m59.038265647s) [upload=9072]: Done starting upload
Aug 9 02:10:37.079251655 (8h44m59.038348893s) [upload=9072]: Uploading segments...
Aug 9 02:10:37.079463912 (8h44m59.038561158s) [upload=9072]: Got next segment. Inline: false
Aug 9 02:10:37.079516285 (8h44m59.03861353s) [upload=9072]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 02:10:37.079521467 (8h44m59.038618702s) [upload=9072]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 02:10:37.281443152 (8h44m59.240540403s) [seg_pos={0 0}, upload=9072]: Begin upload segment...
Aug 9 02:10:37.281501467 (8h44m59.240598711s) [seg_pos={0 0}, upload=9072]: Done begin upload segment.
Aug 9 02:10:37.281533149 (8h44m59.240630384s) [noise=true , address=79.127.219.51:4185 , piece_id=YEKJOTAO5GNJJ4EXXZQ67PBOEVF5CMRWS2YILIWEYH7SPCYDJDFQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.281542503 (8h44m59.24063975s) [noise=true , address=45.91.116.13:4157 , piece_id=NF2U6KEPFJJES3LLLPMEXW2D4TQGIRZXCBZKYRKP6WDVTQZG3Z5A, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.281978435 (8h44m59.241075686s) [noise=true , address=104.36.82.38:4700 , piece_id=MOOI5GCJ6U2SOZ6CXSFCXJ3EM33ILXQKUKZGHDNQAWFQZCR6FA5A, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.282035638 (8h44m59.24113289s) [noise=true , address=104.36.82.36:4628 , piece_id=NXQCJWOKEPWPHWLUA2LN33NY2K4T6MBADP6UZHDXCOSZ3IVTU7QA, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.282365897 (8h44m59.241463153s) [noise=true , address=104.36.82.8:4983 , piece_id=7Z3ESXBUZPGZ4B3UOBGJMQTLIORRPYGISSWBVBGPJ5NZLBUSYQQQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.282519577 (8h44m59.241616826s) [noise=true , address=104.36.82.3:4792 , piece_id=3EICKVTJG3WKIVW7NSTAOJF6MHIR535WZ2DWPBZWGDBEKAW2UAIQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.282775377 (8h44m59.241872638s) [noise=true , address=64.49.13.27:4965 , piece_id=RY6ZCWIZLZJ5ODB5VQL5HHLAWMVCPR3DGFA2EHJK7YX3PD64ICCQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.282945943 (8h44m59.242043197s) [noise=true , address=79.127.201.215:4346 , piece_id=A4ZZJR37JVXZJENDXEPEWRHOXWGJJIQWMNDJDP3K4AYTFWBBRZVA, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.283249037 (8h44m59.242346294s) [noise=true , address=104.36.82.34:4555 , piece_id=FDBGAOUH2TNFRWOUVOUITLKDMEF3DTR7LZ366XU7IIBLPM7754MQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.283497868 (8h44m59.242595117s) [noise=true , address=104.36.82.47:4535 , piece_id=GSW3JTWTFKGNPBQESXRFXE4MJMURCGR3CWA5A5X2NHE3WBQXW7MQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.283697787 (8h44m59.242795043s) [noise=true , address=104.36.82.37:4667 , piece_id=CAYYHPWFW3WMLNS4U4LKB7ZBDTS4XK7R2ECH6B4JLFECFVEG4J2A, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.283923629 (8h44m59.243020879s) [noise=true , address=79.127.201.215:4344 , piece_id=GMLUHW4RJO2B5CA3FRJXREMPPA3GI5UAJ75MCKSPWCMDB4XZTB3A, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.284070531 (8h44m59.2431678s) [noise=true , address=104.36.82.59:4336 , piece_id=XKEMPPIYH3H3G2MBNNTTFLOYDNTLH6XZIDS3GAMJBRBTUSRPD2IA, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.284320294 (8h44m59.243417527s) [noise=true , address=104.36.82.62:4433 , piece_id=A5M2AO7CLC4GED6GT3ZW72NXSHTFAADOBWAPIQCDMKIJWSQSM7OQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.284484469 (8h44m59.243581723s) [noise=true , address=104.36.82.44:4896 , piece_id=LH3KS6YE4VX4TNUPTJSGMKQZH6XNFIGEG4QCI6RSEZCGTGRGUKIA, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.284875568 (8h44m59.243972872s) [noise=true , address=104.36.82.14:4238 , piece_id=TKXGQSYKRGK4APMPZ2SM62LE7SBLDLNBNQJKGQQNROVQC3V57XEQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.285200545 (8h44m59.244297797s) [noise=true , address=104.36.82.42:4825 , piece_id=CLIXDVX5I3Z7AMDAJH7YDSIM4HURCGTTNUOKPGKWUS44GXFWWGHQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.285531356 (8h44m59.244628595s) [noise=true , address=104.36.82.39:4746 , piece_id=6RWW23FF6YXXHCW6C6NPQUE5VZQT5PVKVSI3QIILPNVJHYYBA4FA, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.857401850 (8h44m59.816499088s) [upload=9072]: Next returned nil segment
Aug 9 02:10:37.857420190 (8h44m59.816517435s) [upload=9072]: Waiting for error group managing segments...
Aug 9 02:10:38.002192174 (8h44m59.961289461s) [noise=true , address=45.91.116.13:4157 , piece_id=NF2U6KEPFJJES3LLLPMEXW2D4TQGIRZXCBZKYRKP6WDVTQZG3Z5A, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.008516068 (8h44m59.967613307s) [noise=true , address=104.36.82.37:4667 , piece_id=CAYYHPWFW3WMLNS4U4LKB7ZBDTS4XK7R2ECH6B4JLFECFVEG4J2A, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.010892791 (8h44m59.969990029s) [noise=true , address=104.36.82.38:4700 , piece_id=MOOI5GCJ6U2SOZ6CXSFCXJ3EM33ILXQKUKZGHDNQAWFQZCR6FA5A, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.015403350 (8h44m59.974500596s) [noise=true , address=104.36.82.3:4792 , piece_id=3EICKVTJG3WKIVW7NSTAOJF6MHIR535WZ2DWPBZWGDBEKAW2UAIQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.021945896 (8h44m59.981043141s) [noise=true , address=104.36.82.62:4433 , piece_id=A5M2AO7CLC4GED6GT3ZW72NXSHTFAADOBWAPIQCDMKIJWSQSM7OQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.022623812 (8h44m59.981721043s) [noise=true , address=104.36.82.36:4628 , piece_id=NXQCJWOKEPWPHWLUA2LN33NY2K4T6MBADP6UZHDXCOSZ3IVTU7QA, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.025268193 (8h44m59.984365438s) [noise=true , address=104.36.82.47:4535 , piece_id=GSW3JTWTFKGNPBQESXRFXE4MJMURCGR3CWA5A5X2NHE3WBQXW7MQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.029831147 (8h44m59.988928379s) [noise=true , address=104.36.82.42:4825 , piece_id=CLIXDVX5I3Z7AMDAJH7YDSIM4HURCGTTNUOKPGKWUS44GXFWWGHQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.031361897 (8h44m59.990459143s) [noise=true , address=104.36.82.39:4746 , piece_id=6RWW23FF6YXXHCW6C6NPQUE5VZQT5PVKVSI3QIILPNVJHYYBA4FA, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.031724328 (8h44m59.990821567s) [noise=true , address=104.36.82.14:4238 , piece_id=TKXGQSYKRGK4APMPZ2SM62LE7SBLDLNBNQJKGQQNROVQC3V57XEQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.034015821 (8h44m59.993113059s) [noise=true , address=104.36.82.8:4983 , piece_id=7Z3ESXBUZPGZ4B3UOBGJMQTLIORRPYGISSWBVBGPJ5NZLBUSYQQQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.039241260 (8h44m59.998338494s) [noise=true , address=104.36.82.34:4555 , piece_id=FDBGAOUH2TNFRWOUVOUITLKDMEF3DTR7LZ366XU7IIBLPM7754MQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.084935610 (8h45m0.044032847s) [noise=true , address=79.127.219.51:4185 , piece_id=YEKJOTAO5GNJJ4EXXZQ67PBOEVF5CMRWS2YILIWEYH7SPCYDJDFQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.094851780 (8h45m0.053949012s) [noise=true , address=104.36.82.59:4336 , piece_id=XKEMPPIYH3H3G2MBNNTTFLOYDNTLH6XZIDS3GAMJBRBTUSRPD2IA, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.094888338 (8h45m0.053985583s) [seg_pos={0 0}, upload=9072]: Segment reached optimal threshold of 14 pieces.
Aug 9 02:10:38.095192665 (8h45m0.054289897s) [noise=true , address=104.36.82.44:4896 , piece_id=LH3KS6YE4VX4TNUPTJSGMKQZH6XNFIGEG4QCI6RSEZCGTGRGUKIA, seg_pos={0 0}, upload=9072]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o): protocol: expected piece hash; context canceled; EOF
Aug 9 02:10:38.095235469 (8h45m0.054332713s) [noise=true , address=79.127.201.215:4344 , piece_id=GMLUHW4RJO2B5CA3FRJXREMPPA3GI5UAJ75MCKSPWCMDB4XZTB3A, seg_pos={0 0}, upload=9072]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 9 02:10:38.095344994 (8h45m0.054442225s) [noise=true , address=79.127.201.215:4346 , piece_id=A4ZZJR37JVXZJENDXEPEWRHOXWGJJIQWMNDJDP3K4AYTFWBBRZVA, seg_pos={0 0}, upload=9072]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: expected piece hash; context canceled; EOF
Aug 9 02:10:38.095490516 (8h45m0.054587748s) [noise=true , address=64.49.13.27:4965 , piece_id=RY6ZCWIZLZJ5ODB5VQL5HHLAWMVCPR3DGFA2EHJK7YX3PD64ICCQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WVhm2QyhAf1y6HXRpyChMLbDLhZJQHEE2kQpstZH2dkwNhd7P): protocol: write tcp 139.59.144.22:60048->64.49.13.27:4965: use of closed network connection; write tcp 139.59.144.22:60048->64.49.13.27:4965: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60048->64.49.13.27:4965: use of closed network connection
Aug 9 02:10:38.095501617 (8h45m0.054598848s) [seg_pos={0 0}, upload=9072]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 02:10:38.095587096 (8h45m0.054684328s) [upload=9072]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 02:10:38.095591184 (8h45m0.054688416s) [upload=9072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 02:10:38.283711477 (8h45m0.242808728s) [upload=9072]: Done uploading segments...
Aug 9 02:10:38.283731544 (8h45m0.242828775s) [upload=9072]: Upload finished. err: <nil>
Duration: 2.425731606s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..X........X.....................................X..........] duration:
1.050701952s
FAIL (2025-08-09 02:11:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:04:31.977231824 (8h38m53.93632908s) [upload=8967]: Starting upload Aug 9 02:04:31.977318166 (8h38m53.936415419s) [upload=8967]: Done starting upload Aug 9 02:04:31.977468417 (8h38m53.936565654s) [upload=8967]: Uploading segments... Aug 9 02:04:31.977561216 (8h38m53.93665847s) [upload=8967]: Got next segment. Inline: true Aug 9 02:04:31.977569010 (8h38m53.936666256s) [upload=8967]: Waiting for error group managing segments... Aug 9 02:04:31.977632258 (8h38m53.936729507s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 02:04:31.977637624 (8h38m53.936734872s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 02:04:31.977641013 (8h38m53.936738258s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 02:04:32.067582835 (8h38m54.02668009s) [upload=8967]: Done uploading segments... Aug 9 02:04:32.067611492 (8h38m54.026708745s) [upload=8967]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.050733115s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...X........X.....................................X.........] duration:
1.008851304s
FAIL (2025-08-09 02:10:40 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:04:31.977231824 (8h38m53.93632908s) [upload=8967]: Starting upload Aug 9 02:04:31.977318166 (8h38m53.936415419s) [upload=8967]: Done starting upload Aug 9 02:04:31.977468417 (8h38m53.936565654s) [upload=8967]: Uploading segments... Aug 9 02:04:31.977561216 (8h38m53.93665847s) [upload=8967]: Got next segment. Inline: true Aug 9 02:04:31.977569010 (8h38m53.936666256s) [upload=8967]: Waiting for error group managing segments... Aug 9 02:04:31.977632258 (8h38m53.936729507s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 02:04:31.977637624 (8h38m53.936734872s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 02:04:31.977641013 (8h38m53.936738258s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 02:04:32.067582835 (8h38m54.02668009s) [upload=8967]: Done uploading segments... Aug 9 02:04:32.067611492 (8h38m54.026708745s) [upload=8967]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.008879371s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X..........X.........................................X] duration:
1.679352885s
FAIL (2025-08-09 02:10:38 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 9 02:10:37.079080615 (8h44m59.038177867s) [upload=9072]: Starting upload
Aug 9 02:10:37.079168398 (8h44m59.038265647s) [upload=9072]: Done starting upload
Aug 9 02:10:37.079251655 (8h44m59.038348893s) [upload=9072]: Uploading segments...
Aug 9 02:10:37.079463912 (8h44m59.038561158s) [upload=9072]: Got next segment. Inline: false
Aug 9 02:10:37.079516285 (8h44m59.03861353s) [upload=9072]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 02:10:37.079521467 (8h44m59.038618702s) [upload=9072]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 02:10:37.281443152 (8h44m59.240540403s) [seg_pos={0 0}, upload=9072]: Begin upload segment...
Aug 9 02:10:37.281501467 (8h44m59.240598711s) [seg_pos={0 0}, upload=9072]: Done begin upload segment.
Aug 9 02:10:37.281533149 (8h44m59.240630384s) [noise=true , address=79.127.219.51:4185 , piece_id=YEKJOTAO5GNJJ4EXXZQ67PBOEVF5CMRWS2YILIWEYH7SPCYDJDFQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.281542503 (8h44m59.24063975s) [noise=true , address=45.91.116.13:4157 , piece_id=NF2U6KEPFJJES3LLLPMEXW2D4TQGIRZXCBZKYRKP6WDVTQZG3Z5A, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.281978435 (8h44m59.241075686s) [noise=true , address=104.36.82.38:4700 , piece_id=MOOI5GCJ6U2SOZ6CXSFCXJ3EM33ILXQKUKZGHDNQAWFQZCR6FA5A, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.282035638 (8h44m59.24113289s) [noise=true , address=104.36.82.36:4628 , piece_id=NXQCJWOKEPWPHWLUA2LN33NY2K4T6MBADP6UZHDXCOSZ3IVTU7QA, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.282365897 (8h44m59.241463153s) [noise=true , address=104.36.82.8:4983 , piece_id=7Z3ESXBUZPGZ4B3UOBGJMQTLIORRPYGISSWBVBGPJ5NZLBUSYQQQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.282519577 (8h44m59.241616826s) [noise=true , address=104.36.82.3:4792 , piece_id=3EICKVTJG3WKIVW7NSTAOJF6MHIR535WZ2DWPBZWGDBEKAW2UAIQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.282775377 (8h44m59.241872638s) [noise=true , address=64.49.13.27:4965 , piece_id=RY6ZCWIZLZJ5ODB5VQL5HHLAWMVCPR3DGFA2EHJK7YX3PD64ICCQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.282945943 (8h44m59.242043197s) [noise=true , address=79.127.201.215:4346 , piece_id=A4ZZJR37JVXZJENDXEPEWRHOXWGJJIQWMNDJDP3K4AYTFWBBRZVA, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.283249037 (8h44m59.242346294s) [noise=true , address=104.36.82.34:4555 , piece_id=FDBGAOUH2TNFRWOUVOUITLKDMEF3DTR7LZ366XU7IIBLPM7754MQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.283497868 (8h44m59.242595117s) [noise=true , address=104.36.82.47:4535 , piece_id=GSW3JTWTFKGNPBQESXRFXE4MJMURCGR3CWA5A5X2NHE3WBQXW7MQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.283697787 (8h44m59.242795043s) [noise=true , address=104.36.82.37:4667 , piece_id=CAYYHPWFW3WMLNS4U4LKB7ZBDTS4XK7R2ECH6B4JLFECFVEG4J2A, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.283923629 (8h44m59.243020879s) [noise=true , address=79.127.201.215:4344 , piece_id=GMLUHW4RJO2B5CA3FRJXREMPPA3GI5UAJ75MCKSPWCMDB4XZTB3A, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.284070531 (8h44m59.2431678s) [noise=true , address=104.36.82.59:4336 , piece_id=XKEMPPIYH3H3G2MBNNTTFLOYDNTLH6XZIDS3GAMJBRBTUSRPD2IA, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.284320294 (8h44m59.243417527s) [noise=true , address=104.36.82.62:4433 , piece_id=A5M2AO7CLC4GED6GT3ZW72NXSHTFAADOBWAPIQCDMKIJWSQSM7OQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.284484469 (8h44m59.243581723s) [noise=true , address=104.36.82.44:4896 , piece_id=LH3KS6YE4VX4TNUPTJSGMKQZH6XNFIGEG4QCI6RSEZCGTGRGUKIA, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.284875568 (8h44m59.243972872s) [noise=true , address=104.36.82.14:4238 , piece_id=TKXGQSYKRGK4APMPZ2SM62LE7SBLDLNBNQJKGQQNROVQC3V57XEQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.285200545 (8h44m59.244297797s) [noise=true , address=104.36.82.42:4825 , piece_id=CLIXDVX5I3Z7AMDAJH7YDSIM4HURCGTTNUOKPGKWUS44GXFWWGHQ, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.285531356 (8h44m59.244628595s) [noise=true , address=104.36.82.39:4746 , piece_id=6RWW23FF6YXXHCW6C6NPQUE5VZQT5PVKVSI3QIILPNVJHYYBA4FA, seg_pos={0 0}, upload=9072]: Uploading piece...
Aug 9 02:10:37.857401850 (8h44m59.816499088s) [upload=9072]: Next returned nil segment
Aug 9 02:10:37.857420190 (8h44m59.816517435s) [upload=9072]: Waiting for error group managing segments...
Aug 9 02:10:38.002192174 (8h44m59.961289461s) [noise=true , address=45.91.116.13:4157 , piece_id=NF2U6KEPFJJES3LLLPMEXW2D4TQGIRZXCBZKYRKP6WDVTQZG3Z5A, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.008516068 (8h44m59.967613307s) [noise=true , address=104.36.82.37:4667 , piece_id=CAYYHPWFW3WMLNS4U4LKB7ZBDTS4XK7R2ECH6B4JLFECFVEG4J2A, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.010892791 (8h44m59.969990029s) [noise=true , address=104.36.82.38:4700 , piece_id=MOOI5GCJ6U2SOZ6CXSFCXJ3EM33ILXQKUKZGHDNQAWFQZCR6FA5A, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.015403350 (8h44m59.974500596s) [noise=true , address=104.36.82.3:4792 , piece_id=3EICKVTJG3WKIVW7NSTAOJF6MHIR535WZ2DWPBZWGDBEKAW2UAIQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.021945896 (8h44m59.981043141s) [noise=true , address=104.36.82.62:4433 , piece_id=A5M2AO7CLC4GED6GT3ZW72NXSHTFAADOBWAPIQCDMKIJWSQSM7OQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.022623812 (8h44m59.981721043s) [noise=true , address=104.36.82.36:4628 , piece_id=NXQCJWOKEPWPHWLUA2LN33NY2K4T6MBADP6UZHDXCOSZ3IVTU7QA, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.025268193 (8h44m59.984365438s) [noise=true , address=104.36.82.47:4535 , piece_id=GSW3JTWTFKGNPBQESXRFXE4MJMURCGR3CWA5A5X2NHE3WBQXW7MQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.029831147 (8h44m59.988928379s) [noise=true , address=104.36.82.42:4825 , piece_id=CLIXDVX5I3Z7AMDAJH7YDSIM4HURCGTTNUOKPGKWUS44GXFWWGHQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.031361897 (8h44m59.990459143s) [noise=true , address=104.36.82.39:4746 , piece_id=6RWW23FF6YXXHCW6C6NPQUE5VZQT5PVKVSI3QIILPNVJHYYBA4FA, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.031724328 (8h44m59.990821567s) [noise=true , address=104.36.82.14:4238 , piece_id=TKXGQSYKRGK4APMPZ2SM62LE7SBLDLNBNQJKGQQNROVQC3V57XEQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.034015821 (8h44m59.993113059s) [noise=true , address=104.36.82.8:4983 , piece_id=7Z3ESXBUZPGZ4B3UOBGJMQTLIORRPYGISSWBVBGPJ5NZLBUSYQQQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.039241260 (8h44m59.998338494s) [noise=true , address=104.36.82.34:4555 , piece_id=FDBGAOUH2TNFRWOUVOUITLKDMEF3DTR7LZ366XU7IIBLPM7754MQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.084935610 (8h45m0.044032847s) [noise=true , address=79.127.219.51:4185 , piece_id=YEKJOTAO5GNJJ4EXXZQ67PBOEVF5CMRWS2YILIWEYH7SPCYDJDFQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.094851780 (8h45m0.053949012s) [noise=true , address=104.36.82.59:4336 , piece_id=XKEMPPIYH3H3G2MBNNTTFLOYDNTLH6XZIDS3GAMJBRBTUSRPD2IA, seg_pos={0 0}, upload=9072]: Done uploading piece. err: <nil>
Aug 9 02:10:38.094888338 (8h45m0.053985583s) [seg_pos={0 0}, upload=9072]: Segment reached optimal threshold of 14 pieces.
Aug 9 02:10:38.095192665 (8h45m0.054289897s) [noise=true , address=104.36.82.44:4896 , piece_id=LH3KS6YE4VX4TNUPTJSGMKQZH6XNFIGEG4QCI6RSEZCGTGRGUKIA, seg_pos={0 0}, upload=9072]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ndSgjgfZMVQni5tw1ugdTrhJt4c4NagdvgYTbSbjatYYtfu1o): protocol: expected piece hash; context canceled; EOF
Aug 9 02:10:38.095235469 (8h45m0.054332713s) [noise=true , address=79.127.201.215:4344 , piece_id=GMLUHW4RJO2B5CA3FRJXREMPPA3GI5UAJ75MCKSPWCMDB4XZTB3A, seg_pos={0 0}, upload=9072]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12RXve6Cd4pYRqUySbbaUKk9Xz3qjMPDAit9XRveV5DL5p3iVwU): protocol: expected piece hash; context canceled; EOF
Aug 9 02:10:38.095344994 (8h45m0.054442225s) [noise=true , address=79.127.201.215:4346 , piece_id=A4ZZJR37JVXZJENDXEPEWRHOXWGJJIQWMNDJDP3K4AYTFWBBRZVA, seg_pos={0 0}, upload=9072]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1233Rr1BSqzZQFufL1FJor8kQyMNY22A9kpcKwvWe6SMniRBYAT): protocol: expected piece hash; context canceled; EOF
Aug 9 02:10:38.095490516 (8h45m0.054587748s) [noise=true , address=64.49.13.27:4965 , piece_id=RY6ZCWIZLZJ5ODB5VQL5HHLAWMVCPR3DGFA2EHJK7YX3PD64ICCQ, seg_pos={0 0}, upload=9072]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WVhm2QyhAf1y6HXRpyChMLbDLhZJQHEE2kQpstZH2dkwNhd7P): protocol: write tcp 139.59.144.22:60048->64.49.13.27:4965: use of closed network connection; write tcp 139.59.144.22:60048->64.49.13.27:4965: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:60048->64.49.13.27:4965: use of closed network connection
Aug 9 02:10:38.095501617 (8h45m0.054598848s) [seg_pos={0 0}, upload=9072]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 02:10:38.095587096 (8h45m0.054684328s) [upload=9072]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 02:10:38.095591184 (8h45m0.054688416s) [upload=9072]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 02:10:38.283711477 (8h45m0.242808728s) [upload=9072]: Done uploading segments...
Aug 9 02:10:38.283731544 (8h45m0.242828775s) [upload=9072]: Upload finished. err: <nil>
Duration: 1.679383386s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....X........X.....................................X........] duration:
879.325675ms
FAIL (2025-08-09 02:10:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:04:31.977231824 (8h38m53.93632908s) [upload=8967]: Starting upload Aug 9 02:04:31.977318166 (8h38m53.936415419s) [upload=8967]: Done starting upload Aug 9 02:04:31.977468417 (8h38m53.936565654s) [upload=8967]: Uploading segments... Aug 9 02:04:31.977561216 (8h38m53.93665847s) [upload=8967]: Got next segment. Inline: true Aug 9 02:04:31.977569010 (8h38m53.936666256s) [upload=8967]: Waiting for error group managing segments... Aug 9 02:04:31.977632258 (8h38m53.936729507s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 02:04:31.977637624 (8h38m53.936734872s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 02:04:31.977641013 (8h38m53.936738258s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 02:04:32.067582835 (8h38m54.02668009s) [upload=8967]: Done uploading segments... Aug 9 02:04:32.067611492 (8h38m54.026708745s) [upload=8967]: Upload finished. err: metaclient: Too Many Requests
Duration: 879.360291ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....X........X.....................................X.......] duration:
889.609541ms
FAIL (2025-08-09 02:09:51 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:04:31.977231824 (8h38m53.93632908s) [upload=8967]: Starting upload Aug 9 02:04:31.977318166 (8h38m53.936415419s) [upload=8967]: Done starting upload Aug 9 02:04:31.977468417 (8h38m53.936565654s) [upload=8967]: Uploading segments... Aug 9 02:04:31.977561216 (8h38m53.93665847s) [upload=8967]: Got next segment. Inline: true Aug 9 02:04:31.977569010 (8h38m53.936666256s) [upload=8967]: Waiting for error group managing segments... Aug 9 02:04:31.977632258 (8h38m53.936729507s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 02:04:31.977637624 (8h38m53.936734872s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 02:04:31.977641013 (8h38m53.936738258s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 02:04:32.067582835 (8h38m54.02668009s) [upload=8967]: Done uploading segments... Aug 9 02:04:32.067611492 (8h38m54.026708745s) [upload=8967]: Upload finished. err: metaclient: Too Many Requests
Duration: 889.688356ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X..........X.........................................] duration:
2.410670689s
FAIL (2025-08-09 02:09:49 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 94afcee7731a2b877dfcae283ac3ff6dfc82b6c045d3239802dbbab47b431857 != before a467afc70c7187cd4597cb7b3731ac500946666b57769b2188794949ffc86afe
======LOGS======
Aug 9 01:37:39.977951417 (8h12m1.937048655s) [upload=8506]: Starting upload
Aug 9 01:37:39.978012527 (8h12m1.937109772s) [upload=8506]: Done starting upload
Aug 9 01:37:39.978139735 (8h12m1.937236973s) [upload=8506]: Uploading segments...
Aug 9 01:37:39.978272880 (8h12m1.937370126s) [upload=8506]: Got next segment. Inline: false
Aug 9 01:37:39.978323989 (8h12m1.93742124s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 01:37:39.978330714 (8h12m1.937427961s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 01:37:40.180138125 (8h12m2.139235371s) [seg_pos={0 0}, upload=8506]: Begin upload segment...
Aug 9 01:37:40.180207573 (8h12m2.139304811s) [seg_pos={0 0}, upload=8506]: Done begin upload segment.
Aug 9 01:37:40.180240200 (8h12m2.139337436s) [noise=true , address=104.36.82.43:4843 , piece_id=WVO2C7GOJSQWZAF67TBW3MTXRUVRSVILYVARLEMF4H54Z2QFT4JA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180267541 (8h12m2.139364796s) [noise=true , address=104.36.82.44:4872 , piece_id=E3BVSGBN23F5TQXNQKBZWU4GE3E5NLNT3446IUIR6C32KKA66X4Q, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180662941 (8h12m2.139760195s) [noise=true , address=79.127.201.215:4357 , piece_id=5BUGCF53FXENMTR37BKGHXS7X7SLMZZMKWQQHRITBY2EZUWHCIPQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180687333 (8h12m2.139784579s) [noise=true , address=104.36.82.8:4991 , piece_id=JB47QIZZRPBUQX4OZRP6CY46GOGBSRF3YYCBTL3XVOUK34OK3TMA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180981984 (8h12m2.14007923s) [noise=true , address=104.36.82.61:4389 , piece_id=PSL3YRUSQ4S4HVHON6LN7Q4ZRLVIGKTGBK2R5KVY5CQMCFAZJIEQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181059607 (8h12m2.140156855s) [noise=true , address=156.146.43.225:4447 , piece_id=VNI2L3DYKSVKFSBG6T4XBZN3TAYMTXR3WFWWFHBKRVLTHSJMJKCA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181398585 (8h12m2.14049584s) [noise=true , address=104.36.82.36:4649 , piece_id=XVEF6EPWEMC5MEXARNPYZ26WRJVNFLYS7W4MPCUZHTZT5XGKJBMA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181524608 (8h12m2.14062186s) [noise=true , address=104.36.82.58:4280 , piece_id=YUVJ2G4JOQECOGIQHCNF7FBR3SECNEKLVM3F2QBXV3GSAOAIOHVQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181796488 (8h12m2.140893742s) [noise=true , address=104.36.82.46:4516 , piece_id=IKLQNZYBXHLDGDP7S4OEZQ3RC6YOKQ5IXXM6MEWQKFIGDUB7FLVA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181982190 (8h12m2.141079441s) [noise=true , address=104.36.82.37:4660 , piece_id=M5U7KGBHFG7UYF6WLQEISXE64PF6DYG7NHI47CYQUXXWAVID64PA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182147460 (8h12m2.141244711s) [noise=true , address=104.36.82.62:4414 , piece_id=PLF3SDZAWZM2KMV76N3Q5ZRD2UMWNJNH2VMCGBTX4D34MNWA675A, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182356147 (8h12m2.141453406s) [noise=true , address=104.36.82.55:4197 , piece_id=N4QTMFXNAKANGTEPCLZG6JUTGCCBW7QJAQZFKUKF4QEOANYPKJNQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182437159 (8h12m2.14153441s) [noise=true , address=104.36.82.52:4108 , piece_id=Y744EJMSDJ4OBGSF57UAOFSJER4TPJ7BXTTY5HBUSP2WDSD4FOHA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182689680 (8h12m2.141786928s) [noise=true , address=104.36.82.36:4648 , piece_id=JBR4ONZYRTSQ52PHKLEHWUPBXUDK6OPGYUOQQV7QUG6UMOXIHS2A, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182725202 (8h12m2.14182245s) [noise=true , address=64.49.13.169:4710 , piece_id=TOFOCQ2F35L7QY6WPUTPD2XZOHGM7BYZOTBKKTOYHBSSL5ZPCI4Q, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182986738 (8h12m2.142083987s) [noise=true , address=104.36.82.60:4351 , piece_id=3FYQGNJSC44EP5LPPB7MDSBOJB3VQI5WII7PXKPSH7KKHV3UGNOQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.183281883 (8h12m2.142379114s) [noise=true , address=79.127.205.233:4625 , piece_id=Q5OP7MQWKI5LVAOXSVIKD7HLHIIIGNP4GFBSBGOU7KRYKLMMKDVA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.183698827 (8h12m2.14279608s) [noise=true , address=104.36.82.22:4517 , piece_id=YNKWDF2L46QGZZGCIO4VXUWGDUFQFLQK5PQOA2BFV32BUI53TZIA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.785004157 (8h12m2.74410141s) [upload=8506]: Next returned nil segment
Aug 9 01:37:40.785025779 (8h12m2.74412303s) [upload=8506]: Waiting for error group managing segments...
Aug 9 01:37:40.942088464 (8h12m2.901185709s) [noise=true , address=104.36.82.43:4843 , piece_id=WVO2C7GOJSQWZAF67TBW3MTXRUVRSVILYVARLEMF4H54Z2QFT4JA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.943893997 (8h12m2.902991243s) [noise=true , address=104.36.82.8:4991 , piece_id=JB47QIZZRPBUQX4OZRP6CY46GOGBSRF3YYCBTL3XVOUK34OK3TMA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.948240181 (8h12m2.90733742s) [noise=true , address=104.36.82.61:4389 , piece_id=PSL3YRUSQ4S4HVHON6LN7Q4ZRLVIGKTGBK2R5KVY5CQMCFAZJIEQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.965455840 (8h12m2.924553078s) [noise=true , address=104.36.82.22:4517 , piece_id=YNKWDF2L46QGZZGCIO4VXUWGDUFQFLQK5PQOA2BFV32BUI53TZIA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.965793772 (8h12m2.924891015s) [noise=true , address=104.36.82.60:4351 , piece_id=3FYQGNJSC44EP5LPPB7MDSBOJB3VQI5WII7PXKPSH7KKHV3UGNOQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.967071943 (8h12m2.926169174s) [noise=true , address=104.36.82.44:4872 , piece_id=E3BVSGBN23F5TQXNQKBZWU4GE3E5NLNT3446IUIR6C32KKA66X4Q, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.972526119 (8h12m2.931623363s) [noise=true , address=104.36.82.55:4197 , piece_id=N4QTMFXNAKANGTEPCLZG6JUTGCCBW7QJAQZFKUKF4QEOANYPKJNQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.973224814 (8h12m2.932322051s) [noise=true , address=104.36.82.36:4649 , piece_id=XVEF6EPWEMC5MEXARNPYZ26WRJVNFLYS7W4MPCUZHTZT5XGKJBMA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.976278379 (8h12m2.935375629s) [noise=true , address=104.36.82.62:4414 , piece_id=PLF3SDZAWZM2KMV76N3Q5ZRD2UMWNJNH2VMCGBTX4D34MNWA675A, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.977210898 (8h12m2.936308144s) [noise=true , address=104.36.82.36:4648 , piece_id=JBR4ONZYRTSQ52PHKLEHWUPBXUDK6OPGYUOQQV7QUG6UMOXIHS2A, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.983081736 (8h12m2.942178972s) [noise=true , address=104.36.82.58:4280 , piece_id=YUVJ2G4JOQECOGIQHCNF7FBR3SECNEKLVM3F2QBXV3GSAOAIOHVQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.001400028 (8h12m2.960497282s) [noise=true , address=104.36.82.46:4516 , piece_id=IKLQNZYBXHLDGDP7S4OEZQ3RC6YOKQ5IXXM6MEWQKFIGDUB7FLVA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.018227379 (8h12m2.977324618s) [noise=true , address=104.36.82.37:4660 , piece_id=M5U7KGBHFG7UYF6WLQEISXE64PF6DYG7NHI47CYQUXXWAVID64PA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.107000447 (8h12m3.066097679s) [noise=true , address=79.127.201.215:4357 , piece_id=5BUGCF53FXENMTR37BKGHXS7X7SLMZZMKWQQHRITBY2EZUWHCIPQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.107023182 (8h12m3.066120414s) [seg_pos={0 0}, upload=8506]: Segment reached optimal threshold of 14 pieces.
Aug 9 01:37:41.107386732 (8h12m3.066483977s) [noise=true , address=156.146.43.225:4447 , piece_id=VNI2L3DYKSVKFSBG6T4XBZN3TAYMTXR3WFWWFHBKRVLTHSJMJKCA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cxeoGU2UJZiVGgmdmWW5iqfhGzBCvMGc7sXT1F2cEUhuQztkB): protocol: expected piece hash; context canceled; EOF
Aug 9 01:37:41.107771226 (8h12m3.06686847s) [noise=true , address=79.127.205.233:4625 , piece_id=Q5OP7MQWKI5LVAOXSVIKD7HLHIIIGNP4GFBSBGOU7KRYKLMMKDVA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sq71vD4JQ9eSC57mKXGJDm2rN83CbsByuwi49iESzH4U155kD): protocol: write tcp 139.59.144.22:42468->79.127.205.233:4625: use of closed network connection; write tcp 139.59.144.22:42468->79.127.205.233:4625: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42468->79.127.205.233:4625: use of closed network connection
Aug 9 01:37:41.107852883 (8h12m3.066950131s) [noise=true , address=64.49.13.169:4710 , piece_id=TOFOCQ2F35L7QY6WPUTPD2XZOHGM7BYZOTBKKTOYHBSSL5ZPCI4Q, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: write tcp 139.59.144.22:40654->64.49.13.169:4710: use of closed network connection; write tcp 139.59.144.22:40654->64.49.13.169:4710: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40654->64.49.13.169:4710: use of closed network connection
Aug 9 01:37:41.108063179 (8h12m3.067160425s) [noise=true , address=104.36.82.52:4108 , piece_id=Y744EJMSDJ4OBGSF57UAOFSJER4TPJ7BXTTY5HBUSP2WDSD4FOHA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XJJZCUSHUS52YC6jhoPB4ayjsyKZT477PymPj4inkZtdUvheT): protocol: write tcp 139.59.144.22:57682->104.36.82.52:4108: use of closed network connection; write tcp 139.59.144.22:57682->104.36.82.52:4108: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57682->104.36.82.52:4108: use of closed network connection
Aug 9 01:37:41.108082464 (8h12m3.067179699s) [seg_pos={0 0}, upload=8506]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 01:37:41.108208497 (8h12m3.067305745s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 01:37:41.108213756 (8h12m3.067311001s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 01:37:41.420082799 (8h12m3.379180055s) [upload=8506]: Done uploading segments...
Aug 9 01:37:41.420118181 (8h12m3.379215434s) [upload=8506]: Upload finished. err: <nil>
Duration: 2.410727363s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........X..........X........................................] duration:
2.366246808s
FAIL (2025-08-09 02:09:12 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 94afcee7731a2b877dfcae283ac3ff6dfc82b6c045d3239802dbbab47b431857 != before a467afc70c7187cd4597cb7b3731ac500946666b57769b2188794949ffc86afe
======LOGS======
Aug 9 01:37:39.977951417 (8h12m1.937048655s) [upload=8506]: Starting upload
Aug 9 01:37:39.978012527 (8h12m1.937109772s) [upload=8506]: Done starting upload
Aug 9 01:37:39.978139735 (8h12m1.937236973s) [upload=8506]: Uploading segments...
Aug 9 01:37:39.978272880 (8h12m1.937370126s) [upload=8506]: Got next segment. Inline: false
Aug 9 01:37:39.978323989 (8h12m1.93742124s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 01:37:39.978330714 (8h12m1.937427961s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 01:37:40.180138125 (8h12m2.139235371s) [seg_pos={0 0}, upload=8506]: Begin upload segment...
Aug 9 01:37:40.180207573 (8h12m2.139304811s) [seg_pos={0 0}, upload=8506]: Done begin upload segment.
Aug 9 01:37:40.180240200 (8h12m2.139337436s) [noise=true , address=104.36.82.43:4843 , piece_id=WVO2C7GOJSQWZAF67TBW3MTXRUVRSVILYVARLEMF4H54Z2QFT4JA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180267541 (8h12m2.139364796s) [noise=true , address=104.36.82.44:4872 , piece_id=E3BVSGBN23F5TQXNQKBZWU4GE3E5NLNT3446IUIR6C32KKA66X4Q, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180662941 (8h12m2.139760195s) [noise=true , address=79.127.201.215:4357 , piece_id=5BUGCF53FXENMTR37BKGHXS7X7SLMZZMKWQQHRITBY2EZUWHCIPQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180687333 (8h12m2.139784579s) [noise=true , address=104.36.82.8:4991 , piece_id=JB47QIZZRPBUQX4OZRP6CY46GOGBSRF3YYCBTL3XVOUK34OK3TMA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180981984 (8h12m2.14007923s) [noise=true , address=104.36.82.61:4389 , piece_id=PSL3YRUSQ4S4HVHON6LN7Q4ZRLVIGKTGBK2R5KVY5CQMCFAZJIEQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181059607 (8h12m2.140156855s) [noise=true , address=156.146.43.225:4447 , piece_id=VNI2L3DYKSVKFSBG6T4XBZN3TAYMTXR3WFWWFHBKRVLTHSJMJKCA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181398585 (8h12m2.14049584s) [noise=true , address=104.36.82.36:4649 , piece_id=XVEF6EPWEMC5MEXARNPYZ26WRJVNFLYS7W4MPCUZHTZT5XGKJBMA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181524608 (8h12m2.14062186s) [noise=true , address=104.36.82.58:4280 , piece_id=YUVJ2G4JOQECOGIQHCNF7FBR3SECNEKLVM3F2QBXV3GSAOAIOHVQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181796488 (8h12m2.140893742s) [noise=true , address=104.36.82.46:4516 , piece_id=IKLQNZYBXHLDGDP7S4OEZQ3RC6YOKQ5IXXM6MEWQKFIGDUB7FLVA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181982190 (8h12m2.141079441s) [noise=true , address=104.36.82.37:4660 , piece_id=M5U7KGBHFG7UYF6WLQEISXE64PF6DYG7NHI47CYQUXXWAVID64PA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182147460 (8h12m2.141244711s) [noise=true , address=104.36.82.62:4414 , piece_id=PLF3SDZAWZM2KMV76N3Q5ZRD2UMWNJNH2VMCGBTX4D34MNWA675A, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182356147 (8h12m2.141453406s) [noise=true , address=104.36.82.55:4197 , piece_id=N4QTMFXNAKANGTEPCLZG6JUTGCCBW7QJAQZFKUKF4QEOANYPKJNQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182437159 (8h12m2.14153441s) [noise=true , address=104.36.82.52:4108 , piece_id=Y744EJMSDJ4OBGSF57UAOFSJER4TPJ7BXTTY5HBUSP2WDSD4FOHA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182689680 (8h12m2.141786928s) [noise=true , address=104.36.82.36:4648 , piece_id=JBR4ONZYRTSQ52PHKLEHWUPBXUDK6OPGYUOQQV7QUG6UMOXIHS2A, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182725202 (8h12m2.14182245s) [noise=true , address=64.49.13.169:4710 , piece_id=TOFOCQ2F35L7QY6WPUTPD2XZOHGM7BYZOTBKKTOYHBSSL5ZPCI4Q, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182986738 (8h12m2.142083987s) [noise=true , address=104.36.82.60:4351 , piece_id=3FYQGNJSC44EP5LPPB7MDSBOJB3VQI5WII7PXKPSH7KKHV3UGNOQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.183281883 (8h12m2.142379114s) [noise=true , address=79.127.205.233:4625 , piece_id=Q5OP7MQWKI5LVAOXSVIKD7HLHIIIGNP4GFBSBGOU7KRYKLMMKDVA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.183698827 (8h12m2.14279608s) [noise=true , address=104.36.82.22:4517 , piece_id=YNKWDF2L46QGZZGCIO4VXUWGDUFQFLQK5PQOA2BFV32BUI53TZIA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.785004157 (8h12m2.74410141s) [upload=8506]: Next returned nil segment
Aug 9 01:37:40.785025779 (8h12m2.74412303s) [upload=8506]: Waiting for error group managing segments...
Aug 9 01:37:40.942088464 (8h12m2.901185709s) [noise=true , address=104.36.82.43:4843 , piece_id=WVO2C7GOJSQWZAF67TBW3MTXRUVRSVILYVARLEMF4H54Z2QFT4JA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.943893997 (8h12m2.902991243s) [noise=true , address=104.36.82.8:4991 , piece_id=JB47QIZZRPBUQX4OZRP6CY46GOGBSRF3YYCBTL3XVOUK34OK3TMA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.948240181 (8h12m2.90733742s) [noise=true , address=104.36.82.61:4389 , piece_id=PSL3YRUSQ4S4HVHON6LN7Q4ZRLVIGKTGBK2R5KVY5CQMCFAZJIEQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.965455840 (8h12m2.924553078s) [noise=true , address=104.36.82.22:4517 , piece_id=YNKWDF2L46QGZZGCIO4VXUWGDUFQFLQK5PQOA2BFV32BUI53TZIA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.965793772 (8h12m2.924891015s) [noise=true , address=104.36.82.60:4351 , piece_id=3FYQGNJSC44EP5LPPB7MDSBOJB3VQI5WII7PXKPSH7KKHV3UGNOQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.967071943 (8h12m2.926169174s) [noise=true , address=104.36.82.44:4872 , piece_id=E3BVSGBN23F5TQXNQKBZWU4GE3E5NLNT3446IUIR6C32KKA66X4Q, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.972526119 (8h12m2.931623363s) [noise=true , address=104.36.82.55:4197 , piece_id=N4QTMFXNAKANGTEPCLZG6JUTGCCBW7QJAQZFKUKF4QEOANYPKJNQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.973224814 (8h12m2.932322051s) [noise=true , address=104.36.82.36:4649 , piece_id=XVEF6EPWEMC5MEXARNPYZ26WRJVNFLYS7W4MPCUZHTZT5XGKJBMA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.976278379 (8h12m2.935375629s) [noise=true , address=104.36.82.62:4414 , piece_id=PLF3SDZAWZM2KMV76N3Q5ZRD2UMWNJNH2VMCGBTX4D34MNWA675A, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.977210898 (8h12m2.936308144s) [noise=true , address=104.36.82.36:4648 , piece_id=JBR4ONZYRTSQ52PHKLEHWUPBXUDK6OPGYUOQQV7QUG6UMOXIHS2A, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.983081736 (8h12m2.942178972s) [noise=true , address=104.36.82.58:4280 , piece_id=YUVJ2G4JOQECOGIQHCNF7FBR3SECNEKLVM3F2QBXV3GSAOAIOHVQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.001400028 (8h12m2.960497282s) [noise=true , address=104.36.82.46:4516 , piece_id=IKLQNZYBXHLDGDP7S4OEZQ3RC6YOKQ5IXXM6MEWQKFIGDUB7FLVA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.018227379 (8h12m2.977324618s) [noise=true , address=104.36.82.37:4660 , piece_id=M5U7KGBHFG7UYF6WLQEISXE64PF6DYG7NHI47CYQUXXWAVID64PA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.107000447 (8h12m3.066097679s) [noise=true , address=79.127.201.215:4357 , piece_id=5BUGCF53FXENMTR37BKGHXS7X7SLMZZMKWQQHRITBY2EZUWHCIPQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.107023182 (8h12m3.066120414s) [seg_pos={0 0}, upload=8506]: Segment reached optimal threshold of 14 pieces.
Aug 9 01:37:41.107386732 (8h12m3.066483977s) [noise=true , address=156.146.43.225:4447 , piece_id=VNI2L3DYKSVKFSBG6T4XBZN3TAYMTXR3WFWWFHBKRVLTHSJMJKCA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cxeoGU2UJZiVGgmdmWW5iqfhGzBCvMGc7sXT1F2cEUhuQztkB): protocol: expected piece hash; context canceled; EOF
Aug 9 01:37:41.107771226 (8h12m3.06686847s) [noise=true , address=79.127.205.233:4625 , piece_id=Q5OP7MQWKI5LVAOXSVIKD7HLHIIIGNP4GFBSBGOU7KRYKLMMKDVA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sq71vD4JQ9eSC57mKXGJDm2rN83CbsByuwi49iESzH4U155kD): protocol: write tcp 139.59.144.22:42468->79.127.205.233:4625: use of closed network connection; write tcp 139.59.144.22:42468->79.127.205.233:4625: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42468->79.127.205.233:4625: use of closed network connection
Aug 9 01:37:41.107852883 (8h12m3.066950131s) [noise=true , address=64.49.13.169:4710 , piece_id=TOFOCQ2F35L7QY6WPUTPD2XZOHGM7BYZOTBKKTOYHBSSL5ZPCI4Q, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: write tcp 139.59.144.22:40654->64.49.13.169:4710: use of closed network connection; write tcp 139.59.144.22:40654->64.49.13.169:4710: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40654->64.49.13.169:4710: use of closed network connection
Aug 9 01:37:41.108063179 (8h12m3.067160425s) [noise=true , address=104.36.82.52:4108 , piece_id=Y744EJMSDJ4OBGSF57UAOFSJER4TPJ7BXTTY5HBUSP2WDSD4FOHA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XJJZCUSHUS52YC6jhoPB4ayjsyKZT477PymPj4inkZtdUvheT): protocol: write tcp 139.59.144.22:57682->104.36.82.52:4108: use of closed network connection; write tcp 139.59.144.22:57682->104.36.82.52:4108: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57682->104.36.82.52:4108: use of closed network connection
Aug 9 01:37:41.108082464 (8h12m3.067179699s) [seg_pos={0 0}, upload=8506]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 01:37:41.108208497 (8h12m3.067305745s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 01:37:41.108213756 (8h12m3.067311001s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 01:37:41.420082799 (8h12m3.379180055s) [upload=8506]: Done uploading segments...
Aug 9 01:37:41.420118181 (8h12m3.379215434s) [upload=8506]: Upload finished. err: <nil>
Duration: 2.366273796s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......X........X.....................................X......] duration:
915.855415ms
FAIL (2025-08-09 02:09:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:04:31.977231824 (8h38m53.93632908s) [upload=8967]: Starting upload Aug 9 02:04:31.977318166 (8h38m53.936415419s) [upload=8967]: Done starting upload Aug 9 02:04:31.977468417 (8h38m53.936565654s) [upload=8967]: Uploading segments... Aug 9 02:04:31.977561216 (8h38m53.93665847s) [upload=8967]: Got next segment. Inline: true Aug 9 02:04:31.977569010 (8h38m53.936666256s) [upload=8967]: Waiting for error group managing segments... Aug 9 02:04:31.977632258 (8h38m53.936729507s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 02:04:31.977637624 (8h38m53.936734872s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 02:04:31.977641013 (8h38m53.936738258s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 02:04:32.067582835 (8h38m54.02668009s) [upload=8967]: Done uploading segments... Aug 9 02:04:32.067611492 (8h38m54.026708745s) [upload=8967]: Upload finished. err: metaclient: Too Many Requests
Duration: 915.88924ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......X........X.....................................X.....] duration:
864.782965ms
FAIL (2025-08-09 02:08:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:04:31.977231824 (8h38m53.93632908s) [upload=8967]: Starting upload Aug 9 02:04:31.977318166 (8h38m53.936415419s) [upload=8967]: Done starting upload Aug 9 02:04:31.977468417 (8h38m53.936565654s) [upload=8967]: Uploading segments... Aug 9 02:04:31.977561216 (8h38m53.93665847s) [upload=8967]: Got next segment. Inline: true Aug 9 02:04:31.977569010 (8h38m53.936666256s) [upload=8967]: Waiting for error group managing segments... Aug 9 02:04:31.977632258 (8h38m53.936729507s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 02:04:31.977637624 (8h38m53.936734872s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 02:04:31.977641013 (8h38m53.936738258s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 02:04:32.067582835 (8h38m54.02668009s) [upload=8967]: Done uploading segments... Aug 9 02:04:32.067611492 (8h38m54.026708745s) [upload=8967]: Upload finished. err: metaclient: Too Many Requests
Duration: 864.839555ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........X..........X.......................................] duration:
2.396721059s
FAIL (2025-08-09 02:08:05 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 94afcee7731a2b877dfcae283ac3ff6dfc82b6c045d3239802dbbab47b431857 != before a467afc70c7187cd4597cb7b3731ac500946666b57769b2188794949ffc86afe
======LOGS======
Aug 9 01:37:39.977951417 (8h12m1.937048655s) [upload=8506]: Starting upload
Aug 9 01:37:39.978012527 (8h12m1.937109772s) [upload=8506]: Done starting upload
Aug 9 01:37:39.978139735 (8h12m1.937236973s) [upload=8506]: Uploading segments...
Aug 9 01:37:39.978272880 (8h12m1.937370126s) [upload=8506]: Got next segment. Inline: false
Aug 9 01:37:39.978323989 (8h12m1.93742124s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 01:37:39.978330714 (8h12m1.937427961s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 01:37:40.180138125 (8h12m2.139235371s) [seg_pos={0 0}, upload=8506]: Begin upload segment...
Aug 9 01:37:40.180207573 (8h12m2.139304811s) [seg_pos={0 0}, upload=8506]: Done begin upload segment.
Aug 9 01:37:40.180240200 (8h12m2.139337436s) [noise=true , address=104.36.82.43:4843 , piece_id=WVO2C7GOJSQWZAF67TBW3MTXRUVRSVILYVARLEMF4H54Z2QFT4JA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180267541 (8h12m2.139364796s) [noise=true , address=104.36.82.44:4872 , piece_id=E3BVSGBN23F5TQXNQKBZWU4GE3E5NLNT3446IUIR6C32KKA66X4Q, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180662941 (8h12m2.139760195s) [noise=true , address=79.127.201.215:4357 , piece_id=5BUGCF53FXENMTR37BKGHXS7X7SLMZZMKWQQHRITBY2EZUWHCIPQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180687333 (8h12m2.139784579s) [noise=true , address=104.36.82.8:4991 , piece_id=JB47QIZZRPBUQX4OZRP6CY46GOGBSRF3YYCBTL3XVOUK34OK3TMA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180981984 (8h12m2.14007923s) [noise=true , address=104.36.82.61:4389 , piece_id=PSL3YRUSQ4S4HVHON6LN7Q4ZRLVIGKTGBK2R5KVY5CQMCFAZJIEQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181059607 (8h12m2.140156855s) [noise=true , address=156.146.43.225:4447 , piece_id=VNI2L3DYKSVKFSBG6T4XBZN3TAYMTXR3WFWWFHBKRVLTHSJMJKCA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181398585 (8h12m2.14049584s) [noise=true , address=104.36.82.36:4649 , piece_id=XVEF6EPWEMC5MEXARNPYZ26WRJVNFLYS7W4MPCUZHTZT5XGKJBMA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181524608 (8h12m2.14062186s) [noise=true , address=104.36.82.58:4280 , piece_id=YUVJ2G4JOQECOGIQHCNF7FBR3SECNEKLVM3F2QBXV3GSAOAIOHVQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181796488 (8h12m2.140893742s) [noise=true , address=104.36.82.46:4516 , piece_id=IKLQNZYBXHLDGDP7S4OEZQ3RC6YOKQ5IXXM6MEWQKFIGDUB7FLVA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181982190 (8h12m2.141079441s) [noise=true , address=104.36.82.37:4660 , piece_id=M5U7KGBHFG7UYF6WLQEISXE64PF6DYG7NHI47CYQUXXWAVID64PA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182147460 (8h12m2.141244711s) [noise=true , address=104.36.82.62:4414 , piece_id=PLF3SDZAWZM2KMV76N3Q5ZRD2UMWNJNH2VMCGBTX4D34MNWA675A, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182356147 (8h12m2.141453406s) [noise=true , address=104.36.82.55:4197 , piece_id=N4QTMFXNAKANGTEPCLZG6JUTGCCBW7QJAQZFKUKF4QEOANYPKJNQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182437159 (8h12m2.14153441s) [noise=true , address=104.36.82.52:4108 , piece_id=Y744EJMSDJ4OBGSF57UAOFSJER4TPJ7BXTTY5HBUSP2WDSD4FOHA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182689680 (8h12m2.141786928s) [noise=true , address=104.36.82.36:4648 , piece_id=JBR4ONZYRTSQ52PHKLEHWUPBXUDK6OPGYUOQQV7QUG6UMOXIHS2A, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182725202 (8h12m2.14182245s) [noise=true , address=64.49.13.169:4710 , piece_id=TOFOCQ2F35L7QY6WPUTPD2XZOHGM7BYZOTBKKTOYHBSSL5ZPCI4Q, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182986738 (8h12m2.142083987s) [noise=true , address=104.36.82.60:4351 , piece_id=3FYQGNJSC44EP5LPPB7MDSBOJB3VQI5WII7PXKPSH7KKHV3UGNOQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.183281883 (8h12m2.142379114s) [noise=true , address=79.127.205.233:4625 , piece_id=Q5OP7MQWKI5LVAOXSVIKD7HLHIIIGNP4GFBSBGOU7KRYKLMMKDVA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.183698827 (8h12m2.14279608s) [noise=true , address=104.36.82.22:4517 , piece_id=YNKWDF2L46QGZZGCIO4VXUWGDUFQFLQK5PQOA2BFV32BUI53TZIA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.785004157 (8h12m2.74410141s) [upload=8506]: Next returned nil segment
Aug 9 01:37:40.785025779 (8h12m2.74412303s) [upload=8506]: Waiting for error group managing segments...
Aug 9 01:37:40.942088464 (8h12m2.901185709s) [noise=true , address=104.36.82.43:4843 , piece_id=WVO2C7GOJSQWZAF67TBW3MTXRUVRSVILYVARLEMF4H54Z2QFT4JA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.943893997 (8h12m2.902991243s) [noise=true , address=104.36.82.8:4991 , piece_id=JB47QIZZRPBUQX4OZRP6CY46GOGBSRF3YYCBTL3XVOUK34OK3TMA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.948240181 (8h12m2.90733742s) [noise=true , address=104.36.82.61:4389 , piece_id=PSL3YRUSQ4S4HVHON6LN7Q4ZRLVIGKTGBK2R5KVY5CQMCFAZJIEQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.965455840 (8h12m2.924553078s) [noise=true , address=104.36.82.22:4517 , piece_id=YNKWDF2L46QGZZGCIO4VXUWGDUFQFLQK5PQOA2BFV32BUI53TZIA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.965793772 (8h12m2.924891015s) [noise=true , address=104.36.82.60:4351 , piece_id=3FYQGNJSC44EP5LPPB7MDSBOJB3VQI5WII7PXKPSH7KKHV3UGNOQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.967071943 (8h12m2.926169174s) [noise=true , address=104.36.82.44:4872 , piece_id=E3BVSGBN23F5TQXNQKBZWU4GE3E5NLNT3446IUIR6C32KKA66X4Q, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.972526119 (8h12m2.931623363s) [noise=true , address=104.36.82.55:4197 , piece_id=N4QTMFXNAKANGTEPCLZG6JUTGCCBW7QJAQZFKUKF4QEOANYPKJNQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.973224814 (8h12m2.932322051s) [noise=true , address=104.36.82.36:4649 , piece_id=XVEF6EPWEMC5MEXARNPYZ26WRJVNFLYS7W4MPCUZHTZT5XGKJBMA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.976278379 (8h12m2.935375629s) [noise=true , address=104.36.82.62:4414 , piece_id=PLF3SDZAWZM2KMV76N3Q5ZRD2UMWNJNH2VMCGBTX4D34MNWA675A, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.977210898 (8h12m2.936308144s) [noise=true , address=104.36.82.36:4648 , piece_id=JBR4ONZYRTSQ52PHKLEHWUPBXUDK6OPGYUOQQV7QUG6UMOXIHS2A, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.983081736 (8h12m2.942178972s) [noise=true , address=104.36.82.58:4280 , piece_id=YUVJ2G4JOQECOGIQHCNF7FBR3SECNEKLVM3F2QBXV3GSAOAIOHVQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.001400028 (8h12m2.960497282s) [noise=true , address=104.36.82.46:4516 , piece_id=IKLQNZYBXHLDGDP7S4OEZQ3RC6YOKQ5IXXM6MEWQKFIGDUB7FLVA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.018227379 (8h12m2.977324618s) [noise=true , address=104.36.82.37:4660 , piece_id=M5U7KGBHFG7UYF6WLQEISXE64PF6DYG7NHI47CYQUXXWAVID64PA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.107000447 (8h12m3.066097679s) [noise=true , address=79.127.201.215:4357 , piece_id=5BUGCF53FXENMTR37BKGHXS7X7SLMZZMKWQQHRITBY2EZUWHCIPQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.107023182 (8h12m3.066120414s) [seg_pos={0 0}, upload=8506]: Segment reached optimal threshold of 14 pieces.
Aug 9 01:37:41.107386732 (8h12m3.066483977s) [noise=true , address=156.146.43.225:4447 , piece_id=VNI2L3DYKSVKFSBG6T4XBZN3TAYMTXR3WFWWFHBKRVLTHSJMJKCA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cxeoGU2UJZiVGgmdmWW5iqfhGzBCvMGc7sXT1F2cEUhuQztkB): protocol: expected piece hash; context canceled; EOF
Aug 9 01:37:41.107771226 (8h12m3.06686847s) [noise=true , address=79.127.205.233:4625 , piece_id=Q5OP7MQWKI5LVAOXSVIKD7HLHIIIGNP4GFBSBGOU7KRYKLMMKDVA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sq71vD4JQ9eSC57mKXGJDm2rN83CbsByuwi49iESzH4U155kD): protocol: write tcp 139.59.144.22:42468->79.127.205.233:4625: use of closed network connection; write tcp 139.59.144.22:42468->79.127.205.233:4625: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42468->79.127.205.233:4625: use of closed network connection
Aug 9 01:37:41.107852883 (8h12m3.066950131s) [noise=true , address=64.49.13.169:4710 , piece_id=TOFOCQ2F35L7QY6WPUTPD2XZOHGM7BYZOTBKKTOYHBSSL5ZPCI4Q, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: write tcp 139.59.144.22:40654->64.49.13.169:4710: use of closed network connection; write tcp 139.59.144.22:40654->64.49.13.169:4710: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40654->64.49.13.169:4710: use of closed network connection
Aug 9 01:37:41.108063179 (8h12m3.067160425s) [noise=true , address=104.36.82.52:4108 , piece_id=Y744EJMSDJ4OBGSF57UAOFSJER4TPJ7BXTTY5HBUSP2WDSD4FOHA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XJJZCUSHUS52YC6jhoPB4ayjsyKZT477PymPj4inkZtdUvheT): protocol: write tcp 139.59.144.22:57682->104.36.82.52:4108: use of closed network connection; write tcp 139.59.144.22:57682->104.36.82.52:4108: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57682->104.36.82.52:4108: use of closed network connection
Aug 9 01:37:41.108082464 (8h12m3.067179699s) [seg_pos={0 0}, upload=8506]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 01:37:41.108208497 (8h12m3.067305745s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 01:37:41.108213756 (8h12m3.067311001s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 01:37:41.420082799 (8h12m3.379180055s) [upload=8506]: Done uploading segments...
Aug 9 01:37:41.420118181 (8h12m3.379215434s) [upload=8506]: Upload finished. err: <nil>
Duration: 2.39676801s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........X........X.....................................X....] duration:
869.940379ms
FAIL (2025-08-09 02:07:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:04:31.977231824 (8h38m53.93632908s) [upload=8967]: Starting upload Aug 9 02:04:31.977318166 (8h38m53.936415419s) [upload=8967]: Done starting upload Aug 9 02:04:31.977468417 (8h38m53.936565654s) [upload=8967]: Uploading segments... Aug 9 02:04:31.977561216 (8h38m53.93665847s) [upload=8967]: Got next segment. Inline: true Aug 9 02:04:31.977569010 (8h38m53.936666256s) [upload=8967]: Waiting for error group managing segments... Aug 9 02:04:31.977632258 (8h38m53.936729507s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 02:04:31.977637624 (8h38m53.936734872s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 02:04:31.977641013 (8h38m53.936738258s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 02:04:32.067582835 (8h38m54.02668009s) [upload=8967]: Done uploading segments... Aug 9 02:04:32.067611492 (8h38m54.026708745s) [upload=8967]: Upload finished. err: metaclient: Too Many Requests
Duration: 869.968671ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........X..........X......................................] duration:
2.496160221s
FAIL (2025-08-09 02:07:13 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 94afcee7731a2b877dfcae283ac3ff6dfc82b6c045d3239802dbbab47b431857 != before a467afc70c7187cd4597cb7b3731ac500946666b57769b2188794949ffc86afe
======LOGS======
Aug 9 01:37:39.977951417 (8h12m1.937048655s) [upload=8506]: Starting upload
Aug 9 01:37:39.978012527 (8h12m1.937109772s) [upload=8506]: Done starting upload
Aug 9 01:37:39.978139735 (8h12m1.937236973s) [upload=8506]: Uploading segments...
Aug 9 01:37:39.978272880 (8h12m1.937370126s) [upload=8506]: Got next segment. Inline: false
Aug 9 01:37:39.978323989 (8h12m1.93742124s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 01:37:39.978330714 (8h12m1.937427961s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 01:37:40.180138125 (8h12m2.139235371s) [seg_pos={0 0}, upload=8506]: Begin upload segment...
Aug 9 01:37:40.180207573 (8h12m2.139304811s) [seg_pos={0 0}, upload=8506]: Done begin upload segment.
Aug 9 01:37:40.180240200 (8h12m2.139337436s) [noise=true , address=104.36.82.43:4843 , piece_id=WVO2C7GOJSQWZAF67TBW3MTXRUVRSVILYVARLEMF4H54Z2QFT4JA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180267541 (8h12m2.139364796s) [noise=true , address=104.36.82.44:4872 , piece_id=E3BVSGBN23F5TQXNQKBZWU4GE3E5NLNT3446IUIR6C32KKA66X4Q, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180662941 (8h12m2.139760195s) [noise=true , address=79.127.201.215:4357 , piece_id=5BUGCF53FXENMTR37BKGHXS7X7SLMZZMKWQQHRITBY2EZUWHCIPQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180687333 (8h12m2.139784579s) [noise=true , address=104.36.82.8:4991 , piece_id=JB47QIZZRPBUQX4OZRP6CY46GOGBSRF3YYCBTL3XVOUK34OK3TMA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180981984 (8h12m2.14007923s) [noise=true , address=104.36.82.61:4389 , piece_id=PSL3YRUSQ4S4HVHON6LN7Q4ZRLVIGKTGBK2R5KVY5CQMCFAZJIEQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181059607 (8h12m2.140156855s) [noise=true , address=156.146.43.225:4447 , piece_id=VNI2L3DYKSVKFSBG6T4XBZN3TAYMTXR3WFWWFHBKRVLTHSJMJKCA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181398585 (8h12m2.14049584s) [noise=true , address=104.36.82.36:4649 , piece_id=XVEF6EPWEMC5MEXARNPYZ26WRJVNFLYS7W4MPCUZHTZT5XGKJBMA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181524608 (8h12m2.14062186s) [noise=true , address=104.36.82.58:4280 , piece_id=YUVJ2G4JOQECOGIQHCNF7FBR3SECNEKLVM3F2QBXV3GSAOAIOHVQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181796488 (8h12m2.140893742s) [noise=true , address=104.36.82.46:4516 , piece_id=IKLQNZYBXHLDGDP7S4OEZQ3RC6YOKQ5IXXM6MEWQKFIGDUB7FLVA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181982190 (8h12m2.141079441s) [noise=true , address=104.36.82.37:4660 , piece_id=M5U7KGBHFG7UYF6WLQEISXE64PF6DYG7NHI47CYQUXXWAVID64PA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182147460 (8h12m2.141244711s) [noise=true , address=104.36.82.62:4414 , piece_id=PLF3SDZAWZM2KMV76N3Q5ZRD2UMWNJNH2VMCGBTX4D34MNWA675A, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182356147 (8h12m2.141453406s) [noise=true , address=104.36.82.55:4197 , piece_id=N4QTMFXNAKANGTEPCLZG6JUTGCCBW7QJAQZFKUKF4QEOANYPKJNQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182437159 (8h12m2.14153441s) [noise=true , address=104.36.82.52:4108 , piece_id=Y744EJMSDJ4OBGSF57UAOFSJER4TPJ7BXTTY5HBUSP2WDSD4FOHA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182689680 (8h12m2.141786928s) [noise=true , address=104.36.82.36:4648 , piece_id=JBR4ONZYRTSQ52PHKLEHWUPBXUDK6OPGYUOQQV7QUG6UMOXIHS2A, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182725202 (8h12m2.14182245s) [noise=true , address=64.49.13.169:4710 , piece_id=TOFOCQ2F35L7QY6WPUTPD2XZOHGM7BYZOTBKKTOYHBSSL5ZPCI4Q, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182986738 (8h12m2.142083987s) [noise=true , address=104.36.82.60:4351 , piece_id=3FYQGNJSC44EP5LPPB7MDSBOJB3VQI5WII7PXKPSH7KKHV3UGNOQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.183281883 (8h12m2.142379114s) [noise=true , address=79.127.205.233:4625 , piece_id=Q5OP7MQWKI5LVAOXSVIKD7HLHIIIGNP4GFBSBGOU7KRYKLMMKDVA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.183698827 (8h12m2.14279608s) [noise=true , address=104.36.82.22:4517 , piece_id=YNKWDF2L46QGZZGCIO4VXUWGDUFQFLQK5PQOA2BFV32BUI53TZIA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.785004157 (8h12m2.74410141s) [upload=8506]: Next returned nil segment
Aug 9 01:37:40.785025779 (8h12m2.74412303s) [upload=8506]: Waiting for error group managing segments...
Aug 9 01:37:40.942088464 (8h12m2.901185709s) [noise=true , address=104.36.82.43:4843 , piece_id=WVO2C7GOJSQWZAF67TBW3MTXRUVRSVILYVARLEMF4H54Z2QFT4JA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.943893997 (8h12m2.902991243s) [noise=true , address=104.36.82.8:4991 , piece_id=JB47QIZZRPBUQX4OZRP6CY46GOGBSRF3YYCBTL3XVOUK34OK3TMA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.948240181 (8h12m2.90733742s) [noise=true , address=104.36.82.61:4389 , piece_id=PSL3YRUSQ4S4HVHON6LN7Q4ZRLVIGKTGBK2R5KVY5CQMCFAZJIEQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.965455840 (8h12m2.924553078s) [noise=true , address=104.36.82.22:4517 , piece_id=YNKWDF2L46QGZZGCIO4VXUWGDUFQFLQK5PQOA2BFV32BUI53TZIA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.965793772 (8h12m2.924891015s) [noise=true , address=104.36.82.60:4351 , piece_id=3FYQGNJSC44EP5LPPB7MDSBOJB3VQI5WII7PXKPSH7KKHV3UGNOQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.967071943 (8h12m2.926169174s) [noise=true , address=104.36.82.44:4872 , piece_id=E3BVSGBN23F5TQXNQKBZWU4GE3E5NLNT3446IUIR6C32KKA66X4Q, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.972526119 (8h12m2.931623363s) [noise=true , address=104.36.82.55:4197 , piece_id=N4QTMFXNAKANGTEPCLZG6JUTGCCBW7QJAQZFKUKF4QEOANYPKJNQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.973224814 (8h12m2.932322051s) [noise=true , address=104.36.82.36:4649 , piece_id=XVEF6EPWEMC5MEXARNPYZ26WRJVNFLYS7W4MPCUZHTZT5XGKJBMA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.976278379 (8h12m2.935375629s) [noise=true , address=104.36.82.62:4414 , piece_id=PLF3SDZAWZM2KMV76N3Q5ZRD2UMWNJNH2VMCGBTX4D34MNWA675A, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.977210898 (8h12m2.936308144s) [noise=true , address=104.36.82.36:4648 , piece_id=JBR4ONZYRTSQ52PHKLEHWUPBXUDK6OPGYUOQQV7QUG6UMOXIHS2A, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.983081736 (8h12m2.942178972s) [noise=true , address=104.36.82.58:4280 , piece_id=YUVJ2G4JOQECOGIQHCNF7FBR3SECNEKLVM3F2QBXV3GSAOAIOHVQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.001400028 (8h12m2.960497282s) [noise=true , address=104.36.82.46:4516 , piece_id=IKLQNZYBXHLDGDP7S4OEZQ3RC6YOKQ5IXXM6MEWQKFIGDUB7FLVA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.018227379 (8h12m2.977324618s) [noise=true , address=104.36.82.37:4660 , piece_id=M5U7KGBHFG7UYF6WLQEISXE64PF6DYG7NHI47CYQUXXWAVID64PA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.107000447 (8h12m3.066097679s) [noise=true , address=79.127.201.215:4357 , piece_id=5BUGCF53FXENMTR37BKGHXS7X7SLMZZMKWQQHRITBY2EZUWHCIPQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.107023182 (8h12m3.066120414s) [seg_pos={0 0}, upload=8506]: Segment reached optimal threshold of 14 pieces.
Aug 9 01:37:41.107386732 (8h12m3.066483977s) [noise=true , address=156.146.43.225:4447 , piece_id=VNI2L3DYKSVKFSBG6T4XBZN3TAYMTXR3WFWWFHBKRVLTHSJMJKCA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cxeoGU2UJZiVGgmdmWW5iqfhGzBCvMGc7sXT1F2cEUhuQztkB): protocol: expected piece hash; context canceled; EOF
Aug 9 01:37:41.107771226 (8h12m3.06686847s) [noise=true , address=79.127.205.233:4625 , piece_id=Q5OP7MQWKI5LVAOXSVIKD7HLHIIIGNP4GFBSBGOU7KRYKLMMKDVA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sq71vD4JQ9eSC57mKXGJDm2rN83CbsByuwi49iESzH4U155kD): protocol: write tcp 139.59.144.22:42468->79.127.205.233:4625: use of closed network connection; write tcp 139.59.144.22:42468->79.127.205.233:4625: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42468->79.127.205.233:4625: use of closed network connection
Aug 9 01:37:41.107852883 (8h12m3.066950131s) [noise=true , address=64.49.13.169:4710 , piece_id=TOFOCQ2F35L7QY6WPUTPD2XZOHGM7BYZOTBKKTOYHBSSL5ZPCI4Q, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: write tcp 139.59.144.22:40654->64.49.13.169:4710: use of closed network connection; write tcp 139.59.144.22:40654->64.49.13.169:4710: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40654->64.49.13.169:4710: use of closed network connection
Aug 9 01:37:41.108063179 (8h12m3.067160425s) [noise=true , address=104.36.82.52:4108 , piece_id=Y744EJMSDJ4OBGSF57UAOFSJER4TPJ7BXTTY5HBUSP2WDSD4FOHA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XJJZCUSHUS52YC6jhoPB4ayjsyKZT477PymPj4inkZtdUvheT): protocol: write tcp 139.59.144.22:57682->104.36.82.52:4108: use of closed network connection; write tcp 139.59.144.22:57682->104.36.82.52:4108: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57682->104.36.82.52:4108: use of closed network connection
Aug 9 01:37:41.108082464 (8h12m3.067179699s) [seg_pos={0 0}, upload=8506]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 01:37:41.108208497 (8h12m3.067305745s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 01:37:41.108213756 (8h12m3.067311001s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 01:37:41.420082799 (8h12m3.379180055s) [upload=8506]: Done uploading segments...
Aug 9 01:37:41.420118181 (8h12m3.379215434s) [upload=8506]: Upload finished. err: <nil>
Duration: 2.496189449s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X........X.....................................X...] duration:
883.897503ms
FAIL (2025-08-09 02:07:10 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:04:31.977231824 (8h38m53.93632908s) [upload=8967]: Starting upload Aug 9 02:04:31.977318166 (8h38m53.936415419s) [upload=8967]: Done starting upload Aug 9 02:04:31.977468417 (8h38m53.936565654s) [upload=8967]: Uploading segments... Aug 9 02:04:31.977561216 (8h38m53.93665847s) [upload=8967]: Got next segment. Inline: true Aug 9 02:04:31.977569010 (8h38m53.936666256s) [upload=8967]: Waiting for error group managing segments... Aug 9 02:04:31.977632258 (8h38m53.936729507s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 02:04:31.977637624 (8h38m53.936734872s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 02:04:31.977641013 (8h38m53.936738258s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 02:04:32.067582835 (8h38m54.02668009s) [upload=8967]: Done uploading segments... Aug 9 02:04:32.067611492 (8h38m54.026708745s) [upload=8967]: Upload finished. err: metaclient: Too Many Requests
Duration: 883.927204ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........X..........X.....................................] duration:
2.660394259s
FAIL (2025-08-09 02:06:53 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 94afcee7731a2b877dfcae283ac3ff6dfc82b6c045d3239802dbbab47b431857 != before a467afc70c7187cd4597cb7b3731ac500946666b57769b2188794949ffc86afe
======LOGS======
Aug 9 01:37:39.977951417 (8h12m1.937048655s) [upload=8506]: Starting upload
Aug 9 01:37:39.978012527 (8h12m1.937109772s) [upload=8506]: Done starting upload
Aug 9 01:37:39.978139735 (8h12m1.937236973s) [upload=8506]: Uploading segments...
Aug 9 01:37:39.978272880 (8h12m1.937370126s) [upload=8506]: Got next segment. Inline: false
Aug 9 01:37:39.978323989 (8h12m1.93742124s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 01:37:39.978330714 (8h12m1.937427961s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 01:37:40.180138125 (8h12m2.139235371s) [seg_pos={0 0}, upload=8506]: Begin upload segment...
Aug 9 01:37:40.180207573 (8h12m2.139304811s) [seg_pos={0 0}, upload=8506]: Done begin upload segment.
Aug 9 01:37:40.180240200 (8h12m2.139337436s) [noise=true , address=104.36.82.43:4843 , piece_id=WVO2C7GOJSQWZAF67TBW3MTXRUVRSVILYVARLEMF4H54Z2QFT4JA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180267541 (8h12m2.139364796s) [noise=true , address=104.36.82.44:4872 , piece_id=E3BVSGBN23F5TQXNQKBZWU4GE3E5NLNT3446IUIR6C32KKA66X4Q, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180662941 (8h12m2.139760195s) [noise=true , address=79.127.201.215:4357 , piece_id=5BUGCF53FXENMTR37BKGHXS7X7SLMZZMKWQQHRITBY2EZUWHCIPQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180687333 (8h12m2.139784579s) [noise=true , address=104.36.82.8:4991 , piece_id=JB47QIZZRPBUQX4OZRP6CY46GOGBSRF3YYCBTL3XVOUK34OK3TMA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180981984 (8h12m2.14007923s) [noise=true , address=104.36.82.61:4389 , piece_id=PSL3YRUSQ4S4HVHON6LN7Q4ZRLVIGKTGBK2R5KVY5CQMCFAZJIEQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181059607 (8h12m2.140156855s) [noise=true , address=156.146.43.225:4447 , piece_id=VNI2L3DYKSVKFSBG6T4XBZN3TAYMTXR3WFWWFHBKRVLTHSJMJKCA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181398585 (8h12m2.14049584s) [noise=true , address=104.36.82.36:4649 , piece_id=XVEF6EPWEMC5MEXARNPYZ26WRJVNFLYS7W4MPCUZHTZT5XGKJBMA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181524608 (8h12m2.14062186s) [noise=true , address=104.36.82.58:4280 , piece_id=YUVJ2G4JOQECOGIQHCNF7FBR3SECNEKLVM3F2QBXV3GSAOAIOHVQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181796488 (8h12m2.140893742s) [noise=true , address=104.36.82.46:4516 , piece_id=IKLQNZYBXHLDGDP7S4OEZQ3RC6YOKQ5IXXM6MEWQKFIGDUB7FLVA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181982190 (8h12m2.141079441s) [noise=true , address=104.36.82.37:4660 , piece_id=M5U7KGBHFG7UYF6WLQEISXE64PF6DYG7NHI47CYQUXXWAVID64PA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182147460 (8h12m2.141244711s) [noise=true , address=104.36.82.62:4414 , piece_id=PLF3SDZAWZM2KMV76N3Q5ZRD2UMWNJNH2VMCGBTX4D34MNWA675A, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182356147 (8h12m2.141453406s) [noise=true , address=104.36.82.55:4197 , piece_id=N4QTMFXNAKANGTEPCLZG6JUTGCCBW7QJAQZFKUKF4QEOANYPKJNQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182437159 (8h12m2.14153441s) [noise=true , address=104.36.82.52:4108 , piece_id=Y744EJMSDJ4OBGSF57UAOFSJER4TPJ7BXTTY5HBUSP2WDSD4FOHA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182689680 (8h12m2.141786928s) [noise=true , address=104.36.82.36:4648 , piece_id=JBR4ONZYRTSQ52PHKLEHWUPBXUDK6OPGYUOQQV7QUG6UMOXIHS2A, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182725202 (8h12m2.14182245s) [noise=true , address=64.49.13.169:4710 , piece_id=TOFOCQ2F35L7QY6WPUTPD2XZOHGM7BYZOTBKKTOYHBSSL5ZPCI4Q, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182986738 (8h12m2.142083987s) [noise=true , address=104.36.82.60:4351 , piece_id=3FYQGNJSC44EP5LPPB7MDSBOJB3VQI5WII7PXKPSH7KKHV3UGNOQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.183281883 (8h12m2.142379114s) [noise=true , address=79.127.205.233:4625 , piece_id=Q5OP7MQWKI5LVAOXSVIKD7HLHIIIGNP4GFBSBGOU7KRYKLMMKDVA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.183698827 (8h12m2.14279608s) [noise=true , address=104.36.82.22:4517 , piece_id=YNKWDF2L46QGZZGCIO4VXUWGDUFQFLQK5PQOA2BFV32BUI53TZIA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.785004157 (8h12m2.74410141s) [upload=8506]: Next returned nil segment
Aug 9 01:37:40.785025779 (8h12m2.74412303s) [upload=8506]: Waiting for error group managing segments...
Aug 9 01:37:40.942088464 (8h12m2.901185709s) [noise=true , address=104.36.82.43:4843 , piece_id=WVO2C7GOJSQWZAF67TBW3MTXRUVRSVILYVARLEMF4H54Z2QFT4JA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.943893997 (8h12m2.902991243s) [noise=true , address=104.36.82.8:4991 , piece_id=JB47QIZZRPBUQX4OZRP6CY46GOGBSRF3YYCBTL3XVOUK34OK3TMA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.948240181 (8h12m2.90733742s) [noise=true , address=104.36.82.61:4389 , piece_id=PSL3YRUSQ4S4HVHON6LN7Q4ZRLVIGKTGBK2R5KVY5CQMCFAZJIEQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.965455840 (8h12m2.924553078s) [noise=true , address=104.36.82.22:4517 , piece_id=YNKWDF2L46QGZZGCIO4VXUWGDUFQFLQK5PQOA2BFV32BUI53TZIA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.965793772 (8h12m2.924891015s) [noise=true , address=104.36.82.60:4351 , piece_id=3FYQGNJSC44EP5LPPB7MDSBOJB3VQI5WII7PXKPSH7KKHV3UGNOQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.967071943 (8h12m2.926169174s) [noise=true , address=104.36.82.44:4872 , piece_id=E3BVSGBN23F5TQXNQKBZWU4GE3E5NLNT3446IUIR6C32KKA66X4Q, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.972526119 (8h12m2.931623363s) [noise=true , address=104.36.82.55:4197 , piece_id=N4QTMFXNAKANGTEPCLZG6JUTGCCBW7QJAQZFKUKF4QEOANYPKJNQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.973224814 (8h12m2.932322051s) [noise=true , address=104.36.82.36:4649 , piece_id=XVEF6EPWEMC5MEXARNPYZ26WRJVNFLYS7W4MPCUZHTZT5XGKJBMA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.976278379 (8h12m2.935375629s) [noise=true , address=104.36.82.62:4414 , piece_id=PLF3SDZAWZM2KMV76N3Q5ZRD2UMWNJNH2VMCGBTX4D34MNWA675A, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.977210898 (8h12m2.936308144s) [noise=true , address=104.36.82.36:4648 , piece_id=JBR4ONZYRTSQ52PHKLEHWUPBXUDK6OPGYUOQQV7QUG6UMOXIHS2A, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.983081736 (8h12m2.942178972s) [noise=true , address=104.36.82.58:4280 , piece_id=YUVJ2G4JOQECOGIQHCNF7FBR3SECNEKLVM3F2QBXV3GSAOAIOHVQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.001400028 (8h12m2.960497282s) [noise=true , address=104.36.82.46:4516 , piece_id=IKLQNZYBXHLDGDP7S4OEZQ3RC6YOKQ5IXXM6MEWQKFIGDUB7FLVA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.018227379 (8h12m2.977324618s) [noise=true , address=104.36.82.37:4660 , piece_id=M5U7KGBHFG7UYF6WLQEISXE64PF6DYG7NHI47CYQUXXWAVID64PA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.107000447 (8h12m3.066097679s) [noise=true , address=79.127.201.215:4357 , piece_id=5BUGCF53FXENMTR37BKGHXS7X7SLMZZMKWQQHRITBY2EZUWHCIPQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.107023182 (8h12m3.066120414s) [seg_pos={0 0}, upload=8506]: Segment reached optimal threshold of 14 pieces.
Aug 9 01:37:41.107386732 (8h12m3.066483977s) [noise=true , address=156.146.43.225:4447 , piece_id=VNI2L3DYKSVKFSBG6T4XBZN3TAYMTXR3WFWWFHBKRVLTHSJMJKCA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cxeoGU2UJZiVGgmdmWW5iqfhGzBCvMGc7sXT1F2cEUhuQztkB): protocol: expected piece hash; context canceled; EOF
Aug 9 01:37:41.107771226 (8h12m3.06686847s) [noise=true , address=79.127.205.233:4625 , piece_id=Q5OP7MQWKI5LVAOXSVIKD7HLHIIIGNP4GFBSBGOU7KRYKLMMKDVA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sq71vD4JQ9eSC57mKXGJDm2rN83CbsByuwi49iESzH4U155kD): protocol: write tcp 139.59.144.22:42468->79.127.205.233:4625: use of closed network connection; write tcp 139.59.144.22:42468->79.127.205.233:4625: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42468->79.127.205.233:4625: use of closed network connection
Aug 9 01:37:41.107852883 (8h12m3.066950131s) [noise=true , address=64.49.13.169:4710 , piece_id=TOFOCQ2F35L7QY6WPUTPD2XZOHGM7BYZOTBKKTOYHBSSL5ZPCI4Q, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: write tcp 139.59.144.22:40654->64.49.13.169:4710: use of closed network connection; write tcp 139.59.144.22:40654->64.49.13.169:4710: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40654->64.49.13.169:4710: use of closed network connection
Aug 9 01:37:41.108063179 (8h12m3.067160425s) [noise=true , address=104.36.82.52:4108 , piece_id=Y744EJMSDJ4OBGSF57UAOFSJER4TPJ7BXTTY5HBUSP2WDSD4FOHA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XJJZCUSHUS52YC6jhoPB4ayjsyKZT477PymPj4inkZtdUvheT): protocol: write tcp 139.59.144.22:57682->104.36.82.52:4108: use of closed network connection; write tcp 139.59.144.22:57682->104.36.82.52:4108: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57682->104.36.82.52:4108: use of closed network connection
Aug 9 01:37:41.108082464 (8h12m3.067179699s) [seg_pos={0 0}, upload=8506]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 01:37:41.108208497 (8h12m3.067305745s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 01:37:41.108213756 (8h12m3.067311001s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 01:37:41.420082799 (8h12m3.379180055s) [upload=8506]: Done uploading segments...
Aug 9 01:37:41.420118181 (8h12m3.379215434s) [upload=8506]: Upload finished. err: <nil>
Duration: 2.660425476s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............X..........X....................................] duration:
2.398292322s
FAIL (2025-08-09 02:06:19 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 94afcee7731a2b877dfcae283ac3ff6dfc82b6c045d3239802dbbab47b431857 != before a467afc70c7187cd4597cb7b3731ac500946666b57769b2188794949ffc86afe
======LOGS======
Aug 9 01:37:39.977951417 (8h12m1.937048655s) [upload=8506]: Starting upload
Aug 9 01:37:39.978012527 (8h12m1.937109772s) [upload=8506]: Done starting upload
Aug 9 01:37:39.978139735 (8h12m1.937236973s) [upload=8506]: Uploading segments...
Aug 9 01:37:39.978272880 (8h12m1.937370126s) [upload=8506]: Got next segment. Inline: false
Aug 9 01:37:39.978323989 (8h12m1.93742124s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 01:37:39.978330714 (8h12m1.937427961s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 01:37:40.180138125 (8h12m2.139235371s) [seg_pos={0 0}, upload=8506]: Begin upload segment...
Aug 9 01:37:40.180207573 (8h12m2.139304811s) [seg_pos={0 0}, upload=8506]: Done begin upload segment.
Aug 9 01:37:40.180240200 (8h12m2.139337436s) [noise=true , address=104.36.82.43:4843 , piece_id=WVO2C7GOJSQWZAF67TBW3MTXRUVRSVILYVARLEMF4H54Z2QFT4JA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180267541 (8h12m2.139364796s) [noise=true , address=104.36.82.44:4872 , piece_id=E3BVSGBN23F5TQXNQKBZWU4GE3E5NLNT3446IUIR6C32KKA66X4Q, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180662941 (8h12m2.139760195s) [noise=true , address=79.127.201.215:4357 , piece_id=5BUGCF53FXENMTR37BKGHXS7X7SLMZZMKWQQHRITBY2EZUWHCIPQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180687333 (8h12m2.139784579s) [noise=true , address=104.36.82.8:4991 , piece_id=JB47QIZZRPBUQX4OZRP6CY46GOGBSRF3YYCBTL3XVOUK34OK3TMA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180981984 (8h12m2.14007923s) [noise=true , address=104.36.82.61:4389 , piece_id=PSL3YRUSQ4S4HVHON6LN7Q4ZRLVIGKTGBK2R5KVY5CQMCFAZJIEQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181059607 (8h12m2.140156855s) [noise=true , address=156.146.43.225:4447 , piece_id=VNI2L3DYKSVKFSBG6T4XBZN3TAYMTXR3WFWWFHBKRVLTHSJMJKCA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181398585 (8h12m2.14049584s) [noise=true , address=104.36.82.36:4649 , piece_id=XVEF6EPWEMC5MEXARNPYZ26WRJVNFLYS7W4MPCUZHTZT5XGKJBMA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181524608 (8h12m2.14062186s) [noise=true , address=104.36.82.58:4280 , piece_id=YUVJ2G4JOQECOGIQHCNF7FBR3SECNEKLVM3F2QBXV3GSAOAIOHVQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181796488 (8h12m2.140893742s) [noise=true , address=104.36.82.46:4516 , piece_id=IKLQNZYBXHLDGDP7S4OEZQ3RC6YOKQ5IXXM6MEWQKFIGDUB7FLVA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181982190 (8h12m2.141079441s) [noise=true , address=104.36.82.37:4660 , piece_id=M5U7KGBHFG7UYF6WLQEISXE64PF6DYG7NHI47CYQUXXWAVID64PA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182147460 (8h12m2.141244711s) [noise=true , address=104.36.82.62:4414 , piece_id=PLF3SDZAWZM2KMV76N3Q5ZRD2UMWNJNH2VMCGBTX4D34MNWA675A, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182356147 (8h12m2.141453406s) [noise=true , address=104.36.82.55:4197 , piece_id=N4QTMFXNAKANGTEPCLZG6JUTGCCBW7QJAQZFKUKF4QEOANYPKJNQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182437159 (8h12m2.14153441s) [noise=true , address=104.36.82.52:4108 , piece_id=Y744EJMSDJ4OBGSF57UAOFSJER4TPJ7BXTTY5HBUSP2WDSD4FOHA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182689680 (8h12m2.141786928s) [noise=true , address=104.36.82.36:4648 , piece_id=JBR4ONZYRTSQ52PHKLEHWUPBXUDK6OPGYUOQQV7QUG6UMOXIHS2A, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182725202 (8h12m2.14182245s) [noise=true , address=64.49.13.169:4710 , piece_id=TOFOCQ2F35L7QY6WPUTPD2XZOHGM7BYZOTBKKTOYHBSSL5ZPCI4Q, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182986738 (8h12m2.142083987s) [noise=true , address=104.36.82.60:4351 , piece_id=3FYQGNJSC44EP5LPPB7MDSBOJB3VQI5WII7PXKPSH7KKHV3UGNOQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.183281883 (8h12m2.142379114s) [noise=true , address=79.127.205.233:4625 , piece_id=Q5OP7MQWKI5LVAOXSVIKD7HLHIIIGNP4GFBSBGOU7KRYKLMMKDVA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.183698827 (8h12m2.14279608s) [noise=true , address=104.36.82.22:4517 , piece_id=YNKWDF2L46QGZZGCIO4VXUWGDUFQFLQK5PQOA2BFV32BUI53TZIA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.785004157 (8h12m2.74410141s) [upload=8506]: Next returned nil segment
Aug 9 01:37:40.785025779 (8h12m2.74412303s) [upload=8506]: Waiting for error group managing segments...
Aug 9 01:37:40.942088464 (8h12m2.901185709s) [noise=true , address=104.36.82.43:4843 , piece_id=WVO2C7GOJSQWZAF67TBW3MTXRUVRSVILYVARLEMF4H54Z2QFT4JA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.943893997 (8h12m2.902991243s) [noise=true , address=104.36.82.8:4991 , piece_id=JB47QIZZRPBUQX4OZRP6CY46GOGBSRF3YYCBTL3XVOUK34OK3TMA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.948240181 (8h12m2.90733742s) [noise=true , address=104.36.82.61:4389 , piece_id=PSL3YRUSQ4S4HVHON6LN7Q4ZRLVIGKTGBK2R5KVY5CQMCFAZJIEQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.965455840 (8h12m2.924553078s) [noise=true , address=104.36.82.22:4517 , piece_id=YNKWDF2L46QGZZGCIO4VXUWGDUFQFLQK5PQOA2BFV32BUI53TZIA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.965793772 (8h12m2.924891015s) [noise=true , address=104.36.82.60:4351 , piece_id=3FYQGNJSC44EP5LPPB7MDSBOJB3VQI5WII7PXKPSH7KKHV3UGNOQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.967071943 (8h12m2.926169174s) [noise=true , address=104.36.82.44:4872 , piece_id=E3BVSGBN23F5TQXNQKBZWU4GE3E5NLNT3446IUIR6C32KKA66X4Q, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.972526119 (8h12m2.931623363s) [noise=true , address=104.36.82.55:4197 , piece_id=N4QTMFXNAKANGTEPCLZG6JUTGCCBW7QJAQZFKUKF4QEOANYPKJNQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.973224814 (8h12m2.932322051s) [noise=true , address=104.36.82.36:4649 , piece_id=XVEF6EPWEMC5MEXARNPYZ26WRJVNFLYS7W4MPCUZHTZT5XGKJBMA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.976278379 (8h12m2.935375629s) [noise=true , address=104.36.82.62:4414 , piece_id=PLF3SDZAWZM2KMV76N3Q5ZRD2UMWNJNH2VMCGBTX4D34MNWA675A, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.977210898 (8h12m2.936308144s) [noise=true , address=104.36.82.36:4648 , piece_id=JBR4ONZYRTSQ52PHKLEHWUPBXUDK6OPGYUOQQV7QUG6UMOXIHS2A, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.983081736 (8h12m2.942178972s) [noise=true , address=104.36.82.58:4280 , piece_id=YUVJ2G4JOQECOGIQHCNF7FBR3SECNEKLVM3F2QBXV3GSAOAIOHVQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.001400028 (8h12m2.960497282s) [noise=true , address=104.36.82.46:4516 , piece_id=IKLQNZYBXHLDGDP7S4OEZQ3RC6YOKQ5IXXM6MEWQKFIGDUB7FLVA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.018227379 (8h12m2.977324618s) [noise=true , address=104.36.82.37:4660 , piece_id=M5U7KGBHFG7UYF6WLQEISXE64PF6DYG7NHI47CYQUXXWAVID64PA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.107000447 (8h12m3.066097679s) [noise=true , address=79.127.201.215:4357 , piece_id=5BUGCF53FXENMTR37BKGHXS7X7SLMZZMKWQQHRITBY2EZUWHCIPQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.107023182 (8h12m3.066120414s) [seg_pos={0 0}, upload=8506]: Segment reached optimal threshold of 14 pieces.
Aug 9 01:37:41.107386732 (8h12m3.066483977s) [noise=true , address=156.146.43.225:4447 , piece_id=VNI2L3DYKSVKFSBG6T4XBZN3TAYMTXR3WFWWFHBKRVLTHSJMJKCA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cxeoGU2UJZiVGgmdmWW5iqfhGzBCvMGc7sXT1F2cEUhuQztkB): protocol: expected piece hash; context canceled; EOF
Aug 9 01:37:41.107771226 (8h12m3.06686847s) [noise=true , address=79.127.205.233:4625 , piece_id=Q5OP7MQWKI5LVAOXSVIKD7HLHIIIGNP4GFBSBGOU7KRYKLMMKDVA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sq71vD4JQ9eSC57mKXGJDm2rN83CbsByuwi49iESzH4U155kD): protocol: write tcp 139.59.144.22:42468->79.127.205.233:4625: use of closed network connection; write tcp 139.59.144.22:42468->79.127.205.233:4625: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42468->79.127.205.233:4625: use of closed network connection
Aug 9 01:37:41.107852883 (8h12m3.066950131s) [noise=true , address=64.49.13.169:4710 , piece_id=TOFOCQ2F35L7QY6WPUTPD2XZOHGM7BYZOTBKKTOYHBSSL5ZPCI4Q, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: write tcp 139.59.144.22:40654->64.49.13.169:4710: use of closed network connection; write tcp 139.59.144.22:40654->64.49.13.169:4710: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40654->64.49.13.169:4710: use of closed network connection
Aug 9 01:37:41.108063179 (8h12m3.067160425s) [noise=true , address=104.36.82.52:4108 , piece_id=Y744EJMSDJ4OBGSF57UAOFSJER4TPJ7BXTTY5HBUSP2WDSD4FOHA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XJJZCUSHUS52YC6jhoPB4ayjsyKZT477PymPj4inkZtdUvheT): protocol: write tcp 139.59.144.22:57682->104.36.82.52:4108: use of closed network connection; write tcp 139.59.144.22:57682->104.36.82.52:4108: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57682->104.36.82.52:4108: use of closed network connection
Aug 9 01:37:41.108082464 (8h12m3.067179699s) [seg_pos={0 0}, upload=8506]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 01:37:41.108208497 (8h12m3.067305745s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 01:37:41.108213756 (8h12m3.067311001s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 01:37:41.420082799 (8h12m3.379180055s) [upload=8506]: Done uploading segments...
Aug 9 01:37:41.420118181 (8h12m3.379215434s) [upload=8506]: Upload finished. err: <nil>
Duration: 2.398326014s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........X........X.....................................X..] duration:
887.611345ms
FAIL (2025-08-09 02:05:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:04:31.977231824 (8h38m53.93632908s) [upload=8967]: Starting upload Aug 9 02:04:31.977318166 (8h38m53.936415419s) [upload=8967]: Done starting upload Aug 9 02:04:31.977468417 (8h38m53.936565654s) [upload=8967]: Uploading segments... Aug 9 02:04:31.977561216 (8h38m53.93665847s) [upload=8967]: Got next segment. Inline: true Aug 9 02:04:31.977569010 (8h38m53.936666256s) [upload=8967]: Waiting for error group managing segments... Aug 9 02:04:31.977632258 (8h38m53.936729507s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 02:04:31.977637624 (8h38m53.936734872s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 02:04:31.977641013 (8h38m53.936738258s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 02:04:32.067582835 (8h38m54.02668009s) [upload=8967]: Done uploading segments... Aug 9 02:04:32.067611492 (8h38m54.026708745s) [upload=8967]: Upload finished. err: metaclient: Too Many Requests
Duration: 887.673401ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............X..........X...................................] duration:
2.35619613s
FAIL (2025-08-09 02:05:08 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 94afcee7731a2b877dfcae283ac3ff6dfc82b6c045d3239802dbbab47b431857 != before a467afc70c7187cd4597cb7b3731ac500946666b57769b2188794949ffc86afe
======LOGS======
Aug 9 01:37:39.977951417 (8h12m1.937048655s) [upload=8506]: Starting upload
Aug 9 01:37:39.978012527 (8h12m1.937109772s) [upload=8506]: Done starting upload
Aug 9 01:37:39.978139735 (8h12m1.937236973s) [upload=8506]: Uploading segments...
Aug 9 01:37:39.978272880 (8h12m1.937370126s) [upload=8506]: Got next segment. Inline: false
Aug 9 01:37:39.978323989 (8h12m1.93742124s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 01:37:39.978330714 (8h12m1.937427961s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 01:37:40.180138125 (8h12m2.139235371s) [seg_pos={0 0}, upload=8506]: Begin upload segment...
Aug 9 01:37:40.180207573 (8h12m2.139304811s) [seg_pos={0 0}, upload=8506]: Done begin upload segment.
Aug 9 01:37:40.180240200 (8h12m2.139337436s) [noise=true , address=104.36.82.43:4843 , piece_id=WVO2C7GOJSQWZAF67TBW3MTXRUVRSVILYVARLEMF4H54Z2QFT4JA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180267541 (8h12m2.139364796s) [noise=true , address=104.36.82.44:4872 , piece_id=E3BVSGBN23F5TQXNQKBZWU4GE3E5NLNT3446IUIR6C32KKA66X4Q, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180662941 (8h12m2.139760195s) [noise=true , address=79.127.201.215:4357 , piece_id=5BUGCF53FXENMTR37BKGHXS7X7SLMZZMKWQQHRITBY2EZUWHCIPQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180687333 (8h12m2.139784579s) [noise=true , address=104.36.82.8:4991 , piece_id=JB47QIZZRPBUQX4OZRP6CY46GOGBSRF3YYCBTL3XVOUK34OK3TMA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180981984 (8h12m2.14007923s) [noise=true , address=104.36.82.61:4389 , piece_id=PSL3YRUSQ4S4HVHON6LN7Q4ZRLVIGKTGBK2R5KVY5CQMCFAZJIEQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181059607 (8h12m2.140156855s) [noise=true , address=156.146.43.225:4447 , piece_id=VNI2L3DYKSVKFSBG6T4XBZN3TAYMTXR3WFWWFHBKRVLTHSJMJKCA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181398585 (8h12m2.14049584s) [noise=true , address=104.36.82.36:4649 , piece_id=XVEF6EPWEMC5MEXARNPYZ26WRJVNFLYS7W4MPCUZHTZT5XGKJBMA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181524608 (8h12m2.14062186s) [noise=true , address=104.36.82.58:4280 , piece_id=YUVJ2G4JOQECOGIQHCNF7FBR3SECNEKLVM3F2QBXV3GSAOAIOHVQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181796488 (8h12m2.140893742s) [noise=true , address=104.36.82.46:4516 , piece_id=IKLQNZYBXHLDGDP7S4OEZQ3RC6YOKQ5IXXM6MEWQKFIGDUB7FLVA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181982190 (8h12m2.141079441s) [noise=true , address=104.36.82.37:4660 , piece_id=M5U7KGBHFG7UYF6WLQEISXE64PF6DYG7NHI47CYQUXXWAVID64PA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182147460 (8h12m2.141244711s) [noise=true , address=104.36.82.62:4414 , piece_id=PLF3SDZAWZM2KMV76N3Q5ZRD2UMWNJNH2VMCGBTX4D34MNWA675A, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182356147 (8h12m2.141453406s) [noise=true , address=104.36.82.55:4197 , piece_id=N4QTMFXNAKANGTEPCLZG6JUTGCCBW7QJAQZFKUKF4QEOANYPKJNQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182437159 (8h12m2.14153441s) [noise=true , address=104.36.82.52:4108 , piece_id=Y744EJMSDJ4OBGSF57UAOFSJER4TPJ7BXTTY5HBUSP2WDSD4FOHA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182689680 (8h12m2.141786928s) [noise=true , address=104.36.82.36:4648 , piece_id=JBR4ONZYRTSQ52PHKLEHWUPBXUDK6OPGYUOQQV7QUG6UMOXIHS2A, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182725202 (8h12m2.14182245s) [noise=true , address=64.49.13.169:4710 , piece_id=TOFOCQ2F35L7QY6WPUTPD2XZOHGM7BYZOTBKKTOYHBSSL5ZPCI4Q, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182986738 (8h12m2.142083987s) [noise=true , address=104.36.82.60:4351 , piece_id=3FYQGNJSC44EP5LPPB7MDSBOJB3VQI5WII7PXKPSH7KKHV3UGNOQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.183281883 (8h12m2.142379114s) [noise=true , address=79.127.205.233:4625 , piece_id=Q5OP7MQWKI5LVAOXSVIKD7HLHIIIGNP4GFBSBGOU7KRYKLMMKDVA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.183698827 (8h12m2.14279608s) [noise=true , address=104.36.82.22:4517 , piece_id=YNKWDF2L46QGZZGCIO4VXUWGDUFQFLQK5PQOA2BFV32BUI53TZIA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.785004157 (8h12m2.74410141s) [upload=8506]: Next returned nil segment
Aug 9 01:37:40.785025779 (8h12m2.74412303s) [upload=8506]: Waiting for error group managing segments...
Aug 9 01:37:40.942088464 (8h12m2.901185709s) [noise=true , address=104.36.82.43:4843 , piece_id=WVO2C7GOJSQWZAF67TBW3MTXRUVRSVILYVARLEMF4H54Z2QFT4JA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.943893997 (8h12m2.902991243s) [noise=true , address=104.36.82.8:4991 , piece_id=JB47QIZZRPBUQX4OZRP6CY46GOGBSRF3YYCBTL3XVOUK34OK3TMA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.948240181 (8h12m2.90733742s) [noise=true , address=104.36.82.61:4389 , piece_id=PSL3YRUSQ4S4HVHON6LN7Q4ZRLVIGKTGBK2R5KVY5CQMCFAZJIEQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.965455840 (8h12m2.924553078s) [noise=true , address=104.36.82.22:4517 , piece_id=YNKWDF2L46QGZZGCIO4VXUWGDUFQFLQK5PQOA2BFV32BUI53TZIA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.965793772 (8h12m2.924891015s) [noise=true , address=104.36.82.60:4351 , piece_id=3FYQGNJSC44EP5LPPB7MDSBOJB3VQI5WII7PXKPSH7KKHV3UGNOQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.967071943 (8h12m2.926169174s) [noise=true , address=104.36.82.44:4872 , piece_id=E3BVSGBN23F5TQXNQKBZWU4GE3E5NLNT3446IUIR6C32KKA66X4Q, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.972526119 (8h12m2.931623363s) [noise=true , address=104.36.82.55:4197 , piece_id=N4QTMFXNAKANGTEPCLZG6JUTGCCBW7QJAQZFKUKF4QEOANYPKJNQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.973224814 (8h12m2.932322051s) [noise=true , address=104.36.82.36:4649 , piece_id=XVEF6EPWEMC5MEXARNPYZ26WRJVNFLYS7W4MPCUZHTZT5XGKJBMA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.976278379 (8h12m2.935375629s) [noise=true , address=104.36.82.62:4414 , piece_id=PLF3SDZAWZM2KMV76N3Q5ZRD2UMWNJNH2VMCGBTX4D34MNWA675A, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.977210898 (8h12m2.936308144s) [noise=true , address=104.36.82.36:4648 , piece_id=JBR4ONZYRTSQ52PHKLEHWUPBXUDK6OPGYUOQQV7QUG6UMOXIHS2A, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.983081736 (8h12m2.942178972s) [noise=true , address=104.36.82.58:4280 , piece_id=YUVJ2G4JOQECOGIQHCNF7FBR3SECNEKLVM3F2QBXV3GSAOAIOHVQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.001400028 (8h12m2.960497282s) [noise=true , address=104.36.82.46:4516 , piece_id=IKLQNZYBXHLDGDP7S4OEZQ3RC6YOKQ5IXXM6MEWQKFIGDUB7FLVA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.018227379 (8h12m2.977324618s) [noise=true , address=104.36.82.37:4660 , piece_id=M5U7KGBHFG7UYF6WLQEISXE64PF6DYG7NHI47CYQUXXWAVID64PA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.107000447 (8h12m3.066097679s) [noise=true , address=79.127.201.215:4357 , piece_id=5BUGCF53FXENMTR37BKGHXS7X7SLMZZMKWQQHRITBY2EZUWHCIPQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.107023182 (8h12m3.066120414s) [seg_pos={0 0}, upload=8506]: Segment reached optimal threshold of 14 pieces.
Aug 9 01:37:41.107386732 (8h12m3.066483977s) [noise=true , address=156.146.43.225:4447 , piece_id=VNI2L3DYKSVKFSBG6T4XBZN3TAYMTXR3WFWWFHBKRVLTHSJMJKCA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cxeoGU2UJZiVGgmdmWW5iqfhGzBCvMGc7sXT1F2cEUhuQztkB): protocol: expected piece hash; context canceled; EOF
Aug 9 01:37:41.107771226 (8h12m3.06686847s) [noise=true , address=79.127.205.233:4625 , piece_id=Q5OP7MQWKI5LVAOXSVIKD7HLHIIIGNP4GFBSBGOU7KRYKLMMKDVA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sq71vD4JQ9eSC57mKXGJDm2rN83CbsByuwi49iESzH4U155kD): protocol: write tcp 139.59.144.22:42468->79.127.205.233:4625: use of closed network connection; write tcp 139.59.144.22:42468->79.127.205.233:4625: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42468->79.127.205.233:4625: use of closed network connection
Aug 9 01:37:41.107852883 (8h12m3.066950131s) [noise=true , address=64.49.13.169:4710 , piece_id=TOFOCQ2F35L7QY6WPUTPD2XZOHGM7BYZOTBKKTOYHBSSL5ZPCI4Q, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: write tcp 139.59.144.22:40654->64.49.13.169:4710: use of closed network connection; write tcp 139.59.144.22:40654->64.49.13.169:4710: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40654->64.49.13.169:4710: use of closed network connection
Aug 9 01:37:41.108063179 (8h12m3.067160425s) [noise=true , address=104.36.82.52:4108 , piece_id=Y744EJMSDJ4OBGSF57UAOFSJER4TPJ7BXTTY5HBUSP2WDSD4FOHA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XJJZCUSHUS52YC6jhoPB4ayjsyKZT477PymPj4inkZtdUvheT): protocol: write tcp 139.59.144.22:57682->104.36.82.52:4108: use of closed network connection; write tcp 139.59.144.22:57682->104.36.82.52:4108: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57682->104.36.82.52:4108: use of closed network connection
Aug 9 01:37:41.108082464 (8h12m3.067179699s) [seg_pos={0 0}, upload=8506]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 01:37:41.108208497 (8h12m3.067305745s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 01:37:41.108213756 (8h12m3.067311001s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 01:37:41.420082799 (8h12m3.379180055s) [upload=8506]: Done uploading segments...
Aug 9 01:37:41.420118181 (8h12m3.379215434s) [upload=8506]: Upload finished. err: <nil>
Duration: 2.356231843s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........X........X.....................................X.] duration:
953.193129ms
FAIL (2025-08-09 02:05:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:04:31.977231824 (8h38m53.93632908s) [upload=8967]: Starting upload Aug 9 02:04:31.977318166 (8h38m53.936415419s) [upload=8967]: Done starting upload Aug 9 02:04:31.977468417 (8h38m53.936565654s) [upload=8967]: Uploading segments... Aug 9 02:04:31.977561216 (8h38m53.93665847s) [upload=8967]: Got next segment. Inline: true Aug 9 02:04:31.977569010 (8h38m53.936666256s) [upload=8967]: Waiting for error group managing segments... Aug 9 02:04:31.977632258 (8h38m53.936729507s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 02:04:31.977637624 (8h38m53.936734872s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 02:04:31.977641013 (8h38m53.936738258s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 02:04:32.067582835 (8h38m54.02668009s) [upload=8967]: Done uploading segments... Aug 9 02:04:32.067611492 (8h38m54.026708745s) [upload=8967]: Upload finished. err: metaclient: Too Many Requests
Duration: 953.293001ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............X........X.....................................X] duration:
367.223236ms
FAIL (2025-08-09 02:04:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 02:04:31.977231824 (8h38m53.93632908s) [upload=8967]: Starting upload Aug 9 02:04:31.977318166 (8h38m53.936415419s) [upload=8967]: Done starting upload Aug 9 02:04:31.977468417 (8h38m53.936565654s) [upload=8967]: Uploading segments... Aug 9 02:04:31.977561216 (8h38m53.93665847s) [upload=8967]: Got next segment. Inline: true Aug 9 02:04:31.977569010 (8h38m53.936666256s) [upload=8967]: Waiting for error group managing segments... Aug 9 02:04:31.977632258 (8h38m53.936729507s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 02:04:31.977637624 (8h38m53.936734872s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 02:04:31.977641013 (8h38m53.936738258s) [upload=8967]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 02:04:32.067582835 (8h38m54.02668009s) [upload=8967]: Done uploading segments... Aug 9 02:04:32.067611492 (8h38m54.026708745s) [upload=8967]: Upload finished. err: metaclient: Too Many Requests
Duration: 367.252558ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............X..........X..................................] duration:
2.583871975s
FAIL (2025-08-09 02:04:13 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 94afcee7731a2b877dfcae283ac3ff6dfc82b6c045d3239802dbbab47b431857 != before a467afc70c7187cd4597cb7b3731ac500946666b57769b2188794949ffc86afe
======LOGS======
Aug 9 01:37:39.977951417 (8h12m1.937048655s) [upload=8506]: Starting upload
Aug 9 01:37:39.978012527 (8h12m1.937109772s) [upload=8506]: Done starting upload
Aug 9 01:37:39.978139735 (8h12m1.937236973s) [upload=8506]: Uploading segments...
Aug 9 01:37:39.978272880 (8h12m1.937370126s) [upload=8506]: Got next segment. Inline: false
Aug 9 01:37:39.978323989 (8h12m1.93742124s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 01:37:39.978330714 (8h12m1.937427961s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 01:37:40.180138125 (8h12m2.139235371s) [seg_pos={0 0}, upload=8506]: Begin upload segment...
Aug 9 01:37:40.180207573 (8h12m2.139304811s) [seg_pos={0 0}, upload=8506]: Done begin upload segment.
Aug 9 01:37:40.180240200 (8h12m2.139337436s) [noise=true , address=104.36.82.43:4843 , piece_id=WVO2C7GOJSQWZAF67TBW3MTXRUVRSVILYVARLEMF4H54Z2QFT4JA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180267541 (8h12m2.139364796s) [noise=true , address=104.36.82.44:4872 , piece_id=E3BVSGBN23F5TQXNQKBZWU4GE3E5NLNT3446IUIR6C32KKA66X4Q, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180662941 (8h12m2.139760195s) [noise=true , address=79.127.201.215:4357 , piece_id=5BUGCF53FXENMTR37BKGHXS7X7SLMZZMKWQQHRITBY2EZUWHCIPQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180687333 (8h12m2.139784579s) [noise=true , address=104.36.82.8:4991 , piece_id=JB47QIZZRPBUQX4OZRP6CY46GOGBSRF3YYCBTL3XVOUK34OK3TMA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180981984 (8h12m2.14007923s) [noise=true , address=104.36.82.61:4389 , piece_id=PSL3YRUSQ4S4HVHON6LN7Q4ZRLVIGKTGBK2R5KVY5CQMCFAZJIEQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181059607 (8h12m2.140156855s) [noise=true , address=156.146.43.225:4447 , piece_id=VNI2L3DYKSVKFSBG6T4XBZN3TAYMTXR3WFWWFHBKRVLTHSJMJKCA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181398585 (8h12m2.14049584s) [noise=true , address=104.36.82.36:4649 , piece_id=XVEF6EPWEMC5MEXARNPYZ26WRJVNFLYS7W4MPCUZHTZT5XGKJBMA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181524608 (8h12m2.14062186s) [noise=true , address=104.36.82.58:4280 , piece_id=YUVJ2G4JOQECOGIQHCNF7FBR3SECNEKLVM3F2QBXV3GSAOAIOHVQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181796488 (8h12m2.140893742s) [noise=true , address=104.36.82.46:4516 , piece_id=IKLQNZYBXHLDGDP7S4OEZQ3RC6YOKQ5IXXM6MEWQKFIGDUB7FLVA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181982190 (8h12m2.141079441s) [noise=true , address=104.36.82.37:4660 , piece_id=M5U7KGBHFG7UYF6WLQEISXE64PF6DYG7NHI47CYQUXXWAVID64PA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182147460 (8h12m2.141244711s) [noise=true , address=104.36.82.62:4414 , piece_id=PLF3SDZAWZM2KMV76N3Q5ZRD2UMWNJNH2VMCGBTX4D34MNWA675A, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182356147 (8h12m2.141453406s) [noise=true , address=104.36.82.55:4197 , piece_id=N4QTMFXNAKANGTEPCLZG6JUTGCCBW7QJAQZFKUKF4QEOANYPKJNQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182437159 (8h12m2.14153441s) [noise=true , address=104.36.82.52:4108 , piece_id=Y744EJMSDJ4OBGSF57UAOFSJER4TPJ7BXTTY5HBUSP2WDSD4FOHA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182689680 (8h12m2.141786928s) [noise=true , address=104.36.82.36:4648 , piece_id=JBR4ONZYRTSQ52PHKLEHWUPBXUDK6OPGYUOQQV7QUG6UMOXIHS2A, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182725202 (8h12m2.14182245s) [noise=true , address=64.49.13.169:4710 , piece_id=TOFOCQ2F35L7QY6WPUTPD2XZOHGM7BYZOTBKKTOYHBSSL5ZPCI4Q, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182986738 (8h12m2.142083987s) [noise=true , address=104.36.82.60:4351 , piece_id=3FYQGNJSC44EP5LPPB7MDSBOJB3VQI5WII7PXKPSH7KKHV3UGNOQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.183281883 (8h12m2.142379114s) [noise=true , address=79.127.205.233:4625 , piece_id=Q5OP7MQWKI5LVAOXSVIKD7HLHIIIGNP4GFBSBGOU7KRYKLMMKDVA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.183698827 (8h12m2.14279608s) [noise=true , address=104.36.82.22:4517 , piece_id=YNKWDF2L46QGZZGCIO4VXUWGDUFQFLQK5PQOA2BFV32BUI53TZIA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.785004157 (8h12m2.74410141s) [upload=8506]: Next returned nil segment
Aug 9 01:37:40.785025779 (8h12m2.74412303s) [upload=8506]: Waiting for error group managing segments...
Aug 9 01:37:40.942088464 (8h12m2.901185709s) [noise=true , address=104.36.82.43:4843 , piece_id=WVO2C7GOJSQWZAF67TBW3MTXRUVRSVILYVARLEMF4H54Z2QFT4JA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.943893997 (8h12m2.902991243s) [noise=true , address=104.36.82.8:4991 , piece_id=JB47QIZZRPBUQX4OZRP6CY46GOGBSRF3YYCBTL3XVOUK34OK3TMA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.948240181 (8h12m2.90733742s) [noise=true , address=104.36.82.61:4389 , piece_id=PSL3YRUSQ4S4HVHON6LN7Q4ZRLVIGKTGBK2R5KVY5CQMCFAZJIEQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.965455840 (8h12m2.924553078s) [noise=true , address=104.36.82.22:4517 , piece_id=YNKWDF2L46QGZZGCIO4VXUWGDUFQFLQK5PQOA2BFV32BUI53TZIA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.965793772 (8h12m2.924891015s) [noise=true , address=104.36.82.60:4351 , piece_id=3FYQGNJSC44EP5LPPB7MDSBOJB3VQI5WII7PXKPSH7KKHV3UGNOQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.967071943 (8h12m2.926169174s) [noise=true , address=104.36.82.44:4872 , piece_id=E3BVSGBN23F5TQXNQKBZWU4GE3E5NLNT3446IUIR6C32KKA66X4Q, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.972526119 (8h12m2.931623363s) [noise=true , address=104.36.82.55:4197 , piece_id=N4QTMFXNAKANGTEPCLZG6JUTGCCBW7QJAQZFKUKF4QEOANYPKJNQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.973224814 (8h12m2.932322051s) [noise=true , address=104.36.82.36:4649 , piece_id=XVEF6EPWEMC5MEXARNPYZ26WRJVNFLYS7W4MPCUZHTZT5XGKJBMA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.976278379 (8h12m2.935375629s) [noise=true , address=104.36.82.62:4414 , piece_id=PLF3SDZAWZM2KMV76N3Q5ZRD2UMWNJNH2VMCGBTX4D34MNWA675A, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.977210898 (8h12m2.936308144s) [noise=true , address=104.36.82.36:4648 , piece_id=JBR4ONZYRTSQ52PHKLEHWUPBXUDK6OPGYUOQQV7QUG6UMOXIHS2A, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.983081736 (8h12m2.942178972s) [noise=true , address=104.36.82.58:4280 , piece_id=YUVJ2G4JOQECOGIQHCNF7FBR3SECNEKLVM3F2QBXV3GSAOAIOHVQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.001400028 (8h12m2.960497282s) [noise=true , address=104.36.82.46:4516 , piece_id=IKLQNZYBXHLDGDP7S4OEZQ3RC6YOKQ5IXXM6MEWQKFIGDUB7FLVA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.018227379 (8h12m2.977324618s) [noise=true , address=104.36.82.37:4660 , piece_id=M5U7KGBHFG7UYF6WLQEISXE64PF6DYG7NHI47CYQUXXWAVID64PA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.107000447 (8h12m3.066097679s) [noise=true , address=79.127.201.215:4357 , piece_id=5BUGCF53FXENMTR37BKGHXS7X7SLMZZMKWQQHRITBY2EZUWHCIPQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.107023182 (8h12m3.066120414s) [seg_pos={0 0}, upload=8506]: Segment reached optimal threshold of 14 pieces.
Aug 9 01:37:41.107386732 (8h12m3.066483977s) [noise=true , address=156.146.43.225:4447 , piece_id=VNI2L3DYKSVKFSBG6T4XBZN3TAYMTXR3WFWWFHBKRVLTHSJMJKCA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cxeoGU2UJZiVGgmdmWW5iqfhGzBCvMGc7sXT1F2cEUhuQztkB): protocol: expected piece hash; context canceled; EOF
Aug 9 01:37:41.107771226 (8h12m3.06686847s) [noise=true , address=79.127.205.233:4625 , piece_id=Q5OP7MQWKI5LVAOXSVIKD7HLHIIIGNP4GFBSBGOU7KRYKLMMKDVA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sq71vD4JQ9eSC57mKXGJDm2rN83CbsByuwi49iESzH4U155kD): protocol: write tcp 139.59.144.22:42468->79.127.205.233:4625: use of closed network connection; write tcp 139.59.144.22:42468->79.127.205.233:4625: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42468->79.127.205.233:4625: use of closed network connection
Aug 9 01:37:41.107852883 (8h12m3.066950131s) [noise=true , address=64.49.13.169:4710 , piece_id=TOFOCQ2F35L7QY6WPUTPD2XZOHGM7BYZOTBKKTOYHBSSL5ZPCI4Q, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: write tcp 139.59.144.22:40654->64.49.13.169:4710: use of closed network connection; write tcp 139.59.144.22:40654->64.49.13.169:4710: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40654->64.49.13.169:4710: use of closed network connection
Aug 9 01:37:41.108063179 (8h12m3.067160425s) [noise=true , address=104.36.82.52:4108 , piece_id=Y744EJMSDJ4OBGSF57UAOFSJER4TPJ7BXTTY5HBUSP2WDSD4FOHA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XJJZCUSHUS52YC6jhoPB4ayjsyKZT477PymPj4inkZtdUvheT): protocol: write tcp 139.59.144.22:57682->104.36.82.52:4108: use of closed network connection; write tcp 139.59.144.22:57682->104.36.82.52:4108: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57682->104.36.82.52:4108: use of closed network connection
Aug 9 01:37:41.108082464 (8h12m3.067179699s) [seg_pos={0 0}, upload=8506]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 01:37:41.108208497 (8h12m3.067305745s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 01:37:41.108213756 (8h12m3.067311001s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 01:37:41.420082799 (8h12m3.379180055s) [upload=8506]: Done uploading segments...
Aug 9 01:37:41.420118181 (8h12m3.379215434s) [upload=8506]: Upload finished. err: <nil>
Duration: 2.583924705s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.............X........X.....................................] duration:
1.024631638s
FAIL (2025-08-09 02:03:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e800cd77abfe6f89dd9a7b1968797c0055c19b74871740b580526621edd70cd9 != before dd76228426f38416816ab6cfc46f90886908201f1a25fc192ad5d70e7cc00daa ======LOGS====== Aug 9 01:34:32.980837268 (8h8m54.93993452s) [upload=8446]: Starting upload Aug 9 01:34:32.980920293 (8h8m54.940017544s) [upload=8446]: Done starting upload Aug 9 01:34:32.981022059 (8h8m54.940119305s) [upload=8446]: Uploading segments... Aug 9 01:34:32.981072134 (8h8m54.940169388s) [upload=8446]: Got next segment. Inline: true Aug 9 01:34:32.981078622 (8h8m54.940175868s) [upload=8446]: Waiting for error group managing segments... Aug 9 01:34:32.981128886 (8h8m54.940226139s) [upload=8446]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 01:34:32.981135509 (8h8m54.940232759s) [upload=8446]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 01:34:32.981140290 (8h8m54.940237543s) [upload=8446]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 01:34:33.174309035 (8h8m55.133406286s) [upload=8446]: Done uploading segments... Aug 9 01:34:33.174352609 (8h8m55.133449855s) [upload=8446]: Upload finished. err: <nil>
Duration: 1.024661775s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............X..........X.................................] duration:
2.516421813s
FAIL (2025-08-09 02:03:25 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 94afcee7731a2b877dfcae283ac3ff6dfc82b6c045d3239802dbbab47b431857 != before a467afc70c7187cd4597cb7b3731ac500946666b57769b2188794949ffc86afe
======LOGS======
Aug 9 01:37:39.977951417 (8h12m1.937048655s) [upload=8506]: Starting upload
Aug 9 01:37:39.978012527 (8h12m1.937109772s) [upload=8506]: Done starting upload
Aug 9 01:37:39.978139735 (8h12m1.937236973s) [upload=8506]: Uploading segments...
Aug 9 01:37:39.978272880 (8h12m1.937370126s) [upload=8506]: Got next segment. Inline: false
Aug 9 01:37:39.978323989 (8h12m1.93742124s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 01:37:39.978330714 (8h12m1.937427961s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 01:37:40.180138125 (8h12m2.139235371s) [seg_pos={0 0}, upload=8506]: Begin upload segment...
Aug 9 01:37:40.180207573 (8h12m2.139304811s) [seg_pos={0 0}, upload=8506]: Done begin upload segment.
Aug 9 01:37:40.180240200 (8h12m2.139337436s) [noise=true , address=104.36.82.43:4843 , piece_id=WVO2C7GOJSQWZAF67TBW3MTXRUVRSVILYVARLEMF4H54Z2QFT4JA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180267541 (8h12m2.139364796s) [noise=true , address=104.36.82.44:4872 , piece_id=E3BVSGBN23F5TQXNQKBZWU4GE3E5NLNT3446IUIR6C32KKA66X4Q, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180662941 (8h12m2.139760195s) [noise=true , address=79.127.201.215:4357 , piece_id=5BUGCF53FXENMTR37BKGHXS7X7SLMZZMKWQQHRITBY2EZUWHCIPQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180687333 (8h12m2.139784579s) [noise=true , address=104.36.82.8:4991 , piece_id=JB47QIZZRPBUQX4OZRP6CY46GOGBSRF3YYCBTL3XVOUK34OK3TMA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180981984 (8h12m2.14007923s) [noise=true , address=104.36.82.61:4389 , piece_id=PSL3YRUSQ4S4HVHON6LN7Q4ZRLVIGKTGBK2R5KVY5CQMCFAZJIEQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181059607 (8h12m2.140156855s) [noise=true , address=156.146.43.225:4447 , piece_id=VNI2L3DYKSVKFSBG6T4XBZN3TAYMTXR3WFWWFHBKRVLTHSJMJKCA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181398585 (8h12m2.14049584s) [noise=true , address=104.36.82.36:4649 , piece_id=XVEF6EPWEMC5MEXARNPYZ26WRJVNFLYS7W4MPCUZHTZT5XGKJBMA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181524608 (8h12m2.14062186s) [noise=true , address=104.36.82.58:4280 , piece_id=YUVJ2G4JOQECOGIQHCNF7FBR3SECNEKLVM3F2QBXV3GSAOAIOHVQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181796488 (8h12m2.140893742s) [noise=true , address=104.36.82.46:4516 , piece_id=IKLQNZYBXHLDGDP7S4OEZQ3RC6YOKQ5IXXM6MEWQKFIGDUB7FLVA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181982190 (8h12m2.141079441s) [noise=true , address=104.36.82.37:4660 , piece_id=M5U7KGBHFG7UYF6WLQEISXE64PF6DYG7NHI47CYQUXXWAVID64PA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182147460 (8h12m2.141244711s) [noise=true , address=104.36.82.62:4414 , piece_id=PLF3SDZAWZM2KMV76N3Q5ZRD2UMWNJNH2VMCGBTX4D34MNWA675A, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182356147 (8h12m2.141453406s) [noise=true , address=104.36.82.55:4197 , piece_id=N4QTMFXNAKANGTEPCLZG6JUTGCCBW7QJAQZFKUKF4QEOANYPKJNQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182437159 (8h12m2.14153441s) [noise=true , address=104.36.82.52:4108 , piece_id=Y744EJMSDJ4OBGSF57UAOFSJER4TPJ7BXTTY5HBUSP2WDSD4FOHA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182689680 (8h12m2.141786928s) [noise=true , address=104.36.82.36:4648 , piece_id=JBR4ONZYRTSQ52PHKLEHWUPBXUDK6OPGYUOQQV7QUG6UMOXIHS2A, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182725202 (8h12m2.14182245s) [noise=true , address=64.49.13.169:4710 , piece_id=TOFOCQ2F35L7QY6WPUTPD2XZOHGM7BYZOTBKKTOYHBSSL5ZPCI4Q, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182986738 (8h12m2.142083987s) [noise=true , address=104.36.82.60:4351 , piece_id=3FYQGNJSC44EP5LPPB7MDSBOJB3VQI5WII7PXKPSH7KKHV3UGNOQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.183281883 (8h12m2.142379114s) [noise=true , address=79.127.205.233:4625 , piece_id=Q5OP7MQWKI5LVAOXSVIKD7HLHIIIGNP4GFBSBGOU7KRYKLMMKDVA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.183698827 (8h12m2.14279608s) [noise=true , address=104.36.82.22:4517 , piece_id=YNKWDF2L46QGZZGCIO4VXUWGDUFQFLQK5PQOA2BFV32BUI53TZIA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.785004157 (8h12m2.74410141s) [upload=8506]: Next returned nil segment
Aug 9 01:37:40.785025779 (8h12m2.74412303s) [upload=8506]: Waiting for error group managing segments...
Aug 9 01:37:40.942088464 (8h12m2.901185709s) [noise=true , address=104.36.82.43:4843 , piece_id=WVO2C7GOJSQWZAF67TBW3MTXRUVRSVILYVARLEMF4H54Z2QFT4JA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.943893997 (8h12m2.902991243s) [noise=true , address=104.36.82.8:4991 , piece_id=JB47QIZZRPBUQX4OZRP6CY46GOGBSRF3YYCBTL3XVOUK34OK3TMA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.948240181 (8h12m2.90733742s) [noise=true , address=104.36.82.61:4389 , piece_id=PSL3YRUSQ4S4HVHON6LN7Q4ZRLVIGKTGBK2R5KVY5CQMCFAZJIEQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.965455840 (8h12m2.924553078s) [noise=true , address=104.36.82.22:4517 , piece_id=YNKWDF2L46QGZZGCIO4VXUWGDUFQFLQK5PQOA2BFV32BUI53TZIA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.965793772 (8h12m2.924891015s) [noise=true , address=104.36.82.60:4351 , piece_id=3FYQGNJSC44EP5LPPB7MDSBOJB3VQI5WII7PXKPSH7KKHV3UGNOQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.967071943 (8h12m2.926169174s) [noise=true , address=104.36.82.44:4872 , piece_id=E3BVSGBN23F5TQXNQKBZWU4GE3E5NLNT3446IUIR6C32KKA66X4Q, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.972526119 (8h12m2.931623363s) [noise=true , address=104.36.82.55:4197 , piece_id=N4QTMFXNAKANGTEPCLZG6JUTGCCBW7QJAQZFKUKF4QEOANYPKJNQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.973224814 (8h12m2.932322051s) [noise=true , address=104.36.82.36:4649 , piece_id=XVEF6EPWEMC5MEXARNPYZ26WRJVNFLYS7W4MPCUZHTZT5XGKJBMA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.976278379 (8h12m2.935375629s) [noise=true , address=104.36.82.62:4414 , piece_id=PLF3SDZAWZM2KMV76N3Q5ZRD2UMWNJNH2VMCGBTX4D34MNWA675A, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.977210898 (8h12m2.936308144s) [noise=true , address=104.36.82.36:4648 , piece_id=JBR4ONZYRTSQ52PHKLEHWUPBXUDK6OPGYUOQQV7QUG6UMOXIHS2A, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.983081736 (8h12m2.942178972s) [noise=true , address=104.36.82.58:4280 , piece_id=YUVJ2G4JOQECOGIQHCNF7FBR3SECNEKLVM3F2QBXV3GSAOAIOHVQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.001400028 (8h12m2.960497282s) [noise=true , address=104.36.82.46:4516 , piece_id=IKLQNZYBXHLDGDP7S4OEZQ3RC6YOKQ5IXXM6MEWQKFIGDUB7FLVA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.018227379 (8h12m2.977324618s) [noise=true , address=104.36.82.37:4660 , piece_id=M5U7KGBHFG7UYF6WLQEISXE64PF6DYG7NHI47CYQUXXWAVID64PA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.107000447 (8h12m3.066097679s) [noise=true , address=79.127.201.215:4357 , piece_id=5BUGCF53FXENMTR37BKGHXS7X7SLMZZMKWQQHRITBY2EZUWHCIPQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.107023182 (8h12m3.066120414s) [seg_pos={0 0}, upload=8506]: Segment reached optimal threshold of 14 pieces.
Aug 9 01:37:41.107386732 (8h12m3.066483977s) [noise=true , address=156.146.43.225:4447 , piece_id=VNI2L3DYKSVKFSBG6T4XBZN3TAYMTXR3WFWWFHBKRVLTHSJMJKCA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cxeoGU2UJZiVGgmdmWW5iqfhGzBCvMGc7sXT1F2cEUhuQztkB): protocol: expected piece hash; context canceled; EOF
Aug 9 01:37:41.107771226 (8h12m3.06686847s) [noise=true , address=79.127.205.233:4625 , piece_id=Q5OP7MQWKI5LVAOXSVIKD7HLHIIIGNP4GFBSBGOU7KRYKLMMKDVA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sq71vD4JQ9eSC57mKXGJDm2rN83CbsByuwi49iESzH4U155kD): protocol: write tcp 139.59.144.22:42468->79.127.205.233:4625: use of closed network connection; write tcp 139.59.144.22:42468->79.127.205.233:4625: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42468->79.127.205.233:4625: use of closed network connection
Aug 9 01:37:41.107852883 (8h12m3.066950131s) [noise=true , address=64.49.13.169:4710 , piece_id=TOFOCQ2F35L7QY6WPUTPD2XZOHGM7BYZOTBKKTOYHBSSL5ZPCI4Q, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: write tcp 139.59.144.22:40654->64.49.13.169:4710: use of closed network connection; write tcp 139.59.144.22:40654->64.49.13.169:4710: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40654->64.49.13.169:4710: use of closed network connection
Aug 9 01:37:41.108063179 (8h12m3.067160425s) [noise=true , address=104.36.82.52:4108 , piece_id=Y744EJMSDJ4OBGSF57UAOFSJER4TPJ7BXTTY5HBUSP2WDSD4FOHA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XJJZCUSHUS52YC6jhoPB4ayjsyKZT477PymPj4inkZtdUvheT): protocol: write tcp 139.59.144.22:57682->104.36.82.52:4108: use of closed network connection; write tcp 139.59.144.22:57682->104.36.82.52:4108: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57682->104.36.82.52:4108: use of closed network connection
Aug 9 01:37:41.108082464 (8h12m3.067179699s) [seg_pos={0 0}, upload=8506]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 01:37:41.108208497 (8h12m3.067305745s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 01:37:41.108213756 (8h12m3.067311001s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 01:37:41.420082799 (8h12m3.379180055s) [upload=8506]: Done uploading segments...
Aug 9 01:37:41.420118181 (8h12m3.379215434s) [upload=8506]: Upload finished. err: <nil>
Duration: 2.516450338s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..............X........X....................................] duration:
831.55874ms
FAIL (2025-08-09 02:02:48 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e800cd77abfe6f89dd9a7b1968797c0055c19b74871740b580526621edd70cd9 != before dd76228426f38416816ab6cfc46f90886908201f1a25fc192ad5d70e7cc00daa ======LOGS====== Aug 9 01:34:32.980837268 (8h8m54.93993452s) [upload=8446]: Starting upload Aug 9 01:34:32.980920293 (8h8m54.940017544s) [upload=8446]: Done starting upload Aug 9 01:34:32.981022059 (8h8m54.940119305s) [upload=8446]: Uploading segments... Aug 9 01:34:32.981072134 (8h8m54.940169388s) [upload=8446]: Got next segment. Inline: true Aug 9 01:34:32.981078622 (8h8m54.940175868s) [upload=8446]: Waiting for error group managing segments... Aug 9 01:34:32.981128886 (8h8m54.940226139s) [upload=8446]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 01:34:32.981135509 (8h8m54.940232759s) [upload=8446]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 01:34:32.981140290 (8h8m54.940237543s) [upload=8446]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 01:34:33.174309035 (8h8m55.133406286s) [upload=8446]: Done uploading segments... Aug 9 01:34:33.174352609 (8h8m55.133449855s) [upload=8446]: Upload finished. err: <nil>
Duration: 831.613859ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................X..........X................................] duration:
2.441205705s
FAIL (2025-08-09 02:02:20 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 94afcee7731a2b877dfcae283ac3ff6dfc82b6c045d3239802dbbab47b431857 != before a467afc70c7187cd4597cb7b3731ac500946666b57769b2188794949ffc86afe
======LOGS======
Aug 9 01:37:39.977951417 (8h12m1.937048655s) [upload=8506]: Starting upload
Aug 9 01:37:39.978012527 (8h12m1.937109772s) [upload=8506]: Done starting upload
Aug 9 01:37:39.978139735 (8h12m1.937236973s) [upload=8506]: Uploading segments...
Aug 9 01:37:39.978272880 (8h12m1.937370126s) [upload=8506]: Got next segment. Inline: false
Aug 9 01:37:39.978323989 (8h12m1.93742124s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 01:37:39.978330714 (8h12m1.937427961s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 01:37:40.180138125 (8h12m2.139235371s) [seg_pos={0 0}, upload=8506]: Begin upload segment...
Aug 9 01:37:40.180207573 (8h12m2.139304811s) [seg_pos={0 0}, upload=8506]: Done begin upload segment.
Aug 9 01:37:40.180240200 (8h12m2.139337436s) [noise=true , address=104.36.82.43:4843 , piece_id=WVO2C7GOJSQWZAF67TBW3MTXRUVRSVILYVARLEMF4H54Z2QFT4JA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180267541 (8h12m2.139364796s) [noise=true , address=104.36.82.44:4872 , piece_id=E3BVSGBN23F5TQXNQKBZWU4GE3E5NLNT3446IUIR6C32KKA66X4Q, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180662941 (8h12m2.139760195s) [noise=true , address=79.127.201.215:4357 , piece_id=5BUGCF53FXENMTR37BKGHXS7X7SLMZZMKWQQHRITBY2EZUWHCIPQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180687333 (8h12m2.139784579s) [noise=true , address=104.36.82.8:4991 , piece_id=JB47QIZZRPBUQX4OZRP6CY46GOGBSRF3YYCBTL3XVOUK34OK3TMA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180981984 (8h12m2.14007923s) [noise=true , address=104.36.82.61:4389 , piece_id=PSL3YRUSQ4S4HVHON6LN7Q4ZRLVIGKTGBK2R5KVY5CQMCFAZJIEQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181059607 (8h12m2.140156855s) [noise=true , address=156.146.43.225:4447 , piece_id=VNI2L3DYKSVKFSBG6T4XBZN3TAYMTXR3WFWWFHBKRVLTHSJMJKCA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181398585 (8h12m2.14049584s) [noise=true , address=104.36.82.36:4649 , piece_id=XVEF6EPWEMC5MEXARNPYZ26WRJVNFLYS7W4MPCUZHTZT5XGKJBMA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181524608 (8h12m2.14062186s) [noise=true , address=104.36.82.58:4280 , piece_id=YUVJ2G4JOQECOGIQHCNF7FBR3SECNEKLVM3F2QBXV3GSAOAIOHVQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181796488 (8h12m2.140893742s) [noise=true , address=104.36.82.46:4516 , piece_id=IKLQNZYBXHLDGDP7S4OEZQ3RC6YOKQ5IXXM6MEWQKFIGDUB7FLVA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181982190 (8h12m2.141079441s) [noise=true , address=104.36.82.37:4660 , piece_id=M5U7KGBHFG7UYF6WLQEISXE64PF6DYG7NHI47CYQUXXWAVID64PA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182147460 (8h12m2.141244711s) [noise=true , address=104.36.82.62:4414 , piece_id=PLF3SDZAWZM2KMV76N3Q5ZRD2UMWNJNH2VMCGBTX4D34MNWA675A, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182356147 (8h12m2.141453406s) [noise=true , address=104.36.82.55:4197 , piece_id=N4QTMFXNAKANGTEPCLZG6JUTGCCBW7QJAQZFKUKF4QEOANYPKJNQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182437159 (8h12m2.14153441s) [noise=true , address=104.36.82.52:4108 , piece_id=Y744EJMSDJ4OBGSF57UAOFSJER4TPJ7BXTTY5HBUSP2WDSD4FOHA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182689680 (8h12m2.141786928s) [noise=true , address=104.36.82.36:4648 , piece_id=JBR4ONZYRTSQ52PHKLEHWUPBXUDK6OPGYUOQQV7QUG6UMOXIHS2A, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182725202 (8h12m2.14182245s) [noise=true , address=64.49.13.169:4710 , piece_id=TOFOCQ2F35L7QY6WPUTPD2XZOHGM7BYZOTBKKTOYHBSSL5ZPCI4Q, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182986738 (8h12m2.142083987s) [noise=true , address=104.36.82.60:4351 , piece_id=3FYQGNJSC44EP5LPPB7MDSBOJB3VQI5WII7PXKPSH7KKHV3UGNOQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.183281883 (8h12m2.142379114s) [noise=true , address=79.127.205.233:4625 , piece_id=Q5OP7MQWKI5LVAOXSVIKD7HLHIIIGNP4GFBSBGOU7KRYKLMMKDVA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.183698827 (8h12m2.14279608s) [noise=true , address=104.36.82.22:4517 , piece_id=YNKWDF2L46QGZZGCIO4VXUWGDUFQFLQK5PQOA2BFV32BUI53TZIA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.785004157 (8h12m2.74410141s) [upload=8506]: Next returned nil segment
Aug 9 01:37:40.785025779 (8h12m2.74412303s) [upload=8506]: Waiting for error group managing segments...
Aug 9 01:37:40.942088464 (8h12m2.901185709s) [noise=true , address=104.36.82.43:4843 , piece_id=WVO2C7GOJSQWZAF67TBW3MTXRUVRSVILYVARLEMF4H54Z2QFT4JA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.943893997 (8h12m2.902991243s) [noise=true , address=104.36.82.8:4991 , piece_id=JB47QIZZRPBUQX4OZRP6CY46GOGBSRF3YYCBTL3XVOUK34OK3TMA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.948240181 (8h12m2.90733742s) [noise=true , address=104.36.82.61:4389 , piece_id=PSL3YRUSQ4S4HVHON6LN7Q4ZRLVIGKTGBK2R5KVY5CQMCFAZJIEQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.965455840 (8h12m2.924553078s) [noise=true , address=104.36.82.22:4517 , piece_id=YNKWDF2L46QGZZGCIO4VXUWGDUFQFLQK5PQOA2BFV32BUI53TZIA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.965793772 (8h12m2.924891015s) [noise=true , address=104.36.82.60:4351 , piece_id=3FYQGNJSC44EP5LPPB7MDSBOJB3VQI5WII7PXKPSH7KKHV3UGNOQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.967071943 (8h12m2.926169174s) [noise=true , address=104.36.82.44:4872 , piece_id=E3BVSGBN23F5TQXNQKBZWU4GE3E5NLNT3446IUIR6C32KKA66X4Q, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.972526119 (8h12m2.931623363s) [noise=true , address=104.36.82.55:4197 , piece_id=N4QTMFXNAKANGTEPCLZG6JUTGCCBW7QJAQZFKUKF4QEOANYPKJNQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.973224814 (8h12m2.932322051s) [noise=true , address=104.36.82.36:4649 , piece_id=XVEF6EPWEMC5MEXARNPYZ26WRJVNFLYS7W4MPCUZHTZT5XGKJBMA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.976278379 (8h12m2.935375629s) [noise=true , address=104.36.82.62:4414 , piece_id=PLF3SDZAWZM2KMV76N3Q5ZRD2UMWNJNH2VMCGBTX4D34MNWA675A, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.977210898 (8h12m2.936308144s) [noise=true , address=104.36.82.36:4648 , piece_id=JBR4ONZYRTSQ52PHKLEHWUPBXUDK6OPGYUOQQV7QUG6UMOXIHS2A, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.983081736 (8h12m2.942178972s) [noise=true , address=104.36.82.58:4280 , piece_id=YUVJ2G4JOQECOGIQHCNF7FBR3SECNEKLVM3F2QBXV3GSAOAIOHVQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.001400028 (8h12m2.960497282s) [noise=true , address=104.36.82.46:4516 , piece_id=IKLQNZYBXHLDGDP7S4OEZQ3RC6YOKQ5IXXM6MEWQKFIGDUB7FLVA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.018227379 (8h12m2.977324618s) [noise=true , address=104.36.82.37:4660 , piece_id=M5U7KGBHFG7UYF6WLQEISXE64PF6DYG7NHI47CYQUXXWAVID64PA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.107000447 (8h12m3.066097679s) [noise=true , address=79.127.201.215:4357 , piece_id=5BUGCF53FXENMTR37BKGHXS7X7SLMZZMKWQQHRITBY2EZUWHCIPQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.107023182 (8h12m3.066120414s) [seg_pos={0 0}, upload=8506]: Segment reached optimal threshold of 14 pieces.
Aug 9 01:37:41.107386732 (8h12m3.066483977s) [noise=true , address=156.146.43.225:4447 , piece_id=VNI2L3DYKSVKFSBG6T4XBZN3TAYMTXR3WFWWFHBKRVLTHSJMJKCA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cxeoGU2UJZiVGgmdmWW5iqfhGzBCvMGc7sXT1F2cEUhuQztkB): protocol: expected piece hash; context canceled; EOF
Aug 9 01:37:41.107771226 (8h12m3.06686847s) [noise=true , address=79.127.205.233:4625 , piece_id=Q5OP7MQWKI5LVAOXSVIKD7HLHIIIGNP4GFBSBGOU7KRYKLMMKDVA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sq71vD4JQ9eSC57mKXGJDm2rN83CbsByuwi49iESzH4U155kD): protocol: write tcp 139.59.144.22:42468->79.127.205.233:4625: use of closed network connection; write tcp 139.59.144.22:42468->79.127.205.233:4625: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42468->79.127.205.233:4625: use of closed network connection
Aug 9 01:37:41.107852883 (8h12m3.066950131s) [noise=true , address=64.49.13.169:4710 , piece_id=TOFOCQ2F35L7QY6WPUTPD2XZOHGM7BYZOTBKKTOYHBSSL5ZPCI4Q, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: write tcp 139.59.144.22:40654->64.49.13.169:4710: use of closed network connection; write tcp 139.59.144.22:40654->64.49.13.169:4710: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40654->64.49.13.169:4710: use of closed network connection
Aug 9 01:37:41.108063179 (8h12m3.067160425s) [noise=true , address=104.36.82.52:4108 , piece_id=Y744EJMSDJ4OBGSF57UAOFSJER4TPJ7BXTTY5HBUSP2WDSD4FOHA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XJJZCUSHUS52YC6jhoPB4ayjsyKZT477PymPj4inkZtdUvheT): protocol: write tcp 139.59.144.22:57682->104.36.82.52:4108: use of closed network connection; write tcp 139.59.144.22:57682->104.36.82.52:4108: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57682->104.36.82.52:4108: use of closed network connection
Aug 9 01:37:41.108082464 (8h12m3.067179699s) [seg_pos={0 0}, upload=8506]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 01:37:41.108208497 (8h12m3.067305745s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 01:37:41.108213756 (8h12m3.067311001s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 01:37:41.420082799 (8h12m3.379180055s) [upload=8506]: Done uploading segments...
Aug 9 01:37:41.420118181 (8h12m3.379215434s) [upload=8506]: Upload finished. err: <nil>
Duration: 2.44123842s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...............X........X...................................] duration:
885.018503ms
FAIL (2025-08-09 02:02:05 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e800cd77abfe6f89dd9a7b1968797c0055c19b74871740b580526621edd70cd9 != before dd76228426f38416816ab6cfc46f90886908201f1a25fc192ad5d70e7cc00daa ======LOGS====== Aug 9 01:34:32.980837268 (8h8m54.93993452s) [upload=8446]: Starting upload Aug 9 01:34:32.980920293 (8h8m54.940017544s) [upload=8446]: Done starting upload Aug 9 01:34:32.981022059 (8h8m54.940119305s) [upload=8446]: Uploading segments... Aug 9 01:34:32.981072134 (8h8m54.940169388s) [upload=8446]: Got next segment. Inline: true Aug 9 01:34:32.981078622 (8h8m54.940175868s) [upload=8446]: Waiting for error group managing segments... Aug 9 01:34:32.981128886 (8h8m54.940226139s) [upload=8446]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 01:34:32.981135509 (8h8m54.940232759s) [upload=8446]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 01:34:32.981140290 (8h8m54.940237543s) [upload=8446]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 01:34:33.174309035 (8h8m55.133406286s) [upload=8446]: Done uploading segments... Aug 9 01:34:33.174352609 (8h8m55.133449855s) [upload=8446]: Upload finished. err: <nil>
Duration: 885.047504ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................X..........X...............................] duration:
2.548065378s
FAIL (2025-08-09 02:02:03 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 94afcee7731a2b877dfcae283ac3ff6dfc82b6c045d3239802dbbab47b431857 != before a467afc70c7187cd4597cb7b3731ac500946666b57769b2188794949ffc86afe
======LOGS======
Aug 9 01:37:39.977951417 (8h12m1.937048655s) [upload=8506]: Starting upload
Aug 9 01:37:39.978012527 (8h12m1.937109772s) [upload=8506]: Done starting upload
Aug 9 01:37:39.978139735 (8h12m1.937236973s) [upload=8506]: Uploading segments...
Aug 9 01:37:39.978272880 (8h12m1.937370126s) [upload=8506]: Got next segment. Inline: false
Aug 9 01:37:39.978323989 (8h12m1.93742124s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 01:37:39.978330714 (8h12m1.937427961s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 01:37:40.180138125 (8h12m2.139235371s) [seg_pos={0 0}, upload=8506]: Begin upload segment...
Aug 9 01:37:40.180207573 (8h12m2.139304811s) [seg_pos={0 0}, upload=8506]: Done begin upload segment.
Aug 9 01:37:40.180240200 (8h12m2.139337436s) [noise=true , address=104.36.82.43:4843 , piece_id=WVO2C7GOJSQWZAF67TBW3MTXRUVRSVILYVARLEMF4H54Z2QFT4JA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180267541 (8h12m2.139364796s) [noise=true , address=104.36.82.44:4872 , piece_id=E3BVSGBN23F5TQXNQKBZWU4GE3E5NLNT3446IUIR6C32KKA66X4Q, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180662941 (8h12m2.139760195s) [noise=true , address=79.127.201.215:4357 , piece_id=5BUGCF53FXENMTR37BKGHXS7X7SLMZZMKWQQHRITBY2EZUWHCIPQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180687333 (8h12m2.139784579s) [noise=true , address=104.36.82.8:4991 , piece_id=JB47QIZZRPBUQX4OZRP6CY46GOGBSRF3YYCBTL3XVOUK34OK3TMA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180981984 (8h12m2.14007923s) [noise=true , address=104.36.82.61:4389 , piece_id=PSL3YRUSQ4S4HVHON6LN7Q4ZRLVIGKTGBK2R5KVY5CQMCFAZJIEQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181059607 (8h12m2.140156855s) [noise=true , address=156.146.43.225:4447 , piece_id=VNI2L3DYKSVKFSBG6T4XBZN3TAYMTXR3WFWWFHBKRVLTHSJMJKCA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181398585 (8h12m2.14049584s) [noise=true , address=104.36.82.36:4649 , piece_id=XVEF6EPWEMC5MEXARNPYZ26WRJVNFLYS7W4MPCUZHTZT5XGKJBMA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181524608 (8h12m2.14062186s) [noise=true , address=104.36.82.58:4280 , piece_id=YUVJ2G4JOQECOGIQHCNF7FBR3SECNEKLVM3F2QBXV3GSAOAIOHVQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181796488 (8h12m2.140893742s) [noise=true , address=104.36.82.46:4516 , piece_id=IKLQNZYBXHLDGDP7S4OEZQ3RC6YOKQ5IXXM6MEWQKFIGDUB7FLVA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181982190 (8h12m2.141079441s) [noise=true , address=104.36.82.37:4660 , piece_id=M5U7KGBHFG7UYF6WLQEISXE64PF6DYG7NHI47CYQUXXWAVID64PA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182147460 (8h12m2.141244711s) [noise=true , address=104.36.82.62:4414 , piece_id=PLF3SDZAWZM2KMV76N3Q5ZRD2UMWNJNH2VMCGBTX4D34MNWA675A, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182356147 (8h12m2.141453406s) [noise=true , address=104.36.82.55:4197 , piece_id=N4QTMFXNAKANGTEPCLZG6JUTGCCBW7QJAQZFKUKF4QEOANYPKJNQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182437159 (8h12m2.14153441s) [noise=true , address=104.36.82.52:4108 , piece_id=Y744EJMSDJ4OBGSF57UAOFSJER4TPJ7BXTTY5HBUSP2WDSD4FOHA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182689680 (8h12m2.141786928s) [noise=true , address=104.36.82.36:4648 , piece_id=JBR4ONZYRTSQ52PHKLEHWUPBXUDK6OPGYUOQQV7QUG6UMOXIHS2A, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182725202 (8h12m2.14182245s) [noise=true , address=64.49.13.169:4710 , piece_id=TOFOCQ2F35L7QY6WPUTPD2XZOHGM7BYZOTBKKTOYHBSSL5ZPCI4Q, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182986738 (8h12m2.142083987s) [noise=true , address=104.36.82.60:4351 , piece_id=3FYQGNJSC44EP5LPPB7MDSBOJB3VQI5WII7PXKPSH7KKHV3UGNOQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.183281883 (8h12m2.142379114s) [noise=true , address=79.127.205.233:4625 , piece_id=Q5OP7MQWKI5LVAOXSVIKD7HLHIIIGNP4GFBSBGOU7KRYKLMMKDVA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.183698827 (8h12m2.14279608s) [noise=true , address=104.36.82.22:4517 , piece_id=YNKWDF2L46QGZZGCIO4VXUWGDUFQFLQK5PQOA2BFV32BUI53TZIA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.785004157 (8h12m2.74410141s) [upload=8506]: Next returned nil segment
Aug 9 01:37:40.785025779 (8h12m2.74412303s) [upload=8506]: Waiting for error group managing segments...
Aug 9 01:37:40.942088464 (8h12m2.901185709s) [noise=true , address=104.36.82.43:4843 , piece_id=WVO2C7GOJSQWZAF67TBW3MTXRUVRSVILYVARLEMF4H54Z2QFT4JA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.943893997 (8h12m2.902991243s) [noise=true , address=104.36.82.8:4991 , piece_id=JB47QIZZRPBUQX4OZRP6CY46GOGBSRF3YYCBTL3XVOUK34OK3TMA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.948240181 (8h12m2.90733742s) [noise=true , address=104.36.82.61:4389 , piece_id=PSL3YRUSQ4S4HVHON6LN7Q4ZRLVIGKTGBK2R5KVY5CQMCFAZJIEQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.965455840 (8h12m2.924553078s) [noise=true , address=104.36.82.22:4517 , piece_id=YNKWDF2L46QGZZGCIO4VXUWGDUFQFLQK5PQOA2BFV32BUI53TZIA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.965793772 (8h12m2.924891015s) [noise=true , address=104.36.82.60:4351 , piece_id=3FYQGNJSC44EP5LPPB7MDSBOJB3VQI5WII7PXKPSH7KKHV3UGNOQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.967071943 (8h12m2.926169174s) [noise=true , address=104.36.82.44:4872 , piece_id=E3BVSGBN23F5TQXNQKBZWU4GE3E5NLNT3446IUIR6C32KKA66X4Q, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.972526119 (8h12m2.931623363s) [noise=true , address=104.36.82.55:4197 , piece_id=N4QTMFXNAKANGTEPCLZG6JUTGCCBW7QJAQZFKUKF4QEOANYPKJNQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.973224814 (8h12m2.932322051s) [noise=true , address=104.36.82.36:4649 , piece_id=XVEF6EPWEMC5MEXARNPYZ26WRJVNFLYS7W4MPCUZHTZT5XGKJBMA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.976278379 (8h12m2.935375629s) [noise=true , address=104.36.82.62:4414 , piece_id=PLF3SDZAWZM2KMV76N3Q5ZRD2UMWNJNH2VMCGBTX4D34MNWA675A, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.977210898 (8h12m2.936308144s) [noise=true , address=104.36.82.36:4648 , piece_id=JBR4ONZYRTSQ52PHKLEHWUPBXUDK6OPGYUOQQV7QUG6UMOXIHS2A, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.983081736 (8h12m2.942178972s) [noise=true , address=104.36.82.58:4280 , piece_id=YUVJ2G4JOQECOGIQHCNF7FBR3SECNEKLVM3F2QBXV3GSAOAIOHVQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.001400028 (8h12m2.960497282s) [noise=true , address=104.36.82.46:4516 , piece_id=IKLQNZYBXHLDGDP7S4OEZQ3RC6YOKQ5IXXM6MEWQKFIGDUB7FLVA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.018227379 (8h12m2.977324618s) [noise=true , address=104.36.82.37:4660 , piece_id=M5U7KGBHFG7UYF6WLQEISXE64PF6DYG7NHI47CYQUXXWAVID64PA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.107000447 (8h12m3.066097679s) [noise=true , address=79.127.201.215:4357 , piece_id=5BUGCF53FXENMTR37BKGHXS7X7SLMZZMKWQQHRITBY2EZUWHCIPQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.107023182 (8h12m3.066120414s) [seg_pos={0 0}, upload=8506]: Segment reached optimal threshold of 14 pieces.
Aug 9 01:37:41.107386732 (8h12m3.066483977s) [noise=true , address=156.146.43.225:4447 , piece_id=VNI2L3DYKSVKFSBG6T4XBZN3TAYMTXR3WFWWFHBKRVLTHSJMJKCA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cxeoGU2UJZiVGgmdmWW5iqfhGzBCvMGc7sXT1F2cEUhuQztkB): protocol: expected piece hash; context canceled; EOF
Aug 9 01:37:41.107771226 (8h12m3.06686847s) [noise=true , address=79.127.205.233:4625 , piece_id=Q5OP7MQWKI5LVAOXSVIKD7HLHIIIGNP4GFBSBGOU7KRYKLMMKDVA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sq71vD4JQ9eSC57mKXGJDm2rN83CbsByuwi49iESzH4U155kD): protocol: write tcp 139.59.144.22:42468->79.127.205.233:4625: use of closed network connection; write tcp 139.59.144.22:42468->79.127.205.233:4625: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42468->79.127.205.233:4625: use of closed network connection
Aug 9 01:37:41.107852883 (8h12m3.066950131s) [noise=true , address=64.49.13.169:4710 , piece_id=TOFOCQ2F35L7QY6WPUTPD2XZOHGM7BYZOTBKKTOYHBSSL5ZPCI4Q, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: write tcp 139.59.144.22:40654->64.49.13.169:4710: use of closed network connection; write tcp 139.59.144.22:40654->64.49.13.169:4710: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40654->64.49.13.169:4710: use of closed network connection
Aug 9 01:37:41.108063179 (8h12m3.067160425s) [noise=true , address=104.36.82.52:4108 , piece_id=Y744EJMSDJ4OBGSF57UAOFSJER4TPJ7BXTTY5HBUSP2WDSD4FOHA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XJJZCUSHUS52YC6jhoPB4ayjsyKZT477PymPj4inkZtdUvheT): protocol: write tcp 139.59.144.22:57682->104.36.82.52:4108: use of closed network connection; write tcp 139.59.144.22:57682->104.36.82.52:4108: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57682->104.36.82.52:4108: use of closed network connection
Aug 9 01:37:41.108082464 (8h12m3.067179699s) [seg_pos={0 0}, upload=8506]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 01:37:41.108208497 (8h12m3.067305745s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 01:37:41.108213756 (8h12m3.067311001s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 01:37:41.420082799 (8h12m3.379180055s) [upload=8506]: Done uploading segments...
Aug 9 01:37:41.420118181 (8h12m3.379215434s) [upload=8506]: Upload finished. err: <nil>
Duration: 2.548120972s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [................X........X..................................] duration:
901.011261ms
FAIL (2025-08-09 02:01:46 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e800cd77abfe6f89dd9a7b1968797c0055c19b74871740b580526621edd70cd9 != before dd76228426f38416816ab6cfc46f90886908201f1a25fc192ad5d70e7cc00daa ======LOGS====== Aug 9 01:34:32.980837268 (8h8m54.93993452s) [upload=8446]: Starting upload Aug 9 01:34:32.980920293 (8h8m54.940017544s) [upload=8446]: Done starting upload Aug 9 01:34:32.981022059 (8h8m54.940119305s) [upload=8446]: Uploading segments... Aug 9 01:34:32.981072134 (8h8m54.940169388s) [upload=8446]: Got next segment. Inline: true Aug 9 01:34:32.981078622 (8h8m54.940175868s) [upload=8446]: Waiting for error group managing segments... Aug 9 01:34:32.981128886 (8h8m54.940226139s) [upload=8446]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 01:34:32.981135509 (8h8m54.940232759s) [upload=8446]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 01:34:32.981140290 (8h8m54.940237543s) [upload=8446]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 01:34:33.174309035 (8h8m55.133406286s) [upload=8446]: Done uploading segments... Aug 9 01:34:33.174352609 (8h8m55.133449855s) [upload=8446]: Upload finished. err: <nil>
Duration: 901.046683ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................X..........X..............................] duration:
2.508372772s
FAIL (2025-08-09 02:00:48 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 94afcee7731a2b877dfcae283ac3ff6dfc82b6c045d3239802dbbab47b431857 != before a467afc70c7187cd4597cb7b3731ac500946666b57769b2188794949ffc86afe
======LOGS======
Aug 9 01:37:39.977951417 (8h12m1.937048655s) [upload=8506]: Starting upload
Aug 9 01:37:39.978012527 (8h12m1.937109772s) [upload=8506]: Done starting upload
Aug 9 01:37:39.978139735 (8h12m1.937236973s) [upload=8506]: Uploading segments...
Aug 9 01:37:39.978272880 (8h12m1.937370126s) [upload=8506]: Got next segment. Inline: false
Aug 9 01:37:39.978323989 (8h12m1.93742124s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 01:37:39.978330714 (8h12m1.937427961s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 01:37:40.180138125 (8h12m2.139235371s) [seg_pos={0 0}, upload=8506]: Begin upload segment...
Aug 9 01:37:40.180207573 (8h12m2.139304811s) [seg_pos={0 0}, upload=8506]: Done begin upload segment.
Aug 9 01:37:40.180240200 (8h12m2.139337436s) [noise=true , address=104.36.82.43:4843 , piece_id=WVO2C7GOJSQWZAF67TBW3MTXRUVRSVILYVARLEMF4H54Z2QFT4JA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180267541 (8h12m2.139364796s) [noise=true , address=104.36.82.44:4872 , piece_id=E3BVSGBN23F5TQXNQKBZWU4GE3E5NLNT3446IUIR6C32KKA66X4Q, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180662941 (8h12m2.139760195s) [noise=true , address=79.127.201.215:4357 , piece_id=5BUGCF53FXENMTR37BKGHXS7X7SLMZZMKWQQHRITBY2EZUWHCIPQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180687333 (8h12m2.139784579s) [noise=true , address=104.36.82.8:4991 , piece_id=JB47QIZZRPBUQX4OZRP6CY46GOGBSRF3YYCBTL3XVOUK34OK3TMA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180981984 (8h12m2.14007923s) [noise=true , address=104.36.82.61:4389 , piece_id=PSL3YRUSQ4S4HVHON6LN7Q4ZRLVIGKTGBK2R5KVY5CQMCFAZJIEQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181059607 (8h12m2.140156855s) [noise=true , address=156.146.43.225:4447 , piece_id=VNI2L3DYKSVKFSBG6T4XBZN3TAYMTXR3WFWWFHBKRVLTHSJMJKCA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181398585 (8h12m2.14049584s) [noise=true , address=104.36.82.36:4649 , piece_id=XVEF6EPWEMC5MEXARNPYZ26WRJVNFLYS7W4MPCUZHTZT5XGKJBMA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181524608 (8h12m2.14062186s) [noise=true , address=104.36.82.58:4280 , piece_id=YUVJ2G4JOQECOGIQHCNF7FBR3SECNEKLVM3F2QBXV3GSAOAIOHVQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181796488 (8h12m2.140893742s) [noise=true , address=104.36.82.46:4516 , piece_id=IKLQNZYBXHLDGDP7S4OEZQ3RC6YOKQ5IXXM6MEWQKFIGDUB7FLVA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181982190 (8h12m2.141079441s) [noise=true , address=104.36.82.37:4660 , piece_id=M5U7KGBHFG7UYF6WLQEISXE64PF6DYG7NHI47CYQUXXWAVID64PA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182147460 (8h12m2.141244711s) [noise=true , address=104.36.82.62:4414 , piece_id=PLF3SDZAWZM2KMV76N3Q5ZRD2UMWNJNH2VMCGBTX4D34MNWA675A, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182356147 (8h12m2.141453406s) [noise=true , address=104.36.82.55:4197 , piece_id=N4QTMFXNAKANGTEPCLZG6JUTGCCBW7QJAQZFKUKF4QEOANYPKJNQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182437159 (8h12m2.14153441s) [noise=true , address=104.36.82.52:4108 , piece_id=Y744EJMSDJ4OBGSF57UAOFSJER4TPJ7BXTTY5HBUSP2WDSD4FOHA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182689680 (8h12m2.141786928s) [noise=true , address=104.36.82.36:4648 , piece_id=JBR4ONZYRTSQ52PHKLEHWUPBXUDK6OPGYUOQQV7QUG6UMOXIHS2A, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182725202 (8h12m2.14182245s) [noise=true , address=64.49.13.169:4710 , piece_id=TOFOCQ2F35L7QY6WPUTPD2XZOHGM7BYZOTBKKTOYHBSSL5ZPCI4Q, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182986738 (8h12m2.142083987s) [noise=true , address=104.36.82.60:4351 , piece_id=3FYQGNJSC44EP5LPPB7MDSBOJB3VQI5WII7PXKPSH7KKHV3UGNOQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.183281883 (8h12m2.142379114s) [noise=true , address=79.127.205.233:4625 , piece_id=Q5OP7MQWKI5LVAOXSVIKD7HLHIIIGNP4GFBSBGOU7KRYKLMMKDVA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.183698827 (8h12m2.14279608s) [noise=true , address=104.36.82.22:4517 , piece_id=YNKWDF2L46QGZZGCIO4VXUWGDUFQFLQK5PQOA2BFV32BUI53TZIA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.785004157 (8h12m2.74410141s) [upload=8506]: Next returned nil segment
Aug 9 01:37:40.785025779 (8h12m2.74412303s) [upload=8506]: Waiting for error group managing segments...
Aug 9 01:37:40.942088464 (8h12m2.901185709s) [noise=true , address=104.36.82.43:4843 , piece_id=WVO2C7GOJSQWZAF67TBW3MTXRUVRSVILYVARLEMF4H54Z2QFT4JA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.943893997 (8h12m2.902991243s) [noise=true , address=104.36.82.8:4991 , piece_id=JB47QIZZRPBUQX4OZRP6CY46GOGBSRF3YYCBTL3XVOUK34OK3TMA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.948240181 (8h12m2.90733742s) [noise=true , address=104.36.82.61:4389 , piece_id=PSL3YRUSQ4S4HVHON6LN7Q4ZRLVIGKTGBK2R5KVY5CQMCFAZJIEQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.965455840 (8h12m2.924553078s) [noise=true , address=104.36.82.22:4517 , piece_id=YNKWDF2L46QGZZGCIO4VXUWGDUFQFLQK5PQOA2BFV32BUI53TZIA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.965793772 (8h12m2.924891015s) [noise=true , address=104.36.82.60:4351 , piece_id=3FYQGNJSC44EP5LPPB7MDSBOJB3VQI5WII7PXKPSH7KKHV3UGNOQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.967071943 (8h12m2.926169174s) [noise=true , address=104.36.82.44:4872 , piece_id=E3BVSGBN23F5TQXNQKBZWU4GE3E5NLNT3446IUIR6C32KKA66X4Q, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.972526119 (8h12m2.931623363s) [noise=true , address=104.36.82.55:4197 , piece_id=N4QTMFXNAKANGTEPCLZG6JUTGCCBW7QJAQZFKUKF4QEOANYPKJNQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.973224814 (8h12m2.932322051s) [noise=true , address=104.36.82.36:4649 , piece_id=XVEF6EPWEMC5MEXARNPYZ26WRJVNFLYS7W4MPCUZHTZT5XGKJBMA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.976278379 (8h12m2.935375629s) [noise=true , address=104.36.82.62:4414 , piece_id=PLF3SDZAWZM2KMV76N3Q5ZRD2UMWNJNH2VMCGBTX4D34MNWA675A, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.977210898 (8h12m2.936308144s) [noise=true , address=104.36.82.36:4648 , piece_id=JBR4ONZYRTSQ52PHKLEHWUPBXUDK6OPGYUOQQV7QUG6UMOXIHS2A, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.983081736 (8h12m2.942178972s) [noise=true , address=104.36.82.58:4280 , piece_id=YUVJ2G4JOQECOGIQHCNF7FBR3SECNEKLVM3F2QBXV3GSAOAIOHVQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.001400028 (8h12m2.960497282s) [noise=true , address=104.36.82.46:4516 , piece_id=IKLQNZYBXHLDGDP7S4OEZQ3RC6YOKQ5IXXM6MEWQKFIGDUB7FLVA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.018227379 (8h12m2.977324618s) [noise=true , address=104.36.82.37:4660 , piece_id=M5U7KGBHFG7UYF6WLQEISXE64PF6DYG7NHI47CYQUXXWAVID64PA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.107000447 (8h12m3.066097679s) [noise=true , address=79.127.201.215:4357 , piece_id=5BUGCF53FXENMTR37BKGHXS7X7SLMZZMKWQQHRITBY2EZUWHCIPQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.107023182 (8h12m3.066120414s) [seg_pos={0 0}, upload=8506]: Segment reached optimal threshold of 14 pieces.
Aug 9 01:37:41.107386732 (8h12m3.066483977s) [noise=true , address=156.146.43.225:4447 , piece_id=VNI2L3DYKSVKFSBG6T4XBZN3TAYMTXR3WFWWFHBKRVLTHSJMJKCA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cxeoGU2UJZiVGgmdmWW5iqfhGzBCvMGc7sXT1F2cEUhuQztkB): protocol: expected piece hash; context canceled; EOF
Aug 9 01:37:41.107771226 (8h12m3.06686847s) [noise=true , address=79.127.205.233:4625 , piece_id=Q5OP7MQWKI5LVAOXSVIKD7HLHIIIGNP4GFBSBGOU7KRYKLMMKDVA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sq71vD4JQ9eSC57mKXGJDm2rN83CbsByuwi49iESzH4U155kD): protocol: write tcp 139.59.144.22:42468->79.127.205.233:4625: use of closed network connection; write tcp 139.59.144.22:42468->79.127.205.233:4625: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42468->79.127.205.233:4625: use of closed network connection
Aug 9 01:37:41.107852883 (8h12m3.066950131s) [noise=true , address=64.49.13.169:4710 , piece_id=TOFOCQ2F35L7QY6WPUTPD2XZOHGM7BYZOTBKKTOYHBSSL5ZPCI4Q, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: write tcp 139.59.144.22:40654->64.49.13.169:4710: use of closed network connection; write tcp 139.59.144.22:40654->64.49.13.169:4710: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40654->64.49.13.169:4710: use of closed network connection
Aug 9 01:37:41.108063179 (8h12m3.067160425s) [noise=true , address=104.36.82.52:4108 , piece_id=Y744EJMSDJ4OBGSF57UAOFSJER4TPJ7BXTTY5HBUSP2WDSD4FOHA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XJJZCUSHUS52YC6jhoPB4ayjsyKZT477PymPj4inkZtdUvheT): protocol: write tcp 139.59.144.22:57682->104.36.82.52:4108: use of closed network connection; write tcp 139.59.144.22:57682->104.36.82.52:4108: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57682->104.36.82.52:4108: use of closed network connection
Aug 9 01:37:41.108082464 (8h12m3.067179699s) [seg_pos={0 0}, upload=8506]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 01:37:41.108208497 (8h12m3.067305745s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 01:37:41.108213756 (8h12m3.067311001s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 01:37:41.420082799 (8h12m3.379180055s) [upload=8506]: Done uploading segments...
Aug 9 01:37:41.420118181 (8h12m3.379215434s) [upload=8506]: Upload finished. err: <nil>
Duration: 2.508425425s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.................X........X.................................] duration:
937.860582ms
FAIL (2025-08-09 02:00:37 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e800cd77abfe6f89dd9a7b1968797c0055c19b74871740b580526621edd70cd9 != before dd76228426f38416816ab6cfc46f90886908201f1a25fc192ad5d70e7cc00daa ======LOGS====== Aug 9 01:34:32.980837268 (8h8m54.93993452s) [upload=8446]: Starting upload Aug 9 01:34:32.980920293 (8h8m54.940017544s) [upload=8446]: Done starting upload Aug 9 01:34:32.981022059 (8h8m54.940119305s) [upload=8446]: Uploading segments... Aug 9 01:34:32.981072134 (8h8m54.940169388s) [upload=8446]: Got next segment. Inline: true Aug 9 01:34:32.981078622 (8h8m54.940175868s) [upload=8446]: Waiting for error group managing segments... Aug 9 01:34:32.981128886 (8h8m54.940226139s) [upload=8446]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 01:34:32.981135509 (8h8m54.940232759s) [upload=8446]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 01:34:32.981140290 (8h8m54.940237543s) [upload=8446]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 01:34:33.174309035 (8h8m55.133406286s) [upload=8446]: Done uploading segments... Aug 9 01:34:33.174352609 (8h8m55.133449855s) [upload=8446]: Upload finished. err: <nil>
Duration: 937.886809ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................X..........X.............................] duration:
2.452065581s
FAIL (2025-08-09 01:59:41 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 94afcee7731a2b877dfcae283ac3ff6dfc82b6c045d3239802dbbab47b431857 != before a467afc70c7187cd4597cb7b3731ac500946666b57769b2188794949ffc86afe
======LOGS======
Aug 9 01:37:39.977951417 (8h12m1.937048655s) [upload=8506]: Starting upload
Aug 9 01:37:39.978012527 (8h12m1.937109772s) [upload=8506]: Done starting upload
Aug 9 01:37:39.978139735 (8h12m1.937236973s) [upload=8506]: Uploading segments...
Aug 9 01:37:39.978272880 (8h12m1.937370126s) [upload=8506]: Got next segment. Inline: false
Aug 9 01:37:39.978323989 (8h12m1.93742124s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 01:37:39.978330714 (8h12m1.937427961s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 01:37:40.180138125 (8h12m2.139235371s) [seg_pos={0 0}, upload=8506]: Begin upload segment...
Aug 9 01:37:40.180207573 (8h12m2.139304811s) [seg_pos={0 0}, upload=8506]: Done begin upload segment.
Aug 9 01:37:40.180240200 (8h12m2.139337436s) [noise=true , address=104.36.82.43:4843 , piece_id=WVO2C7GOJSQWZAF67TBW3MTXRUVRSVILYVARLEMF4H54Z2QFT4JA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180267541 (8h12m2.139364796s) [noise=true , address=104.36.82.44:4872 , piece_id=E3BVSGBN23F5TQXNQKBZWU4GE3E5NLNT3446IUIR6C32KKA66X4Q, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180662941 (8h12m2.139760195s) [noise=true , address=79.127.201.215:4357 , piece_id=5BUGCF53FXENMTR37BKGHXS7X7SLMZZMKWQQHRITBY2EZUWHCIPQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180687333 (8h12m2.139784579s) [noise=true , address=104.36.82.8:4991 , piece_id=JB47QIZZRPBUQX4OZRP6CY46GOGBSRF3YYCBTL3XVOUK34OK3TMA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180981984 (8h12m2.14007923s) [noise=true , address=104.36.82.61:4389 , piece_id=PSL3YRUSQ4S4HVHON6LN7Q4ZRLVIGKTGBK2R5KVY5CQMCFAZJIEQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181059607 (8h12m2.140156855s) [noise=true , address=156.146.43.225:4447 , piece_id=VNI2L3DYKSVKFSBG6T4XBZN3TAYMTXR3WFWWFHBKRVLTHSJMJKCA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181398585 (8h12m2.14049584s) [noise=true , address=104.36.82.36:4649 , piece_id=XVEF6EPWEMC5MEXARNPYZ26WRJVNFLYS7W4MPCUZHTZT5XGKJBMA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181524608 (8h12m2.14062186s) [noise=true , address=104.36.82.58:4280 , piece_id=YUVJ2G4JOQECOGIQHCNF7FBR3SECNEKLVM3F2QBXV3GSAOAIOHVQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181796488 (8h12m2.140893742s) [noise=true , address=104.36.82.46:4516 , piece_id=IKLQNZYBXHLDGDP7S4OEZQ3RC6YOKQ5IXXM6MEWQKFIGDUB7FLVA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181982190 (8h12m2.141079441s) [noise=true , address=104.36.82.37:4660 , piece_id=M5U7KGBHFG7UYF6WLQEISXE64PF6DYG7NHI47CYQUXXWAVID64PA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182147460 (8h12m2.141244711s) [noise=true , address=104.36.82.62:4414 , piece_id=PLF3SDZAWZM2KMV76N3Q5ZRD2UMWNJNH2VMCGBTX4D34MNWA675A, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182356147 (8h12m2.141453406s) [noise=true , address=104.36.82.55:4197 , piece_id=N4QTMFXNAKANGTEPCLZG6JUTGCCBW7QJAQZFKUKF4QEOANYPKJNQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182437159 (8h12m2.14153441s) [noise=true , address=104.36.82.52:4108 , piece_id=Y744EJMSDJ4OBGSF57UAOFSJER4TPJ7BXTTY5HBUSP2WDSD4FOHA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182689680 (8h12m2.141786928s) [noise=true , address=104.36.82.36:4648 , piece_id=JBR4ONZYRTSQ52PHKLEHWUPBXUDK6OPGYUOQQV7QUG6UMOXIHS2A, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182725202 (8h12m2.14182245s) [noise=true , address=64.49.13.169:4710 , piece_id=TOFOCQ2F35L7QY6WPUTPD2XZOHGM7BYZOTBKKTOYHBSSL5ZPCI4Q, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182986738 (8h12m2.142083987s) [noise=true , address=104.36.82.60:4351 , piece_id=3FYQGNJSC44EP5LPPB7MDSBOJB3VQI5WII7PXKPSH7KKHV3UGNOQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.183281883 (8h12m2.142379114s) [noise=true , address=79.127.205.233:4625 , piece_id=Q5OP7MQWKI5LVAOXSVIKD7HLHIIIGNP4GFBSBGOU7KRYKLMMKDVA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.183698827 (8h12m2.14279608s) [noise=true , address=104.36.82.22:4517 , piece_id=YNKWDF2L46QGZZGCIO4VXUWGDUFQFLQK5PQOA2BFV32BUI53TZIA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.785004157 (8h12m2.74410141s) [upload=8506]: Next returned nil segment
Aug 9 01:37:40.785025779 (8h12m2.74412303s) [upload=8506]: Waiting for error group managing segments...
Aug 9 01:37:40.942088464 (8h12m2.901185709s) [noise=true , address=104.36.82.43:4843 , piece_id=WVO2C7GOJSQWZAF67TBW3MTXRUVRSVILYVARLEMF4H54Z2QFT4JA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.943893997 (8h12m2.902991243s) [noise=true , address=104.36.82.8:4991 , piece_id=JB47QIZZRPBUQX4OZRP6CY46GOGBSRF3YYCBTL3XVOUK34OK3TMA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.948240181 (8h12m2.90733742s) [noise=true , address=104.36.82.61:4389 , piece_id=PSL3YRUSQ4S4HVHON6LN7Q4ZRLVIGKTGBK2R5KVY5CQMCFAZJIEQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.965455840 (8h12m2.924553078s) [noise=true , address=104.36.82.22:4517 , piece_id=YNKWDF2L46QGZZGCIO4VXUWGDUFQFLQK5PQOA2BFV32BUI53TZIA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.965793772 (8h12m2.924891015s) [noise=true , address=104.36.82.60:4351 , piece_id=3FYQGNJSC44EP5LPPB7MDSBOJB3VQI5WII7PXKPSH7KKHV3UGNOQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.967071943 (8h12m2.926169174s) [noise=true , address=104.36.82.44:4872 , piece_id=E3BVSGBN23F5TQXNQKBZWU4GE3E5NLNT3446IUIR6C32KKA66X4Q, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.972526119 (8h12m2.931623363s) [noise=true , address=104.36.82.55:4197 , piece_id=N4QTMFXNAKANGTEPCLZG6JUTGCCBW7QJAQZFKUKF4QEOANYPKJNQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.973224814 (8h12m2.932322051s) [noise=true , address=104.36.82.36:4649 , piece_id=XVEF6EPWEMC5MEXARNPYZ26WRJVNFLYS7W4MPCUZHTZT5XGKJBMA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.976278379 (8h12m2.935375629s) [noise=true , address=104.36.82.62:4414 , piece_id=PLF3SDZAWZM2KMV76N3Q5ZRD2UMWNJNH2VMCGBTX4D34MNWA675A, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.977210898 (8h12m2.936308144s) [noise=true , address=104.36.82.36:4648 , piece_id=JBR4ONZYRTSQ52PHKLEHWUPBXUDK6OPGYUOQQV7QUG6UMOXIHS2A, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.983081736 (8h12m2.942178972s) [noise=true , address=104.36.82.58:4280 , piece_id=YUVJ2G4JOQECOGIQHCNF7FBR3SECNEKLVM3F2QBXV3GSAOAIOHVQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.001400028 (8h12m2.960497282s) [noise=true , address=104.36.82.46:4516 , piece_id=IKLQNZYBXHLDGDP7S4OEZQ3RC6YOKQ5IXXM6MEWQKFIGDUB7FLVA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.018227379 (8h12m2.977324618s) [noise=true , address=104.36.82.37:4660 , piece_id=M5U7KGBHFG7UYF6WLQEISXE64PF6DYG7NHI47CYQUXXWAVID64PA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.107000447 (8h12m3.066097679s) [noise=true , address=79.127.201.215:4357 , piece_id=5BUGCF53FXENMTR37BKGHXS7X7SLMZZMKWQQHRITBY2EZUWHCIPQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.107023182 (8h12m3.066120414s) [seg_pos={0 0}, upload=8506]: Segment reached optimal threshold of 14 pieces.
Aug 9 01:37:41.107386732 (8h12m3.066483977s) [noise=true , address=156.146.43.225:4447 , piece_id=VNI2L3DYKSVKFSBG6T4XBZN3TAYMTXR3WFWWFHBKRVLTHSJMJKCA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cxeoGU2UJZiVGgmdmWW5iqfhGzBCvMGc7sXT1F2cEUhuQztkB): protocol: expected piece hash; context canceled; EOF
Aug 9 01:37:41.107771226 (8h12m3.06686847s) [noise=true , address=79.127.205.233:4625 , piece_id=Q5OP7MQWKI5LVAOXSVIKD7HLHIIIGNP4GFBSBGOU7KRYKLMMKDVA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sq71vD4JQ9eSC57mKXGJDm2rN83CbsByuwi49iESzH4U155kD): protocol: write tcp 139.59.144.22:42468->79.127.205.233:4625: use of closed network connection; write tcp 139.59.144.22:42468->79.127.205.233:4625: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42468->79.127.205.233:4625: use of closed network connection
Aug 9 01:37:41.107852883 (8h12m3.066950131s) [noise=true , address=64.49.13.169:4710 , piece_id=TOFOCQ2F35L7QY6WPUTPD2XZOHGM7BYZOTBKKTOYHBSSL5ZPCI4Q, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: write tcp 139.59.144.22:40654->64.49.13.169:4710: use of closed network connection; write tcp 139.59.144.22:40654->64.49.13.169:4710: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40654->64.49.13.169:4710: use of closed network connection
Aug 9 01:37:41.108063179 (8h12m3.067160425s) [noise=true , address=104.36.82.52:4108 , piece_id=Y744EJMSDJ4OBGSF57UAOFSJER4TPJ7BXTTY5HBUSP2WDSD4FOHA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XJJZCUSHUS52YC6jhoPB4ayjsyKZT477PymPj4inkZtdUvheT): protocol: write tcp 139.59.144.22:57682->104.36.82.52:4108: use of closed network connection; write tcp 139.59.144.22:57682->104.36.82.52:4108: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57682->104.36.82.52:4108: use of closed network connection
Aug 9 01:37:41.108082464 (8h12m3.067179699s) [seg_pos={0 0}, upload=8506]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 01:37:41.108208497 (8h12m3.067305745s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 01:37:41.108213756 (8h12m3.067311001s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 01:37:41.420082799 (8h12m3.379180055s) [upload=8506]: Done uploading segments...
Aug 9 01:37:41.420118181 (8h12m3.379215434s) [upload=8506]: Upload finished. err: <nil>
Duration: 2.452098702s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..................X........X................................] duration:
848.805255ms
FAIL (2025-08-09 01:59:27 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e800cd77abfe6f89dd9a7b1968797c0055c19b74871740b580526621edd70cd9 != before dd76228426f38416816ab6cfc46f90886908201f1a25fc192ad5d70e7cc00daa ======LOGS====== Aug 9 01:34:32.980837268 (8h8m54.93993452s) [upload=8446]: Starting upload Aug 9 01:34:32.980920293 (8h8m54.940017544s) [upload=8446]: Done starting upload Aug 9 01:34:32.981022059 (8h8m54.940119305s) [upload=8446]: Uploading segments... Aug 9 01:34:32.981072134 (8h8m54.940169388s) [upload=8446]: Got next segment. Inline: true Aug 9 01:34:32.981078622 (8h8m54.940175868s) [upload=8446]: Waiting for error group managing segments... Aug 9 01:34:32.981128886 (8h8m54.940226139s) [upload=8446]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 01:34:32.981135509 (8h8m54.940232759s) [upload=8446]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 01:34:32.981140290 (8h8m54.940237543s) [upload=8446]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 01:34:33.174309035 (8h8m55.133406286s) [upload=8446]: Done uploading segments... Aug 9 01:34:33.174352609 (8h8m55.133449855s) [upload=8446]: Upload finished. err: <nil>
Duration: 848.838189ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................X..........X............................] duration:
2.447424597s
FAIL (2025-08-09 01:59:11 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 94afcee7731a2b877dfcae283ac3ff6dfc82b6c045d3239802dbbab47b431857 != before a467afc70c7187cd4597cb7b3731ac500946666b57769b2188794949ffc86afe
======LOGS======
Aug 9 01:37:39.977951417 (8h12m1.937048655s) [upload=8506]: Starting upload
Aug 9 01:37:39.978012527 (8h12m1.937109772s) [upload=8506]: Done starting upload
Aug 9 01:37:39.978139735 (8h12m1.937236973s) [upload=8506]: Uploading segments...
Aug 9 01:37:39.978272880 (8h12m1.937370126s) [upload=8506]: Got next segment. Inline: false
Aug 9 01:37:39.978323989 (8h12m1.93742124s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 01:37:39.978330714 (8h12m1.937427961s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 01:37:40.180138125 (8h12m2.139235371s) [seg_pos={0 0}, upload=8506]: Begin upload segment...
Aug 9 01:37:40.180207573 (8h12m2.139304811s) [seg_pos={0 0}, upload=8506]: Done begin upload segment.
Aug 9 01:37:40.180240200 (8h12m2.139337436s) [noise=true , address=104.36.82.43:4843 , piece_id=WVO2C7GOJSQWZAF67TBW3MTXRUVRSVILYVARLEMF4H54Z2QFT4JA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180267541 (8h12m2.139364796s) [noise=true , address=104.36.82.44:4872 , piece_id=E3BVSGBN23F5TQXNQKBZWU4GE3E5NLNT3446IUIR6C32KKA66X4Q, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180662941 (8h12m2.139760195s) [noise=true , address=79.127.201.215:4357 , piece_id=5BUGCF53FXENMTR37BKGHXS7X7SLMZZMKWQQHRITBY2EZUWHCIPQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180687333 (8h12m2.139784579s) [noise=true , address=104.36.82.8:4991 , piece_id=JB47QIZZRPBUQX4OZRP6CY46GOGBSRF3YYCBTL3XVOUK34OK3TMA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180981984 (8h12m2.14007923s) [noise=true , address=104.36.82.61:4389 , piece_id=PSL3YRUSQ4S4HVHON6LN7Q4ZRLVIGKTGBK2R5KVY5CQMCFAZJIEQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181059607 (8h12m2.140156855s) [noise=true , address=156.146.43.225:4447 , piece_id=VNI2L3DYKSVKFSBG6T4XBZN3TAYMTXR3WFWWFHBKRVLTHSJMJKCA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181398585 (8h12m2.14049584s) [noise=true , address=104.36.82.36:4649 , piece_id=XVEF6EPWEMC5MEXARNPYZ26WRJVNFLYS7W4MPCUZHTZT5XGKJBMA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181524608 (8h12m2.14062186s) [noise=true , address=104.36.82.58:4280 , piece_id=YUVJ2G4JOQECOGIQHCNF7FBR3SECNEKLVM3F2QBXV3GSAOAIOHVQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181796488 (8h12m2.140893742s) [noise=true , address=104.36.82.46:4516 , piece_id=IKLQNZYBXHLDGDP7S4OEZQ3RC6YOKQ5IXXM6MEWQKFIGDUB7FLVA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181982190 (8h12m2.141079441s) [noise=true , address=104.36.82.37:4660 , piece_id=M5U7KGBHFG7UYF6WLQEISXE64PF6DYG7NHI47CYQUXXWAVID64PA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182147460 (8h12m2.141244711s) [noise=true , address=104.36.82.62:4414 , piece_id=PLF3SDZAWZM2KMV76N3Q5ZRD2UMWNJNH2VMCGBTX4D34MNWA675A, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182356147 (8h12m2.141453406s) [noise=true , address=104.36.82.55:4197 , piece_id=N4QTMFXNAKANGTEPCLZG6JUTGCCBW7QJAQZFKUKF4QEOANYPKJNQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182437159 (8h12m2.14153441s) [noise=true , address=104.36.82.52:4108 , piece_id=Y744EJMSDJ4OBGSF57UAOFSJER4TPJ7BXTTY5HBUSP2WDSD4FOHA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182689680 (8h12m2.141786928s) [noise=true , address=104.36.82.36:4648 , piece_id=JBR4ONZYRTSQ52PHKLEHWUPBXUDK6OPGYUOQQV7QUG6UMOXIHS2A, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182725202 (8h12m2.14182245s) [noise=true , address=64.49.13.169:4710 , piece_id=TOFOCQ2F35L7QY6WPUTPD2XZOHGM7BYZOTBKKTOYHBSSL5ZPCI4Q, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182986738 (8h12m2.142083987s) [noise=true , address=104.36.82.60:4351 , piece_id=3FYQGNJSC44EP5LPPB7MDSBOJB3VQI5WII7PXKPSH7KKHV3UGNOQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.183281883 (8h12m2.142379114s) [noise=true , address=79.127.205.233:4625 , piece_id=Q5OP7MQWKI5LVAOXSVIKD7HLHIIIGNP4GFBSBGOU7KRYKLMMKDVA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.183698827 (8h12m2.14279608s) [noise=true , address=104.36.82.22:4517 , piece_id=YNKWDF2L46QGZZGCIO4VXUWGDUFQFLQK5PQOA2BFV32BUI53TZIA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.785004157 (8h12m2.74410141s) [upload=8506]: Next returned nil segment
Aug 9 01:37:40.785025779 (8h12m2.74412303s) [upload=8506]: Waiting for error group managing segments...
Aug 9 01:37:40.942088464 (8h12m2.901185709s) [noise=true , address=104.36.82.43:4843 , piece_id=WVO2C7GOJSQWZAF67TBW3MTXRUVRSVILYVARLEMF4H54Z2QFT4JA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.943893997 (8h12m2.902991243s) [noise=true , address=104.36.82.8:4991 , piece_id=JB47QIZZRPBUQX4OZRP6CY46GOGBSRF3YYCBTL3XVOUK34OK3TMA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.948240181 (8h12m2.90733742s) [noise=true , address=104.36.82.61:4389 , piece_id=PSL3YRUSQ4S4HVHON6LN7Q4ZRLVIGKTGBK2R5KVY5CQMCFAZJIEQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.965455840 (8h12m2.924553078s) [noise=true , address=104.36.82.22:4517 , piece_id=YNKWDF2L46QGZZGCIO4VXUWGDUFQFLQK5PQOA2BFV32BUI53TZIA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.965793772 (8h12m2.924891015s) [noise=true , address=104.36.82.60:4351 , piece_id=3FYQGNJSC44EP5LPPB7MDSBOJB3VQI5WII7PXKPSH7KKHV3UGNOQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.967071943 (8h12m2.926169174s) [noise=true , address=104.36.82.44:4872 , piece_id=E3BVSGBN23F5TQXNQKBZWU4GE3E5NLNT3446IUIR6C32KKA66X4Q, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.972526119 (8h12m2.931623363s) [noise=true , address=104.36.82.55:4197 , piece_id=N4QTMFXNAKANGTEPCLZG6JUTGCCBW7QJAQZFKUKF4QEOANYPKJNQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.973224814 (8h12m2.932322051s) [noise=true , address=104.36.82.36:4649 , piece_id=XVEF6EPWEMC5MEXARNPYZ26WRJVNFLYS7W4MPCUZHTZT5XGKJBMA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.976278379 (8h12m2.935375629s) [noise=true , address=104.36.82.62:4414 , piece_id=PLF3SDZAWZM2KMV76N3Q5ZRD2UMWNJNH2VMCGBTX4D34MNWA675A, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.977210898 (8h12m2.936308144s) [noise=true , address=104.36.82.36:4648 , piece_id=JBR4ONZYRTSQ52PHKLEHWUPBXUDK6OPGYUOQQV7QUG6UMOXIHS2A, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.983081736 (8h12m2.942178972s) [noise=true , address=104.36.82.58:4280 , piece_id=YUVJ2G4JOQECOGIQHCNF7FBR3SECNEKLVM3F2QBXV3GSAOAIOHVQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.001400028 (8h12m2.960497282s) [noise=true , address=104.36.82.46:4516 , piece_id=IKLQNZYBXHLDGDP7S4OEZQ3RC6YOKQ5IXXM6MEWQKFIGDUB7FLVA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.018227379 (8h12m2.977324618s) [noise=true , address=104.36.82.37:4660 , piece_id=M5U7KGBHFG7UYF6WLQEISXE64PF6DYG7NHI47CYQUXXWAVID64PA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.107000447 (8h12m3.066097679s) [noise=true , address=79.127.201.215:4357 , piece_id=5BUGCF53FXENMTR37BKGHXS7X7SLMZZMKWQQHRITBY2EZUWHCIPQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.107023182 (8h12m3.066120414s) [seg_pos={0 0}, upload=8506]: Segment reached optimal threshold of 14 pieces.
Aug 9 01:37:41.107386732 (8h12m3.066483977s) [noise=true , address=156.146.43.225:4447 , piece_id=VNI2L3DYKSVKFSBG6T4XBZN3TAYMTXR3WFWWFHBKRVLTHSJMJKCA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cxeoGU2UJZiVGgmdmWW5iqfhGzBCvMGc7sXT1F2cEUhuQztkB): protocol: expected piece hash; context canceled; EOF
Aug 9 01:37:41.107771226 (8h12m3.06686847s) [noise=true , address=79.127.205.233:4625 , piece_id=Q5OP7MQWKI5LVAOXSVIKD7HLHIIIGNP4GFBSBGOU7KRYKLMMKDVA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sq71vD4JQ9eSC57mKXGJDm2rN83CbsByuwi49iESzH4U155kD): protocol: write tcp 139.59.144.22:42468->79.127.205.233:4625: use of closed network connection; write tcp 139.59.144.22:42468->79.127.205.233:4625: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42468->79.127.205.233:4625: use of closed network connection
Aug 9 01:37:41.107852883 (8h12m3.066950131s) [noise=true , address=64.49.13.169:4710 , piece_id=TOFOCQ2F35L7QY6WPUTPD2XZOHGM7BYZOTBKKTOYHBSSL5ZPCI4Q, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: write tcp 139.59.144.22:40654->64.49.13.169:4710: use of closed network connection; write tcp 139.59.144.22:40654->64.49.13.169:4710: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40654->64.49.13.169:4710: use of closed network connection
Aug 9 01:37:41.108063179 (8h12m3.067160425s) [noise=true , address=104.36.82.52:4108 , piece_id=Y744EJMSDJ4OBGSF57UAOFSJER4TPJ7BXTTY5HBUSP2WDSD4FOHA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XJJZCUSHUS52YC6jhoPB4ayjsyKZT477PymPj4inkZtdUvheT): protocol: write tcp 139.59.144.22:57682->104.36.82.52:4108: use of closed network connection; write tcp 139.59.144.22:57682->104.36.82.52:4108: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57682->104.36.82.52:4108: use of closed network connection
Aug 9 01:37:41.108082464 (8h12m3.067179699s) [seg_pos={0 0}, upload=8506]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 01:37:41.108208497 (8h12m3.067305745s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 01:37:41.108213756 (8h12m3.067311001s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 01:37:41.420082799 (8h12m3.379180055s) [upload=8506]: Done uploading segments...
Aug 9 01:37:41.420118181 (8h12m3.379215434s) [upload=8506]: Upload finished. err: <nil>
Duration: 2.447452365s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...................X........X...............................] duration:
896.210941ms
FAIL (2025-08-09 01:59:06 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e800cd77abfe6f89dd9a7b1968797c0055c19b74871740b580526621edd70cd9 != before dd76228426f38416816ab6cfc46f90886908201f1a25fc192ad5d70e7cc00daa ======LOGS====== Aug 9 01:34:32.980837268 (8h8m54.93993452s) [upload=8446]: Starting upload Aug 9 01:34:32.980920293 (8h8m54.940017544s) [upload=8446]: Done starting upload Aug 9 01:34:32.981022059 (8h8m54.940119305s) [upload=8446]: Uploading segments... Aug 9 01:34:32.981072134 (8h8m54.940169388s) [upload=8446]: Got next segment. Inline: true Aug 9 01:34:32.981078622 (8h8m54.940175868s) [upload=8446]: Waiting for error group managing segments... Aug 9 01:34:32.981128886 (8h8m54.940226139s) [upload=8446]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 01:34:32.981135509 (8h8m54.940232759s) [upload=8446]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 01:34:32.981140290 (8h8m54.940237543s) [upload=8446]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 01:34:33.174309035 (8h8m55.133406286s) [upload=8446]: Done uploading segments... Aug 9 01:34:33.174352609 (8h8m55.133449855s) [upload=8446]: Upload finished. err: <nil>
Duration: 896.245707ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....................X........X..............................] duration:
881.220779ms
FAIL (2025-08-09 01:58:38 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e800cd77abfe6f89dd9a7b1968797c0055c19b74871740b580526621edd70cd9 != before dd76228426f38416816ab6cfc46f90886908201f1a25fc192ad5d70e7cc00daa ======LOGS====== Aug 9 01:34:32.980837268 (8h8m54.93993452s) [upload=8446]: Starting upload Aug 9 01:34:32.980920293 (8h8m54.940017544s) [upload=8446]: Done starting upload Aug 9 01:34:32.981022059 (8h8m54.940119305s) [upload=8446]: Uploading segments... Aug 9 01:34:32.981072134 (8h8m54.940169388s) [upload=8446]: Got next segment. Inline: true Aug 9 01:34:32.981078622 (8h8m54.940175868s) [upload=8446]: Waiting for error group managing segments... Aug 9 01:34:32.981128886 (8h8m54.940226139s) [upload=8446]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 01:34:32.981135509 (8h8m54.940232759s) [upload=8446]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 01:34:32.981140290 (8h8m54.940237543s) [upload=8446]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 01:34:33.174309035 (8h8m55.133406286s) [upload=8446]: Done uploading segments... Aug 9 01:34:33.174352609 (8h8m55.133449855s) [upload=8446]: Upload finished. err: <nil>
Duration: 881.25133ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................X..........X...........................] duration:
2.429077432s
FAIL (2025-08-09 01:58:10 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 94afcee7731a2b877dfcae283ac3ff6dfc82b6c045d3239802dbbab47b431857 != before a467afc70c7187cd4597cb7b3731ac500946666b57769b2188794949ffc86afe
======LOGS======
Aug 9 01:37:39.977951417 (8h12m1.937048655s) [upload=8506]: Starting upload
Aug 9 01:37:39.978012527 (8h12m1.937109772s) [upload=8506]: Done starting upload
Aug 9 01:37:39.978139735 (8h12m1.937236973s) [upload=8506]: Uploading segments...
Aug 9 01:37:39.978272880 (8h12m1.937370126s) [upload=8506]: Got next segment. Inline: false
Aug 9 01:37:39.978323989 (8h12m1.93742124s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 01:37:39.978330714 (8h12m1.937427961s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 01:37:40.180138125 (8h12m2.139235371s) [seg_pos={0 0}, upload=8506]: Begin upload segment...
Aug 9 01:37:40.180207573 (8h12m2.139304811s) [seg_pos={0 0}, upload=8506]: Done begin upload segment.
Aug 9 01:37:40.180240200 (8h12m2.139337436s) [noise=true , address=104.36.82.43:4843 , piece_id=WVO2C7GOJSQWZAF67TBW3MTXRUVRSVILYVARLEMF4H54Z2QFT4JA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180267541 (8h12m2.139364796s) [noise=true , address=104.36.82.44:4872 , piece_id=E3BVSGBN23F5TQXNQKBZWU4GE3E5NLNT3446IUIR6C32KKA66X4Q, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180662941 (8h12m2.139760195s) [noise=true , address=79.127.201.215:4357 , piece_id=5BUGCF53FXENMTR37BKGHXS7X7SLMZZMKWQQHRITBY2EZUWHCIPQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180687333 (8h12m2.139784579s) [noise=true , address=104.36.82.8:4991 , piece_id=JB47QIZZRPBUQX4OZRP6CY46GOGBSRF3YYCBTL3XVOUK34OK3TMA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.180981984 (8h12m2.14007923s) [noise=true , address=104.36.82.61:4389 , piece_id=PSL3YRUSQ4S4HVHON6LN7Q4ZRLVIGKTGBK2R5KVY5CQMCFAZJIEQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181059607 (8h12m2.140156855s) [noise=true , address=156.146.43.225:4447 , piece_id=VNI2L3DYKSVKFSBG6T4XBZN3TAYMTXR3WFWWFHBKRVLTHSJMJKCA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181398585 (8h12m2.14049584s) [noise=true , address=104.36.82.36:4649 , piece_id=XVEF6EPWEMC5MEXARNPYZ26WRJVNFLYS7W4MPCUZHTZT5XGKJBMA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181524608 (8h12m2.14062186s) [noise=true , address=104.36.82.58:4280 , piece_id=YUVJ2G4JOQECOGIQHCNF7FBR3SECNEKLVM3F2QBXV3GSAOAIOHVQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181796488 (8h12m2.140893742s) [noise=true , address=104.36.82.46:4516 , piece_id=IKLQNZYBXHLDGDP7S4OEZQ3RC6YOKQ5IXXM6MEWQKFIGDUB7FLVA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.181982190 (8h12m2.141079441s) [noise=true , address=104.36.82.37:4660 , piece_id=M5U7KGBHFG7UYF6WLQEISXE64PF6DYG7NHI47CYQUXXWAVID64PA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182147460 (8h12m2.141244711s) [noise=true , address=104.36.82.62:4414 , piece_id=PLF3SDZAWZM2KMV76N3Q5ZRD2UMWNJNH2VMCGBTX4D34MNWA675A, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182356147 (8h12m2.141453406s) [noise=true , address=104.36.82.55:4197 , piece_id=N4QTMFXNAKANGTEPCLZG6JUTGCCBW7QJAQZFKUKF4QEOANYPKJNQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182437159 (8h12m2.14153441s) [noise=true , address=104.36.82.52:4108 , piece_id=Y744EJMSDJ4OBGSF57UAOFSJER4TPJ7BXTTY5HBUSP2WDSD4FOHA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182689680 (8h12m2.141786928s) [noise=true , address=104.36.82.36:4648 , piece_id=JBR4ONZYRTSQ52PHKLEHWUPBXUDK6OPGYUOQQV7QUG6UMOXIHS2A, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182725202 (8h12m2.14182245s) [noise=true , address=64.49.13.169:4710 , piece_id=TOFOCQ2F35L7QY6WPUTPD2XZOHGM7BYZOTBKKTOYHBSSL5ZPCI4Q, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.182986738 (8h12m2.142083987s) [noise=true , address=104.36.82.60:4351 , piece_id=3FYQGNJSC44EP5LPPB7MDSBOJB3VQI5WII7PXKPSH7KKHV3UGNOQ, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.183281883 (8h12m2.142379114s) [noise=true , address=79.127.205.233:4625 , piece_id=Q5OP7MQWKI5LVAOXSVIKD7HLHIIIGNP4GFBSBGOU7KRYKLMMKDVA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.183698827 (8h12m2.14279608s) [noise=true , address=104.36.82.22:4517 , piece_id=YNKWDF2L46QGZZGCIO4VXUWGDUFQFLQK5PQOA2BFV32BUI53TZIA, seg_pos={0 0}, upload=8506]: Uploading piece...
Aug 9 01:37:40.785004157 (8h12m2.74410141s) [upload=8506]: Next returned nil segment
Aug 9 01:37:40.785025779 (8h12m2.74412303s) [upload=8506]: Waiting for error group managing segments...
Aug 9 01:37:40.942088464 (8h12m2.901185709s) [noise=true , address=104.36.82.43:4843 , piece_id=WVO2C7GOJSQWZAF67TBW3MTXRUVRSVILYVARLEMF4H54Z2QFT4JA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.943893997 (8h12m2.902991243s) [noise=true , address=104.36.82.8:4991 , piece_id=JB47QIZZRPBUQX4OZRP6CY46GOGBSRF3YYCBTL3XVOUK34OK3TMA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.948240181 (8h12m2.90733742s) [noise=true , address=104.36.82.61:4389 , piece_id=PSL3YRUSQ4S4HVHON6LN7Q4ZRLVIGKTGBK2R5KVY5CQMCFAZJIEQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.965455840 (8h12m2.924553078s) [noise=true , address=104.36.82.22:4517 , piece_id=YNKWDF2L46QGZZGCIO4VXUWGDUFQFLQK5PQOA2BFV32BUI53TZIA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.965793772 (8h12m2.924891015s) [noise=true , address=104.36.82.60:4351 , piece_id=3FYQGNJSC44EP5LPPB7MDSBOJB3VQI5WII7PXKPSH7KKHV3UGNOQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.967071943 (8h12m2.926169174s) [noise=true , address=104.36.82.44:4872 , piece_id=E3BVSGBN23F5TQXNQKBZWU4GE3E5NLNT3446IUIR6C32KKA66X4Q, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.972526119 (8h12m2.931623363s) [noise=true , address=104.36.82.55:4197 , piece_id=N4QTMFXNAKANGTEPCLZG6JUTGCCBW7QJAQZFKUKF4QEOANYPKJNQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.973224814 (8h12m2.932322051s) [noise=true , address=104.36.82.36:4649 , piece_id=XVEF6EPWEMC5MEXARNPYZ26WRJVNFLYS7W4MPCUZHTZT5XGKJBMA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.976278379 (8h12m2.935375629s) [noise=true , address=104.36.82.62:4414 , piece_id=PLF3SDZAWZM2KMV76N3Q5ZRD2UMWNJNH2VMCGBTX4D34MNWA675A, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.977210898 (8h12m2.936308144s) [noise=true , address=104.36.82.36:4648 , piece_id=JBR4ONZYRTSQ52PHKLEHWUPBXUDK6OPGYUOQQV7QUG6UMOXIHS2A, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:40.983081736 (8h12m2.942178972s) [noise=true , address=104.36.82.58:4280 , piece_id=YUVJ2G4JOQECOGIQHCNF7FBR3SECNEKLVM3F2QBXV3GSAOAIOHVQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.001400028 (8h12m2.960497282s) [noise=true , address=104.36.82.46:4516 , piece_id=IKLQNZYBXHLDGDP7S4OEZQ3RC6YOKQ5IXXM6MEWQKFIGDUB7FLVA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.018227379 (8h12m2.977324618s) [noise=true , address=104.36.82.37:4660 , piece_id=M5U7KGBHFG7UYF6WLQEISXE64PF6DYG7NHI47CYQUXXWAVID64PA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.107000447 (8h12m3.066097679s) [noise=true , address=79.127.201.215:4357 , piece_id=5BUGCF53FXENMTR37BKGHXS7X7SLMZZMKWQQHRITBY2EZUWHCIPQ, seg_pos={0 0}, upload=8506]: Done uploading piece. err: <nil>
Aug 9 01:37:41.107023182 (8h12m3.066120414s) [seg_pos={0 0}, upload=8506]: Segment reached optimal threshold of 14 pieces.
Aug 9 01:37:41.107386732 (8h12m3.066483977s) [noise=true , address=156.146.43.225:4447 , piece_id=VNI2L3DYKSVKFSBG6T4XBZN3TAYMTXR3WFWWFHBKRVLTHSJMJKCA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1cxeoGU2UJZiVGgmdmWW5iqfhGzBCvMGc7sXT1F2cEUhuQztkB): protocol: expected piece hash; context canceled; EOF
Aug 9 01:37:41.107771226 (8h12m3.06686847s) [noise=true , address=79.127.205.233:4625 , piece_id=Q5OP7MQWKI5LVAOXSVIKD7HLHIIIGNP4GFBSBGOU7KRYKLMMKDVA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sq71vD4JQ9eSC57mKXGJDm2rN83CbsByuwi49iESzH4U155kD): protocol: write tcp 139.59.144.22:42468->79.127.205.233:4625: use of closed network connection; write tcp 139.59.144.22:42468->79.127.205.233:4625: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:42468->79.127.205.233:4625: use of closed network connection
Aug 9 01:37:41.107852883 (8h12m3.066950131s) [noise=true , address=64.49.13.169:4710 , piece_id=TOFOCQ2F35L7QY6WPUTPD2XZOHGM7BYZOTBKKTOYHBSSL5ZPCI4Q, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hsbGK94RFwxic9F8NKp8kKvztegUhkNmYEor4QyLJmqF3seZf): protocol: write tcp 139.59.144.22:40654->64.49.13.169:4710: use of closed network connection; write tcp 139.59.144.22:40654->64.49.13.169:4710: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:40654->64.49.13.169:4710: use of closed network connection
Aug 9 01:37:41.108063179 (8h12m3.067160425s) [noise=true , address=104.36.82.52:4108 , piece_id=Y744EJMSDJ4OBGSF57UAOFSJER4TPJ7BXTTY5HBUSP2WDSD4FOHA, seg_pos={0 0}, upload=8506]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XJJZCUSHUS52YC6jhoPB4ayjsyKZT477PymPj4inkZtdUvheT): protocol: write tcp 139.59.144.22:57682->104.36.82.52:4108: use of closed network connection; write tcp 139.59.144.22:57682->104.36.82.52:4108: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:57682->104.36.82.52:4108: use of closed network connection
Aug 9 01:37:41.108082464 (8h12m3.067179699s) [seg_pos={0 0}, upload=8506]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 01:37:41.108208497 (8h12m3.067305745s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 01:37:41.108213756 (8h12m3.067311001s) [upload=8506]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 01:37:41.420082799 (8h12m3.379180055s) [upload=8506]: Done uploading segments...
Aug 9 01:37:41.420118181 (8h12m3.379215434s) [upload=8506]: Upload finished. err: <nil>
Duration: 2.429106164s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....................X........X.............................] duration:
832.250883ms
FAIL (2025-08-09 01:57:47 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after e800cd77abfe6f89dd9a7b1968797c0055c19b74871740b580526621edd70cd9 != before dd76228426f38416816ab6cfc46f90886908201f1a25fc192ad5d70e7cc00daa ======LOGS====== Aug 9 01:34:32.980837268 (8h8m54.93993452s) [upload=8446]: Starting upload Aug 9 01:34:32.980920293 (8h8m54.940017544s) [upload=8446]: Done starting upload Aug 9 01:34:32.981022059 (8h8m54.940119305s) [upload=8446]: Uploading segments... Aug 9 01:34:32.981072134 (8h8m54.940169388s) [upload=8446]: Got next segment. Inline: true Aug 9 01:34:32.981078622 (8h8m54.940175868s) [upload=8446]: Waiting for error group managing segments... Aug 9 01:34:32.981128886 (8h8m54.940226139s) [upload=8446]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 01:34:32.981135509 (8h8m54.940232759s) [upload=8446]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 01:34:32.981140290 (8h8m54.940237543s) [upload=8446]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 01:34:33.174309035 (8h8m55.133406286s) [upload=8446]: Done uploading segments... Aug 9 01:34:33.174352609 (8h8m55.133449855s) [upload=8446]: Upload finished. err: <nil>
Duration: 832.277596ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|