Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....X.....................X.....X..........................] duration:
1.119945896s
FAIL (2025-08-16 23:07:03 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 22:48:41.883559329 (197h23m3.842656575s) [upload=205414]: Starting upload Aug 16 22:48:41.883616147 (197h23m3.842713394s) [upload=205414]: Done starting upload Aug 16 22:48:41.883698102 (197h23m3.842795348s) [upload=205414]: Uploading segments... Aug 16 22:48:41.883755229 (197h23m3.842853797s) [upload=205414]: Got next segment. Inline: true Aug 16 22:48:41.883763436 (197h23m3.842860682s) [upload=205414]: Waiting for error group managing segments... Aug 16 22:48:41.883813582 (197h23m3.842910831s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 22:48:41.883820508 (197h23m3.842917756s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 22:48:41.883824499 (197h23m3.842921747s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 22:48:41.975827358 (197h23m3.934924614s) [upload=205414]: Done uploading segments... Aug 16 22:48:41.975867347 (197h23m3.934964606s) [upload=205414]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.119979462s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......X.....................X.....X.........................] duration:
893.842991ms
FAIL (2025-08-16 23:06:48 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 22:48:41.883559329 (197h23m3.842656575s) [upload=205414]: Starting upload Aug 16 22:48:41.883616147 (197h23m3.842713394s) [upload=205414]: Done starting upload Aug 16 22:48:41.883698102 (197h23m3.842795348s) [upload=205414]: Uploading segments... Aug 16 22:48:41.883755229 (197h23m3.842853797s) [upload=205414]: Got next segment. Inline: true Aug 16 22:48:41.883763436 (197h23m3.842860682s) [upload=205414]: Waiting for error group managing segments... Aug 16 22:48:41.883813582 (197h23m3.842910831s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 22:48:41.883820508 (197h23m3.842917756s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 22:48:41.883824499 (197h23m3.842921747s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 22:48:41.975827358 (197h23m3.934924614s) [upload=205414]: Done uploading segments... Aug 16 22:48:41.975867347 (197h23m3.934964606s) [upload=205414]: Upload finished. err: metaclient: Too Many Requests
Duration: 893.870235ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
4.005718764s
FAIL (2025-08-16 23:06:30 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 791528b4431efbda984ff105020a1fa3d2f607da7e832f9772a2edd3a26490b0 != before 620c0ab2bcf8776c74e0f2a9a3fd8e53be0a8b505a80ecd7e638870652f42aca
======LOGS======
Aug 16 22:49:30.196418476 (197h23m52.155515707s) [upload=205427]: Starting upload
Aug 16 22:49:30.196474919 (197h23m52.155572164s) [upload=205427]: Done starting upload
Aug 16 22:49:30.196565257 (197h23m52.155662507s) [upload=205427]: Uploading segments...
Aug 16 22:49:30.196743883 (197h23m52.155841115s) [upload=205427]: Got next segment. Inline: false
Aug 16 22:49:30.196780331 (197h23m52.155877577s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 22:49:30.196785188 (197h23m52.155882433s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 22:49:30.483512934 (197h23m52.4426102s) [seg_pos={0 0}, upload=205427]: Begin upload segment...
Aug 16 22:49:30.483571578 (197h23m52.442668816s) [seg_pos={0 0}, upload=205427]: Done begin upload segment.
Aug 16 22:49:30.483607605 (197h23m52.44270485s) [noise=true , address=77.90.31.10:4525 , piece_id=EBOKK6AGP3TNV7DP4L3PIJTUDC4M74EOKLH6IBDBMN7IPR5Q3DOQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.484090730 (197h23m52.443187982s) [noise=true , address=104.36.82.18:4392 , piece_id=DUJGW7SOHIZ6SL36R24TZXK3WWT7FJ5U2IYR6U4LT4BYOCLHSDYA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.484459664 (197h23m52.443556918s) [noise=true , address=104.36.82.47:4540 , piece_id=IBPRQX4YHFT3RTB72A5KAWQLSCBHVA6BDN7POOQSZTADZSKX6XAQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485065081 (197h23m52.444162336s) [noise=true , address=104.36.82.38:4692 , piece_id=LXH2ORVEJ5Q24P3YY5VE4EFWLAYQS7LVCSJ6UWOV2TEEDYLOEXXQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485525349 (197h23m52.4446226s) [noise=true , address=104.36.82.16:4308 , piece_id=YUKJ2DOGYXBLFSRUJGDBT6CXTOOETTPNDBFPZUW5E6SEAXQMBAIA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485891474 (197h23m52.444988729s) [noise=true , address=104.36.82.10:4097 , piece_id=GUUN4DD7JPUSO6UVSTQ2QKB2DOES63VXMTI4BLNBJAEQ35AFA47Q, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486268568 (197h23m52.445365815s) [noise=true , address=104.36.82.20:4463 , piece_id=RYRSSCTL3N4GJYTB7MNMI4PKWR7RXLDZ2YVIXY3ERLCXLKEEP4TQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486639528 (197h23m52.445736776s) [noise=true , address=104.36.82.56:4248 , piece_id=TOBE3EZABNRXOGLO3BJ3O4QCWJK4JHS2KYUWYZW6FPFY4TZHPYFA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486976423 (197h23m52.446073669s) [noise=true , address=104.36.82.60:4353 , piece_id=PKRQ3UTWWSP6K4D6VBTXMKOJWRMRLX27PVE7MXOC7YIJFHDU5OBA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487317315 (197h23m52.446414561s) [noise=true , address=104.36.82.14:4241 , piece_id=YZWFVMVW4RIJL5JUUXOG25ZYQUZZZ3P6FZQ6AFBTRZFI74OBJ2FQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487612071 (197h23m52.446709316s) [noise=true , address=77.90.31.12:4602 , piece_id=OH27WBAU3Z5RZA423JF2DWPZ5CIFRZZDW2CQFA3UB27YMKHKAMHA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487947801 (197h23m52.447045053s) [noise=true , address=77.90.31.18:4829 , piece_id=SVYXJGIM6K5KO74OELO7YINLHRXUTPHS6RUUGGYJT7PN2IVWUV7A, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.488287344 (197h23m52.4473846s) [noise=true , address=104.36.82.2:4756 , piece_id=XHJLCWAJJ7BMONKDD5O55EJZSOJY4SE2JIXEMW7BMF5VKLIY4ZMA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.488683382 (197h23m52.447780635s) [noise=true , address=45.91.116.12:4253 , piece_id=I5KOLUJN6IOTYWPAVCYXZCXABR36WIQDVG35TDEFMWPSCYS2FNAA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489152324 (197h23m52.448249578s) [noise=true , address=104.36.82.23:4469 , piece_id=JH44FO3YNQALB6M5PRITANN5HRMNVM4RY5BOXM5OFYI35FV3LOWA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489533496 (197h23m52.448630753s) [noise=true , address=104.36.82.9:4016 , piece_id=HTRAGHQC26JUSNWBAE4MUGJ7GGD7NDR7H5S6KQ2OVC63GZLYUVYQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489992155 (197h23m52.449089406s) [noise=true , address=77.90.31.15:4728 , piece_id=RNCMK7HNBHWDD7OUQHGLPXDA4AL5IKUIFS7JBMMUJ3MNBKRJXWFA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.490332655 (197h23m52.44942991s) [noise=true , address=45.91.116.13:4161 , piece_id=5SE7HKY7PG2AXVK2PSICMLP3ZNQWUDCNTISZKL7A7MGEIZFICMGQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:31.070138080 (197h23m53.029235317s) [upload=205427]: Next returned nil segment
Aug 16 22:49:31.070156240 (197h23m53.029253485s) [upload=205427]: Waiting for error group managing segments...
Aug 16 22:49:31.244750684 (197h23m53.203847918s) [noise=true , address=104.36.82.20:4463 , piece_id=RYRSSCTL3N4GJYTB7MNMI4PKWR7RXLDZ2YVIXY3ERLCXLKEEP4TQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.273373250 (197h23m53.232470481s) [noise=true , address=104.36.82.2:4756 , piece_id=XHJLCWAJJ7BMONKDD5O55EJZSOJY4SE2JIXEMW7BMF5VKLIY4ZMA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.293132979 (197h23m53.252230244s) [noise=true , address=104.36.82.18:4392 , piece_id=DUJGW7SOHIZ6SL36R24TZXK3WWT7FJ5U2IYR6U4LT4BYOCLHSDYA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.318430962 (197h23m53.277528202s) [noise=true , address=104.36.82.60:4353 , piece_id=PKRQ3UTWWSP6K4D6VBTXMKOJWRMRLX27PVE7MXOC7YIJFHDU5OBA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.327035473 (197h23m53.286132717s) [noise=true , address=104.36.82.38:4692 , piece_id=LXH2ORVEJ5Q24P3YY5VE4EFWLAYQS7LVCSJ6UWOV2TEEDYLOEXXQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.338269683 (197h23m53.297366924s) [noise=true , address=45.91.116.13:4161 , piece_id=5SE7HKY7PG2AXVK2PSICMLP3ZNQWUDCNTISZKL7A7MGEIZFICMGQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.352408856 (197h23m53.311506088s) [noise=true , address=45.91.116.12:4253 , piece_id=I5KOLUJN6IOTYWPAVCYXZCXABR36WIQDVG35TDEFMWPSCYS2FNAA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.355334738 (197h23m53.314431976s) [noise=true , address=104.36.82.9:4016 , piece_id=HTRAGHQC26JUSNWBAE4MUGJ7GGD7NDR7H5S6KQ2OVC63GZLYUVYQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.408794808 (197h23m53.367892046s) [noise=true , address=77.90.31.18:4829 , piece_id=SVYXJGIM6K5KO74OELO7YINLHRXUTPHS6RUUGGYJT7PN2IVWUV7A, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.417776712 (197h23m53.376873947s) [noise=true , address=104.36.82.10:4097 , piece_id=GUUN4DD7JPUSO6UVSTQ2QKB2DOES63VXMTI4BLNBJAEQ35AFA47Q, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.430486727 (197h23m53.389583966s) [noise=true , address=77.90.31.15:4728 , piece_id=RNCMK7HNBHWDD7OUQHGLPXDA4AL5IKUIFS7JBMMUJ3MNBKRJXWFA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.489232668 (197h23m53.448329901s) [noise=true , address=104.36.82.16:4308 , piece_id=YUKJ2DOGYXBLFSRUJGDBT6CXTOOETTPNDBFPZUW5E6SEAXQMBAIA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.517002522 (197h23m53.476099767s) [noise=true , address=77.90.31.10:4525 , piece_id=EBOKK6AGP3TNV7DP4L3PIJTUDC4M74EOKLH6IBDBMN7IPR5Q3DOQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.627435127 (197h23m53.586532366s) [noise=true , address=104.36.82.56:4248 , piece_id=TOBE3EZABNRXOGLO3BJ3O4QCWJK4JHS2KYUWYZW6FPFY4TZHPYFA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.627456570 (197h23m53.586553809s) [seg_pos={0 0}, upload=205427]: Segment reached optimal threshold of 14 pieces.
Aug 16 22:49:31.627776426 (197h23m53.586873662s) [noise=true , address=104.36.82.14:4241 , piece_id=YZWFVMVW4RIJL5JUUXOG25ZYQUZZZ3P6FZQ6AFBTRZFI74OBJ2FQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aBy6nQScbjzmBSScfEZwTX8NCcP9c71FRQkUH54WvZhhhtXLR): protocol: expected piece hash; context canceled; EOF
Aug 16 22:49:31.627888126 (197h23m53.586985372s) [noise=true , address=77.90.31.12:4602 , piece_id=OH27WBAU3Z5RZA423JF2DWPZ5CIFRZZDW2CQFA3UB27YMKHKAMHA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf): protocol: expected piece hash; context canceled; EOF
Aug 16 22:49:31.628056687 (197h23m53.587153927s) [noise=true , address=104.36.82.23:4469 , piece_id=JH44FO3YNQALB6M5PRITANN5HRMNVM4RY5BOXM5OFYI35FV3LOWA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection; write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection
Aug 16 22:49:31.628079091 (197h23m53.587176328s) [noise=true , address=104.36.82.47:4540 , piece_id=IBPRQX4YHFT3RTB72A5KAWQLSCBHVA6BDN7POOQSZTADZSKX6XAQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection; write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection
Aug 16 22:49:31.628099133 (197h23m53.587196369s) [seg_pos={0 0}, upload=205427]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 22:49:31.628179292 (197h23m53.587276537s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 22:49:31.628195384 (197h23m53.58729263s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 22:49:31.871260215 (197h23m53.830357485s) [upload=205427]: Done uploading segments...
Aug 16 22:49:31.871286118 (197h23m53.830383351s) [upload=205427]: Upload finished. err: <nil>
Duration: 4.005756351s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......X.....................X.....X........................] duration:
845.633735ms
FAIL (2025-08-16 23:06:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 22:48:41.883559329 (197h23m3.842656575s) [upload=205414]: Starting upload Aug 16 22:48:41.883616147 (197h23m3.842713394s) [upload=205414]: Done starting upload Aug 16 22:48:41.883698102 (197h23m3.842795348s) [upload=205414]: Uploading segments... Aug 16 22:48:41.883755229 (197h23m3.842853797s) [upload=205414]: Got next segment. Inline: true Aug 16 22:48:41.883763436 (197h23m3.842860682s) [upload=205414]: Waiting for error group managing segments... Aug 16 22:48:41.883813582 (197h23m3.842910831s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 22:48:41.883820508 (197h23m3.842917756s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 22:48:41.883824499 (197h23m3.842921747s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 22:48:41.975827358 (197h23m3.934924614s) [upload=205414]: Done uploading segments... Aug 16 22:48:41.975867347 (197h23m3.934964606s) [upload=205414]: Upload finished. err: metaclient: Too Many Requests
Duration: 845.662933ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
2.655388848s
FAIL (2025-08-16 23:05:23 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 791528b4431efbda984ff105020a1fa3d2f607da7e832f9772a2edd3a26490b0 != before 620c0ab2bcf8776c74e0f2a9a3fd8e53be0a8b505a80ecd7e638870652f42aca
======LOGS======
Aug 16 22:49:30.196418476 (197h23m52.155515707s) [upload=205427]: Starting upload
Aug 16 22:49:30.196474919 (197h23m52.155572164s) [upload=205427]: Done starting upload
Aug 16 22:49:30.196565257 (197h23m52.155662507s) [upload=205427]: Uploading segments...
Aug 16 22:49:30.196743883 (197h23m52.155841115s) [upload=205427]: Got next segment. Inline: false
Aug 16 22:49:30.196780331 (197h23m52.155877577s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 22:49:30.196785188 (197h23m52.155882433s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 22:49:30.483512934 (197h23m52.4426102s) [seg_pos={0 0}, upload=205427]: Begin upload segment...
Aug 16 22:49:30.483571578 (197h23m52.442668816s) [seg_pos={0 0}, upload=205427]: Done begin upload segment.
Aug 16 22:49:30.483607605 (197h23m52.44270485s) [noise=true , address=77.90.31.10:4525 , piece_id=EBOKK6AGP3TNV7DP4L3PIJTUDC4M74EOKLH6IBDBMN7IPR5Q3DOQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.484090730 (197h23m52.443187982s) [noise=true , address=104.36.82.18:4392 , piece_id=DUJGW7SOHIZ6SL36R24TZXK3WWT7FJ5U2IYR6U4LT4BYOCLHSDYA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.484459664 (197h23m52.443556918s) [noise=true , address=104.36.82.47:4540 , piece_id=IBPRQX4YHFT3RTB72A5KAWQLSCBHVA6BDN7POOQSZTADZSKX6XAQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485065081 (197h23m52.444162336s) [noise=true , address=104.36.82.38:4692 , piece_id=LXH2ORVEJ5Q24P3YY5VE4EFWLAYQS7LVCSJ6UWOV2TEEDYLOEXXQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485525349 (197h23m52.4446226s) [noise=true , address=104.36.82.16:4308 , piece_id=YUKJ2DOGYXBLFSRUJGDBT6CXTOOETTPNDBFPZUW5E6SEAXQMBAIA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485891474 (197h23m52.444988729s) [noise=true , address=104.36.82.10:4097 , piece_id=GUUN4DD7JPUSO6UVSTQ2QKB2DOES63VXMTI4BLNBJAEQ35AFA47Q, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486268568 (197h23m52.445365815s) [noise=true , address=104.36.82.20:4463 , piece_id=RYRSSCTL3N4GJYTB7MNMI4PKWR7RXLDZ2YVIXY3ERLCXLKEEP4TQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486639528 (197h23m52.445736776s) [noise=true , address=104.36.82.56:4248 , piece_id=TOBE3EZABNRXOGLO3BJ3O4QCWJK4JHS2KYUWYZW6FPFY4TZHPYFA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486976423 (197h23m52.446073669s) [noise=true , address=104.36.82.60:4353 , piece_id=PKRQ3UTWWSP6K4D6VBTXMKOJWRMRLX27PVE7MXOC7YIJFHDU5OBA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487317315 (197h23m52.446414561s) [noise=true , address=104.36.82.14:4241 , piece_id=YZWFVMVW4RIJL5JUUXOG25ZYQUZZZ3P6FZQ6AFBTRZFI74OBJ2FQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487612071 (197h23m52.446709316s) [noise=true , address=77.90.31.12:4602 , piece_id=OH27WBAU3Z5RZA423JF2DWPZ5CIFRZZDW2CQFA3UB27YMKHKAMHA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487947801 (197h23m52.447045053s) [noise=true , address=77.90.31.18:4829 , piece_id=SVYXJGIM6K5KO74OELO7YINLHRXUTPHS6RUUGGYJT7PN2IVWUV7A, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.488287344 (197h23m52.4473846s) [noise=true , address=104.36.82.2:4756 , piece_id=XHJLCWAJJ7BMONKDD5O55EJZSOJY4SE2JIXEMW7BMF5VKLIY4ZMA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.488683382 (197h23m52.447780635s) [noise=true , address=45.91.116.12:4253 , piece_id=I5KOLUJN6IOTYWPAVCYXZCXABR36WIQDVG35TDEFMWPSCYS2FNAA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489152324 (197h23m52.448249578s) [noise=true , address=104.36.82.23:4469 , piece_id=JH44FO3YNQALB6M5PRITANN5HRMNVM4RY5BOXM5OFYI35FV3LOWA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489533496 (197h23m52.448630753s) [noise=true , address=104.36.82.9:4016 , piece_id=HTRAGHQC26JUSNWBAE4MUGJ7GGD7NDR7H5S6KQ2OVC63GZLYUVYQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489992155 (197h23m52.449089406s) [noise=true , address=77.90.31.15:4728 , piece_id=RNCMK7HNBHWDD7OUQHGLPXDA4AL5IKUIFS7JBMMUJ3MNBKRJXWFA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.490332655 (197h23m52.44942991s) [noise=true , address=45.91.116.13:4161 , piece_id=5SE7HKY7PG2AXVK2PSICMLP3ZNQWUDCNTISZKL7A7MGEIZFICMGQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:31.070138080 (197h23m53.029235317s) [upload=205427]: Next returned nil segment
Aug 16 22:49:31.070156240 (197h23m53.029253485s) [upload=205427]: Waiting for error group managing segments...
Aug 16 22:49:31.244750684 (197h23m53.203847918s) [noise=true , address=104.36.82.20:4463 , piece_id=RYRSSCTL3N4GJYTB7MNMI4PKWR7RXLDZ2YVIXY3ERLCXLKEEP4TQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.273373250 (197h23m53.232470481s) [noise=true , address=104.36.82.2:4756 , piece_id=XHJLCWAJJ7BMONKDD5O55EJZSOJY4SE2JIXEMW7BMF5VKLIY4ZMA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.293132979 (197h23m53.252230244s) [noise=true , address=104.36.82.18:4392 , piece_id=DUJGW7SOHIZ6SL36R24TZXK3WWT7FJ5U2IYR6U4LT4BYOCLHSDYA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.318430962 (197h23m53.277528202s) [noise=true , address=104.36.82.60:4353 , piece_id=PKRQ3UTWWSP6K4D6VBTXMKOJWRMRLX27PVE7MXOC7YIJFHDU5OBA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.327035473 (197h23m53.286132717s) [noise=true , address=104.36.82.38:4692 , piece_id=LXH2ORVEJ5Q24P3YY5VE4EFWLAYQS7LVCSJ6UWOV2TEEDYLOEXXQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.338269683 (197h23m53.297366924s) [noise=true , address=45.91.116.13:4161 , piece_id=5SE7HKY7PG2AXVK2PSICMLP3ZNQWUDCNTISZKL7A7MGEIZFICMGQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.352408856 (197h23m53.311506088s) [noise=true , address=45.91.116.12:4253 , piece_id=I5KOLUJN6IOTYWPAVCYXZCXABR36WIQDVG35TDEFMWPSCYS2FNAA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.355334738 (197h23m53.314431976s) [noise=true , address=104.36.82.9:4016 , piece_id=HTRAGHQC26JUSNWBAE4MUGJ7GGD7NDR7H5S6KQ2OVC63GZLYUVYQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.408794808 (197h23m53.367892046s) [noise=true , address=77.90.31.18:4829 , piece_id=SVYXJGIM6K5KO74OELO7YINLHRXUTPHS6RUUGGYJT7PN2IVWUV7A, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.417776712 (197h23m53.376873947s) [noise=true , address=104.36.82.10:4097 , piece_id=GUUN4DD7JPUSO6UVSTQ2QKB2DOES63VXMTI4BLNBJAEQ35AFA47Q, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.430486727 (197h23m53.389583966s) [noise=true , address=77.90.31.15:4728 , piece_id=RNCMK7HNBHWDD7OUQHGLPXDA4AL5IKUIFS7JBMMUJ3MNBKRJXWFA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.489232668 (197h23m53.448329901s) [noise=true , address=104.36.82.16:4308 , piece_id=YUKJ2DOGYXBLFSRUJGDBT6CXTOOETTPNDBFPZUW5E6SEAXQMBAIA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.517002522 (197h23m53.476099767s) [noise=true , address=77.90.31.10:4525 , piece_id=EBOKK6AGP3TNV7DP4L3PIJTUDC4M74EOKLH6IBDBMN7IPR5Q3DOQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.627435127 (197h23m53.586532366s) [noise=true , address=104.36.82.56:4248 , piece_id=TOBE3EZABNRXOGLO3BJ3O4QCWJK4JHS2KYUWYZW6FPFY4TZHPYFA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.627456570 (197h23m53.586553809s) [seg_pos={0 0}, upload=205427]: Segment reached optimal threshold of 14 pieces.
Aug 16 22:49:31.627776426 (197h23m53.586873662s) [noise=true , address=104.36.82.14:4241 , piece_id=YZWFVMVW4RIJL5JUUXOG25ZYQUZZZ3P6FZQ6AFBTRZFI74OBJ2FQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aBy6nQScbjzmBSScfEZwTX8NCcP9c71FRQkUH54WvZhhhtXLR): protocol: expected piece hash; context canceled; EOF
Aug 16 22:49:31.627888126 (197h23m53.586985372s) [noise=true , address=77.90.31.12:4602 , piece_id=OH27WBAU3Z5RZA423JF2DWPZ5CIFRZZDW2CQFA3UB27YMKHKAMHA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf): protocol: expected piece hash; context canceled; EOF
Aug 16 22:49:31.628056687 (197h23m53.587153927s) [noise=true , address=104.36.82.23:4469 , piece_id=JH44FO3YNQALB6M5PRITANN5HRMNVM4RY5BOXM5OFYI35FV3LOWA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection; write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection
Aug 16 22:49:31.628079091 (197h23m53.587176328s) [noise=true , address=104.36.82.47:4540 , piece_id=IBPRQX4YHFT3RTB72A5KAWQLSCBHVA6BDN7POOQSZTADZSKX6XAQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection; write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection
Aug 16 22:49:31.628099133 (197h23m53.587196369s) [seg_pos={0 0}, upload=205427]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 22:49:31.628179292 (197h23m53.587276537s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 22:49:31.628195384 (197h23m53.58729263s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 22:49:31.871260215 (197h23m53.830357485s) [upload=205427]: Done uploading segments...
Aug 16 22:49:31.871286118 (197h23m53.830383351s) [upload=205427]: Upload finished. err: <nil>
Duration: 2.655420339s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........X.....................X.....X.......................] duration:
924.797546ms
FAIL (2025-08-16 23:05:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 22:48:41.883559329 (197h23m3.842656575s) [upload=205414]: Starting upload Aug 16 22:48:41.883616147 (197h23m3.842713394s) [upload=205414]: Done starting upload Aug 16 22:48:41.883698102 (197h23m3.842795348s) [upload=205414]: Uploading segments... Aug 16 22:48:41.883755229 (197h23m3.842853797s) [upload=205414]: Got next segment. Inline: true Aug 16 22:48:41.883763436 (197h23m3.842860682s) [upload=205414]: Waiting for error group managing segments... Aug 16 22:48:41.883813582 (197h23m3.842910831s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 22:48:41.883820508 (197h23m3.842917756s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 22:48:41.883824499 (197h23m3.842921747s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 22:48:41.975827358 (197h23m3.934924614s) [upload=205414]: Done uploading segments... Aug 16 22:48:41.975867347 (197h23m3.934964606s) [upload=205414]: Upload finished. err: metaclient: Too Many Requests
Duration: 924.831595ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X.....................X.....X......................] duration:
1.040861042s
FAIL (2025-08-16 23:04:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 22:48:41.883559329 (197h23m3.842656575s) [upload=205414]: Starting upload Aug 16 22:48:41.883616147 (197h23m3.842713394s) [upload=205414]: Done starting upload Aug 16 22:48:41.883698102 (197h23m3.842795348s) [upload=205414]: Uploading segments... Aug 16 22:48:41.883755229 (197h23m3.842853797s) [upload=205414]: Got next segment. Inline: true Aug 16 22:48:41.883763436 (197h23m3.842860682s) [upload=205414]: Waiting for error group managing segments... Aug 16 22:48:41.883813582 (197h23m3.842910831s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 22:48:41.883820508 (197h23m3.842917756s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 22:48:41.883824499 (197h23m3.842921747s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 22:48:41.975827358 (197h23m3.934924614s) [upload=205414]: Done uploading segments... Aug 16 22:48:41.975867347 (197h23m3.934964606s) [upload=205414]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.040892616s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
2.641284024s
FAIL (2025-08-16 23:04:29 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 791528b4431efbda984ff105020a1fa3d2f607da7e832f9772a2edd3a26490b0 != before 620c0ab2bcf8776c74e0f2a9a3fd8e53be0a8b505a80ecd7e638870652f42aca
======LOGS======
Aug 16 22:49:30.196418476 (197h23m52.155515707s) [upload=205427]: Starting upload
Aug 16 22:49:30.196474919 (197h23m52.155572164s) [upload=205427]: Done starting upload
Aug 16 22:49:30.196565257 (197h23m52.155662507s) [upload=205427]: Uploading segments...
Aug 16 22:49:30.196743883 (197h23m52.155841115s) [upload=205427]: Got next segment. Inline: false
Aug 16 22:49:30.196780331 (197h23m52.155877577s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 22:49:30.196785188 (197h23m52.155882433s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 22:49:30.483512934 (197h23m52.4426102s) [seg_pos={0 0}, upload=205427]: Begin upload segment...
Aug 16 22:49:30.483571578 (197h23m52.442668816s) [seg_pos={0 0}, upload=205427]: Done begin upload segment.
Aug 16 22:49:30.483607605 (197h23m52.44270485s) [noise=true , address=77.90.31.10:4525 , piece_id=EBOKK6AGP3TNV7DP4L3PIJTUDC4M74EOKLH6IBDBMN7IPR5Q3DOQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.484090730 (197h23m52.443187982s) [noise=true , address=104.36.82.18:4392 , piece_id=DUJGW7SOHIZ6SL36R24TZXK3WWT7FJ5U2IYR6U4LT4BYOCLHSDYA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.484459664 (197h23m52.443556918s) [noise=true , address=104.36.82.47:4540 , piece_id=IBPRQX4YHFT3RTB72A5KAWQLSCBHVA6BDN7POOQSZTADZSKX6XAQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485065081 (197h23m52.444162336s) [noise=true , address=104.36.82.38:4692 , piece_id=LXH2ORVEJ5Q24P3YY5VE4EFWLAYQS7LVCSJ6UWOV2TEEDYLOEXXQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485525349 (197h23m52.4446226s) [noise=true , address=104.36.82.16:4308 , piece_id=YUKJ2DOGYXBLFSRUJGDBT6CXTOOETTPNDBFPZUW5E6SEAXQMBAIA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485891474 (197h23m52.444988729s) [noise=true , address=104.36.82.10:4097 , piece_id=GUUN4DD7JPUSO6UVSTQ2QKB2DOES63VXMTI4BLNBJAEQ35AFA47Q, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486268568 (197h23m52.445365815s) [noise=true , address=104.36.82.20:4463 , piece_id=RYRSSCTL3N4GJYTB7MNMI4PKWR7RXLDZ2YVIXY3ERLCXLKEEP4TQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486639528 (197h23m52.445736776s) [noise=true , address=104.36.82.56:4248 , piece_id=TOBE3EZABNRXOGLO3BJ3O4QCWJK4JHS2KYUWYZW6FPFY4TZHPYFA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486976423 (197h23m52.446073669s) [noise=true , address=104.36.82.60:4353 , piece_id=PKRQ3UTWWSP6K4D6VBTXMKOJWRMRLX27PVE7MXOC7YIJFHDU5OBA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487317315 (197h23m52.446414561s) [noise=true , address=104.36.82.14:4241 , piece_id=YZWFVMVW4RIJL5JUUXOG25ZYQUZZZ3P6FZQ6AFBTRZFI74OBJ2FQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487612071 (197h23m52.446709316s) [noise=true , address=77.90.31.12:4602 , piece_id=OH27WBAU3Z5RZA423JF2DWPZ5CIFRZZDW2CQFA3UB27YMKHKAMHA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487947801 (197h23m52.447045053s) [noise=true , address=77.90.31.18:4829 , piece_id=SVYXJGIM6K5KO74OELO7YINLHRXUTPHS6RUUGGYJT7PN2IVWUV7A, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.488287344 (197h23m52.4473846s) [noise=true , address=104.36.82.2:4756 , piece_id=XHJLCWAJJ7BMONKDD5O55EJZSOJY4SE2JIXEMW7BMF5VKLIY4ZMA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.488683382 (197h23m52.447780635s) [noise=true , address=45.91.116.12:4253 , piece_id=I5KOLUJN6IOTYWPAVCYXZCXABR36WIQDVG35TDEFMWPSCYS2FNAA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489152324 (197h23m52.448249578s) [noise=true , address=104.36.82.23:4469 , piece_id=JH44FO3YNQALB6M5PRITANN5HRMNVM4RY5BOXM5OFYI35FV3LOWA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489533496 (197h23m52.448630753s) [noise=true , address=104.36.82.9:4016 , piece_id=HTRAGHQC26JUSNWBAE4MUGJ7GGD7NDR7H5S6KQ2OVC63GZLYUVYQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489992155 (197h23m52.449089406s) [noise=true , address=77.90.31.15:4728 , piece_id=RNCMK7HNBHWDD7OUQHGLPXDA4AL5IKUIFS7JBMMUJ3MNBKRJXWFA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.490332655 (197h23m52.44942991s) [noise=true , address=45.91.116.13:4161 , piece_id=5SE7HKY7PG2AXVK2PSICMLP3ZNQWUDCNTISZKL7A7MGEIZFICMGQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:31.070138080 (197h23m53.029235317s) [upload=205427]: Next returned nil segment
Aug 16 22:49:31.070156240 (197h23m53.029253485s) [upload=205427]: Waiting for error group managing segments...
Aug 16 22:49:31.244750684 (197h23m53.203847918s) [noise=true , address=104.36.82.20:4463 , piece_id=RYRSSCTL3N4GJYTB7MNMI4PKWR7RXLDZ2YVIXY3ERLCXLKEEP4TQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.273373250 (197h23m53.232470481s) [noise=true , address=104.36.82.2:4756 , piece_id=XHJLCWAJJ7BMONKDD5O55EJZSOJY4SE2JIXEMW7BMF5VKLIY4ZMA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.293132979 (197h23m53.252230244s) [noise=true , address=104.36.82.18:4392 , piece_id=DUJGW7SOHIZ6SL36R24TZXK3WWT7FJ5U2IYR6U4LT4BYOCLHSDYA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.318430962 (197h23m53.277528202s) [noise=true , address=104.36.82.60:4353 , piece_id=PKRQ3UTWWSP6K4D6VBTXMKOJWRMRLX27PVE7MXOC7YIJFHDU5OBA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.327035473 (197h23m53.286132717s) [noise=true , address=104.36.82.38:4692 , piece_id=LXH2ORVEJ5Q24P3YY5VE4EFWLAYQS7LVCSJ6UWOV2TEEDYLOEXXQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.338269683 (197h23m53.297366924s) [noise=true , address=45.91.116.13:4161 , piece_id=5SE7HKY7PG2AXVK2PSICMLP3ZNQWUDCNTISZKL7A7MGEIZFICMGQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.352408856 (197h23m53.311506088s) [noise=true , address=45.91.116.12:4253 , piece_id=I5KOLUJN6IOTYWPAVCYXZCXABR36WIQDVG35TDEFMWPSCYS2FNAA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.355334738 (197h23m53.314431976s) [noise=true , address=104.36.82.9:4016 , piece_id=HTRAGHQC26JUSNWBAE4MUGJ7GGD7NDR7H5S6KQ2OVC63GZLYUVYQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.408794808 (197h23m53.367892046s) [noise=true , address=77.90.31.18:4829 , piece_id=SVYXJGIM6K5KO74OELO7YINLHRXUTPHS6RUUGGYJT7PN2IVWUV7A, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.417776712 (197h23m53.376873947s) [noise=true , address=104.36.82.10:4097 , piece_id=GUUN4DD7JPUSO6UVSTQ2QKB2DOES63VXMTI4BLNBJAEQ35AFA47Q, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.430486727 (197h23m53.389583966s) [noise=true , address=77.90.31.15:4728 , piece_id=RNCMK7HNBHWDD7OUQHGLPXDA4AL5IKUIFS7JBMMUJ3MNBKRJXWFA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.489232668 (197h23m53.448329901s) [noise=true , address=104.36.82.16:4308 , piece_id=YUKJ2DOGYXBLFSRUJGDBT6CXTOOETTPNDBFPZUW5E6SEAXQMBAIA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.517002522 (197h23m53.476099767s) [noise=true , address=77.90.31.10:4525 , piece_id=EBOKK6AGP3TNV7DP4L3PIJTUDC4M74EOKLH6IBDBMN7IPR5Q3DOQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.627435127 (197h23m53.586532366s) [noise=true , address=104.36.82.56:4248 , piece_id=TOBE3EZABNRXOGLO3BJ3O4QCWJK4JHS2KYUWYZW6FPFY4TZHPYFA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.627456570 (197h23m53.586553809s) [seg_pos={0 0}, upload=205427]: Segment reached optimal threshold of 14 pieces.
Aug 16 22:49:31.627776426 (197h23m53.586873662s) [noise=true , address=104.36.82.14:4241 , piece_id=YZWFVMVW4RIJL5JUUXOG25ZYQUZZZ3P6FZQ6AFBTRZFI74OBJ2FQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aBy6nQScbjzmBSScfEZwTX8NCcP9c71FRQkUH54WvZhhhtXLR): protocol: expected piece hash; context canceled; EOF
Aug 16 22:49:31.627888126 (197h23m53.586985372s) [noise=true , address=77.90.31.12:4602 , piece_id=OH27WBAU3Z5RZA423JF2DWPZ5CIFRZZDW2CQFA3UB27YMKHKAMHA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf): protocol: expected piece hash; context canceled; EOF
Aug 16 22:49:31.628056687 (197h23m53.587153927s) [noise=true , address=104.36.82.23:4469 , piece_id=JH44FO3YNQALB6M5PRITANN5HRMNVM4RY5BOXM5OFYI35FV3LOWA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection; write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection
Aug 16 22:49:31.628079091 (197h23m53.587176328s) [noise=true , address=104.36.82.47:4540 , piece_id=IBPRQX4YHFT3RTB72A5KAWQLSCBHVA6BDN7POOQSZTADZSKX6XAQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection; write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection
Aug 16 22:49:31.628099133 (197h23m53.587196369s) [seg_pos={0 0}, upload=205427]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 22:49:31.628179292 (197h23m53.587276537s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 22:49:31.628195384 (197h23m53.58729263s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 22:49:31.871260215 (197h23m53.830357485s) [upload=205427]: Done uploading segments...
Aug 16 22:49:31.871286118 (197h23m53.830383351s) [upload=205427]: Upload finished. err: <nil>
Duration: 2.64132522s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........X.....................X.....X.....................] duration:
1.218000393s
FAIL (2025-08-16 23:04:06 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 22:48:41.883559329 (197h23m3.842656575s) [upload=205414]: Starting upload Aug 16 22:48:41.883616147 (197h23m3.842713394s) [upload=205414]: Done starting upload Aug 16 22:48:41.883698102 (197h23m3.842795348s) [upload=205414]: Uploading segments... Aug 16 22:48:41.883755229 (197h23m3.842853797s) [upload=205414]: Got next segment. Inline: true Aug 16 22:48:41.883763436 (197h23m3.842860682s) [upload=205414]: Waiting for error group managing segments... Aug 16 22:48:41.883813582 (197h23m3.842910831s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 22:48:41.883820508 (197h23m3.842917756s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 22:48:41.883824499 (197h23m3.842921747s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 22:48:41.975827358 (197h23m3.934924614s) [upload=205414]: Done uploading segments... Aug 16 22:48:41.975867347 (197h23m3.934964606s) [upload=205414]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.218044882s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
2.77179771s
FAIL (2025-08-16 23:03:29 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 791528b4431efbda984ff105020a1fa3d2f607da7e832f9772a2edd3a26490b0 != before 620c0ab2bcf8776c74e0f2a9a3fd8e53be0a8b505a80ecd7e638870652f42aca
======LOGS======
Aug 16 22:49:30.196418476 (197h23m52.155515707s) [upload=205427]: Starting upload
Aug 16 22:49:30.196474919 (197h23m52.155572164s) [upload=205427]: Done starting upload
Aug 16 22:49:30.196565257 (197h23m52.155662507s) [upload=205427]: Uploading segments...
Aug 16 22:49:30.196743883 (197h23m52.155841115s) [upload=205427]: Got next segment. Inline: false
Aug 16 22:49:30.196780331 (197h23m52.155877577s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 22:49:30.196785188 (197h23m52.155882433s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 22:49:30.483512934 (197h23m52.4426102s) [seg_pos={0 0}, upload=205427]: Begin upload segment...
Aug 16 22:49:30.483571578 (197h23m52.442668816s) [seg_pos={0 0}, upload=205427]: Done begin upload segment.
Aug 16 22:49:30.483607605 (197h23m52.44270485s) [noise=true , address=77.90.31.10:4525 , piece_id=EBOKK6AGP3TNV7DP4L3PIJTUDC4M74EOKLH6IBDBMN7IPR5Q3DOQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.484090730 (197h23m52.443187982s) [noise=true , address=104.36.82.18:4392 , piece_id=DUJGW7SOHIZ6SL36R24TZXK3WWT7FJ5U2IYR6U4LT4BYOCLHSDYA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.484459664 (197h23m52.443556918s) [noise=true , address=104.36.82.47:4540 , piece_id=IBPRQX4YHFT3RTB72A5KAWQLSCBHVA6BDN7POOQSZTADZSKX6XAQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485065081 (197h23m52.444162336s) [noise=true , address=104.36.82.38:4692 , piece_id=LXH2ORVEJ5Q24P3YY5VE4EFWLAYQS7LVCSJ6UWOV2TEEDYLOEXXQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485525349 (197h23m52.4446226s) [noise=true , address=104.36.82.16:4308 , piece_id=YUKJ2DOGYXBLFSRUJGDBT6CXTOOETTPNDBFPZUW5E6SEAXQMBAIA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485891474 (197h23m52.444988729s) [noise=true , address=104.36.82.10:4097 , piece_id=GUUN4DD7JPUSO6UVSTQ2QKB2DOES63VXMTI4BLNBJAEQ35AFA47Q, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486268568 (197h23m52.445365815s) [noise=true , address=104.36.82.20:4463 , piece_id=RYRSSCTL3N4GJYTB7MNMI4PKWR7RXLDZ2YVIXY3ERLCXLKEEP4TQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486639528 (197h23m52.445736776s) [noise=true , address=104.36.82.56:4248 , piece_id=TOBE3EZABNRXOGLO3BJ3O4QCWJK4JHS2KYUWYZW6FPFY4TZHPYFA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486976423 (197h23m52.446073669s) [noise=true , address=104.36.82.60:4353 , piece_id=PKRQ3UTWWSP6K4D6VBTXMKOJWRMRLX27PVE7MXOC7YIJFHDU5OBA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487317315 (197h23m52.446414561s) [noise=true , address=104.36.82.14:4241 , piece_id=YZWFVMVW4RIJL5JUUXOG25ZYQUZZZ3P6FZQ6AFBTRZFI74OBJ2FQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487612071 (197h23m52.446709316s) [noise=true , address=77.90.31.12:4602 , piece_id=OH27WBAU3Z5RZA423JF2DWPZ5CIFRZZDW2CQFA3UB27YMKHKAMHA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487947801 (197h23m52.447045053s) [noise=true , address=77.90.31.18:4829 , piece_id=SVYXJGIM6K5KO74OELO7YINLHRXUTPHS6RUUGGYJT7PN2IVWUV7A, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.488287344 (197h23m52.4473846s) [noise=true , address=104.36.82.2:4756 , piece_id=XHJLCWAJJ7BMONKDD5O55EJZSOJY4SE2JIXEMW7BMF5VKLIY4ZMA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.488683382 (197h23m52.447780635s) [noise=true , address=45.91.116.12:4253 , piece_id=I5KOLUJN6IOTYWPAVCYXZCXABR36WIQDVG35TDEFMWPSCYS2FNAA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489152324 (197h23m52.448249578s) [noise=true , address=104.36.82.23:4469 , piece_id=JH44FO3YNQALB6M5PRITANN5HRMNVM4RY5BOXM5OFYI35FV3LOWA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489533496 (197h23m52.448630753s) [noise=true , address=104.36.82.9:4016 , piece_id=HTRAGHQC26JUSNWBAE4MUGJ7GGD7NDR7H5S6KQ2OVC63GZLYUVYQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489992155 (197h23m52.449089406s) [noise=true , address=77.90.31.15:4728 , piece_id=RNCMK7HNBHWDD7OUQHGLPXDA4AL5IKUIFS7JBMMUJ3MNBKRJXWFA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.490332655 (197h23m52.44942991s) [noise=true , address=45.91.116.13:4161 , piece_id=5SE7HKY7PG2AXVK2PSICMLP3ZNQWUDCNTISZKL7A7MGEIZFICMGQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:31.070138080 (197h23m53.029235317s) [upload=205427]: Next returned nil segment
Aug 16 22:49:31.070156240 (197h23m53.029253485s) [upload=205427]: Waiting for error group managing segments...
Aug 16 22:49:31.244750684 (197h23m53.203847918s) [noise=true , address=104.36.82.20:4463 , piece_id=RYRSSCTL3N4GJYTB7MNMI4PKWR7RXLDZ2YVIXY3ERLCXLKEEP4TQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.273373250 (197h23m53.232470481s) [noise=true , address=104.36.82.2:4756 , piece_id=XHJLCWAJJ7BMONKDD5O55EJZSOJY4SE2JIXEMW7BMF5VKLIY4ZMA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.293132979 (197h23m53.252230244s) [noise=true , address=104.36.82.18:4392 , piece_id=DUJGW7SOHIZ6SL36R24TZXK3WWT7FJ5U2IYR6U4LT4BYOCLHSDYA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.318430962 (197h23m53.277528202s) [noise=true , address=104.36.82.60:4353 , piece_id=PKRQ3UTWWSP6K4D6VBTXMKOJWRMRLX27PVE7MXOC7YIJFHDU5OBA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.327035473 (197h23m53.286132717s) [noise=true , address=104.36.82.38:4692 , piece_id=LXH2ORVEJ5Q24P3YY5VE4EFWLAYQS7LVCSJ6UWOV2TEEDYLOEXXQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.338269683 (197h23m53.297366924s) [noise=true , address=45.91.116.13:4161 , piece_id=5SE7HKY7PG2AXVK2PSICMLP3ZNQWUDCNTISZKL7A7MGEIZFICMGQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.352408856 (197h23m53.311506088s) [noise=true , address=45.91.116.12:4253 , piece_id=I5KOLUJN6IOTYWPAVCYXZCXABR36WIQDVG35TDEFMWPSCYS2FNAA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.355334738 (197h23m53.314431976s) [noise=true , address=104.36.82.9:4016 , piece_id=HTRAGHQC26JUSNWBAE4MUGJ7GGD7NDR7H5S6KQ2OVC63GZLYUVYQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.408794808 (197h23m53.367892046s) [noise=true , address=77.90.31.18:4829 , piece_id=SVYXJGIM6K5KO74OELO7YINLHRXUTPHS6RUUGGYJT7PN2IVWUV7A, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.417776712 (197h23m53.376873947s) [noise=true , address=104.36.82.10:4097 , piece_id=GUUN4DD7JPUSO6UVSTQ2QKB2DOES63VXMTI4BLNBJAEQ35AFA47Q, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.430486727 (197h23m53.389583966s) [noise=true , address=77.90.31.15:4728 , piece_id=RNCMK7HNBHWDD7OUQHGLPXDA4AL5IKUIFS7JBMMUJ3MNBKRJXWFA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.489232668 (197h23m53.448329901s) [noise=true , address=104.36.82.16:4308 , piece_id=YUKJ2DOGYXBLFSRUJGDBT6CXTOOETTPNDBFPZUW5E6SEAXQMBAIA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.517002522 (197h23m53.476099767s) [noise=true , address=77.90.31.10:4525 , piece_id=EBOKK6AGP3TNV7DP4L3PIJTUDC4M74EOKLH6IBDBMN7IPR5Q3DOQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.627435127 (197h23m53.586532366s) [noise=true , address=104.36.82.56:4248 , piece_id=TOBE3EZABNRXOGLO3BJ3O4QCWJK4JHS2KYUWYZW6FPFY4TZHPYFA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.627456570 (197h23m53.586553809s) [seg_pos={0 0}, upload=205427]: Segment reached optimal threshold of 14 pieces.
Aug 16 22:49:31.627776426 (197h23m53.586873662s) [noise=true , address=104.36.82.14:4241 , piece_id=YZWFVMVW4RIJL5JUUXOG25ZYQUZZZ3P6FZQ6AFBTRZFI74OBJ2FQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aBy6nQScbjzmBSScfEZwTX8NCcP9c71FRQkUH54WvZhhhtXLR): protocol: expected piece hash; context canceled; EOF
Aug 16 22:49:31.627888126 (197h23m53.586985372s) [noise=true , address=77.90.31.12:4602 , piece_id=OH27WBAU3Z5RZA423JF2DWPZ5CIFRZZDW2CQFA3UB27YMKHKAMHA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf): protocol: expected piece hash; context canceled; EOF
Aug 16 22:49:31.628056687 (197h23m53.587153927s) [noise=true , address=104.36.82.23:4469 , piece_id=JH44FO3YNQALB6M5PRITANN5HRMNVM4RY5BOXM5OFYI35FV3LOWA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection; write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection
Aug 16 22:49:31.628079091 (197h23m53.587176328s) [noise=true , address=104.36.82.47:4540 , piece_id=IBPRQX4YHFT3RTB72A5KAWQLSCBHVA6BDN7POOQSZTADZSKX6XAQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection; write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection
Aug 16 22:49:31.628099133 (197h23m53.587196369s) [seg_pos={0 0}, upload=205427]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 22:49:31.628179292 (197h23m53.587276537s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 22:49:31.628195384 (197h23m53.58729263s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 22:49:31.871260215 (197h23m53.830357485s) [upload=205427]: Done uploading segments...
Aug 16 22:49:31.871286118 (197h23m53.830383351s) [upload=205427]: Upload finished. err: <nil>
Duration: 2.771831171s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
2.691926192s
FAIL (2025-08-16 23:03:13 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 791528b4431efbda984ff105020a1fa3d2f607da7e832f9772a2edd3a26490b0 != before 620c0ab2bcf8776c74e0f2a9a3fd8e53be0a8b505a80ecd7e638870652f42aca
======LOGS======
Aug 16 22:49:30.196418476 (197h23m52.155515707s) [upload=205427]: Starting upload
Aug 16 22:49:30.196474919 (197h23m52.155572164s) [upload=205427]: Done starting upload
Aug 16 22:49:30.196565257 (197h23m52.155662507s) [upload=205427]: Uploading segments...
Aug 16 22:49:30.196743883 (197h23m52.155841115s) [upload=205427]: Got next segment. Inline: false
Aug 16 22:49:30.196780331 (197h23m52.155877577s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 22:49:30.196785188 (197h23m52.155882433s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 22:49:30.483512934 (197h23m52.4426102s) [seg_pos={0 0}, upload=205427]: Begin upload segment...
Aug 16 22:49:30.483571578 (197h23m52.442668816s) [seg_pos={0 0}, upload=205427]: Done begin upload segment.
Aug 16 22:49:30.483607605 (197h23m52.44270485s) [noise=true , address=77.90.31.10:4525 , piece_id=EBOKK6AGP3TNV7DP4L3PIJTUDC4M74EOKLH6IBDBMN7IPR5Q3DOQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.484090730 (197h23m52.443187982s) [noise=true , address=104.36.82.18:4392 , piece_id=DUJGW7SOHIZ6SL36R24TZXK3WWT7FJ5U2IYR6U4LT4BYOCLHSDYA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.484459664 (197h23m52.443556918s) [noise=true , address=104.36.82.47:4540 , piece_id=IBPRQX4YHFT3RTB72A5KAWQLSCBHVA6BDN7POOQSZTADZSKX6XAQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485065081 (197h23m52.444162336s) [noise=true , address=104.36.82.38:4692 , piece_id=LXH2ORVEJ5Q24P3YY5VE4EFWLAYQS7LVCSJ6UWOV2TEEDYLOEXXQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485525349 (197h23m52.4446226s) [noise=true , address=104.36.82.16:4308 , piece_id=YUKJ2DOGYXBLFSRUJGDBT6CXTOOETTPNDBFPZUW5E6SEAXQMBAIA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485891474 (197h23m52.444988729s) [noise=true , address=104.36.82.10:4097 , piece_id=GUUN4DD7JPUSO6UVSTQ2QKB2DOES63VXMTI4BLNBJAEQ35AFA47Q, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486268568 (197h23m52.445365815s) [noise=true , address=104.36.82.20:4463 , piece_id=RYRSSCTL3N4GJYTB7MNMI4PKWR7RXLDZ2YVIXY3ERLCXLKEEP4TQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486639528 (197h23m52.445736776s) [noise=true , address=104.36.82.56:4248 , piece_id=TOBE3EZABNRXOGLO3BJ3O4QCWJK4JHS2KYUWYZW6FPFY4TZHPYFA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486976423 (197h23m52.446073669s) [noise=true , address=104.36.82.60:4353 , piece_id=PKRQ3UTWWSP6K4D6VBTXMKOJWRMRLX27PVE7MXOC7YIJFHDU5OBA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487317315 (197h23m52.446414561s) [noise=true , address=104.36.82.14:4241 , piece_id=YZWFVMVW4RIJL5JUUXOG25ZYQUZZZ3P6FZQ6AFBTRZFI74OBJ2FQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487612071 (197h23m52.446709316s) [noise=true , address=77.90.31.12:4602 , piece_id=OH27WBAU3Z5RZA423JF2DWPZ5CIFRZZDW2CQFA3UB27YMKHKAMHA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487947801 (197h23m52.447045053s) [noise=true , address=77.90.31.18:4829 , piece_id=SVYXJGIM6K5KO74OELO7YINLHRXUTPHS6RUUGGYJT7PN2IVWUV7A, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.488287344 (197h23m52.4473846s) [noise=true , address=104.36.82.2:4756 , piece_id=XHJLCWAJJ7BMONKDD5O55EJZSOJY4SE2JIXEMW7BMF5VKLIY4ZMA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.488683382 (197h23m52.447780635s) [noise=true , address=45.91.116.12:4253 , piece_id=I5KOLUJN6IOTYWPAVCYXZCXABR36WIQDVG35TDEFMWPSCYS2FNAA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489152324 (197h23m52.448249578s) [noise=true , address=104.36.82.23:4469 , piece_id=JH44FO3YNQALB6M5PRITANN5HRMNVM4RY5BOXM5OFYI35FV3LOWA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489533496 (197h23m52.448630753s) [noise=true , address=104.36.82.9:4016 , piece_id=HTRAGHQC26JUSNWBAE4MUGJ7GGD7NDR7H5S6KQ2OVC63GZLYUVYQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489992155 (197h23m52.449089406s) [noise=true , address=77.90.31.15:4728 , piece_id=RNCMK7HNBHWDD7OUQHGLPXDA4AL5IKUIFS7JBMMUJ3MNBKRJXWFA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.490332655 (197h23m52.44942991s) [noise=true , address=45.91.116.13:4161 , piece_id=5SE7HKY7PG2AXVK2PSICMLP3ZNQWUDCNTISZKL7A7MGEIZFICMGQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:31.070138080 (197h23m53.029235317s) [upload=205427]: Next returned nil segment
Aug 16 22:49:31.070156240 (197h23m53.029253485s) [upload=205427]: Waiting for error group managing segments...
Aug 16 22:49:31.244750684 (197h23m53.203847918s) [noise=true , address=104.36.82.20:4463 , piece_id=RYRSSCTL3N4GJYTB7MNMI4PKWR7RXLDZ2YVIXY3ERLCXLKEEP4TQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.273373250 (197h23m53.232470481s) [noise=true , address=104.36.82.2:4756 , piece_id=XHJLCWAJJ7BMONKDD5O55EJZSOJY4SE2JIXEMW7BMF5VKLIY4ZMA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.293132979 (197h23m53.252230244s) [noise=true , address=104.36.82.18:4392 , piece_id=DUJGW7SOHIZ6SL36R24TZXK3WWT7FJ5U2IYR6U4LT4BYOCLHSDYA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.318430962 (197h23m53.277528202s) [noise=true , address=104.36.82.60:4353 , piece_id=PKRQ3UTWWSP6K4D6VBTXMKOJWRMRLX27PVE7MXOC7YIJFHDU5OBA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.327035473 (197h23m53.286132717s) [noise=true , address=104.36.82.38:4692 , piece_id=LXH2ORVEJ5Q24P3YY5VE4EFWLAYQS7LVCSJ6UWOV2TEEDYLOEXXQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.338269683 (197h23m53.297366924s) [noise=true , address=45.91.116.13:4161 , piece_id=5SE7HKY7PG2AXVK2PSICMLP3ZNQWUDCNTISZKL7A7MGEIZFICMGQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.352408856 (197h23m53.311506088s) [noise=true , address=45.91.116.12:4253 , piece_id=I5KOLUJN6IOTYWPAVCYXZCXABR36WIQDVG35TDEFMWPSCYS2FNAA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.355334738 (197h23m53.314431976s) [noise=true , address=104.36.82.9:4016 , piece_id=HTRAGHQC26JUSNWBAE4MUGJ7GGD7NDR7H5S6KQ2OVC63GZLYUVYQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.408794808 (197h23m53.367892046s) [noise=true , address=77.90.31.18:4829 , piece_id=SVYXJGIM6K5KO74OELO7YINLHRXUTPHS6RUUGGYJT7PN2IVWUV7A, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.417776712 (197h23m53.376873947s) [noise=true , address=104.36.82.10:4097 , piece_id=GUUN4DD7JPUSO6UVSTQ2QKB2DOES63VXMTI4BLNBJAEQ35AFA47Q, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.430486727 (197h23m53.389583966s) [noise=true , address=77.90.31.15:4728 , piece_id=RNCMK7HNBHWDD7OUQHGLPXDA4AL5IKUIFS7JBMMUJ3MNBKRJXWFA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.489232668 (197h23m53.448329901s) [noise=true , address=104.36.82.16:4308 , piece_id=YUKJ2DOGYXBLFSRUJGDBT6CXTOOETTPNDBFPZUW5E6SEAXQMBAIA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.517002522 (197h23m53.476099767s) [noise=true , address=77.90.31.10:4525 , piece_id=EBOKK6AGP3TNV7DP4L3PIJTUDC4M74EOKLH6IBDBMN7IPR5Q3DOQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.627435127 (197h23m53.586532366s) [noise=true , address=104.36.82.56:4248 , piece_id=TOBE3EZABNRXOGLO3BJ3O4QCWJK4JHS2KYUWYZW6FPFY4TZHPYFA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.627456570 (197h23m53.586553809s) [seg_pos={0 0}, upload=205427]: Segment reached optimal threshold of 14 pieces.
Aug 16 22:49:31.627776426 (197h23m53.586873662s) [noise=true , address=104.36.82.14:4241 , piece_id=YZWFVMVW4RIJL5JUUXOG25ZYQUZZZ3P6FZQ6AFBTRZFI74OBJ2FQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aBy6nQScbjzmBSScfEZwTX8NCcP9c71FRQkUH54WvZhhhtXLR): protocol: expected piece hash; context canceled; EOF
Aug 16 22:49:31.627888126 (197h23m53.586985372s) [noise=true , address=77.90.31.12:4602 , piece_id=OH27WBAU3Z5RZA423JF2DWPZ5CIFRZZDW2CQFA3UB27YMKHKAMHA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf): protocol: expected piece hash; context canceled; EOF
Aug 16 22:49:31.628056687 (197h23m53.587153927s) [noise=true , address=104.36.82.23:4469 , piece_id=JH44FO3YNQALB6M5PRITANN5HRMNVM4RY5BOXM5OFYI35FV3LOWA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection; write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection
Aug 16 22:49:31.628079091 (197h23m53.587176328s) [noise=true , address=104.36.82.47:4540 , piece_id=IBPRQX4YHFT3RTB72A5KAWQLSCBHVA6BDN7POOQSZTADZSKX6XAQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection; write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection
Aug 16 22:49:31.628099133 (197h23m53.587196369s) [seg_pos={0 0}, upload=205427]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 22:49:31.628179292 (197h23m53.587276537s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 22:49:31.628195384 (197h23m53.58729263s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 22:49:31.871260215 (197h23m53.830357485s) [upload=205427]: Done uploading segments...
Aug 16 22:49:31.871286118 (197h23m53.830383351s) [upload=205427]: Upload finished. err: <nil>
Duration: 2.691997895s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........X.....................X.....X....................] duration:
1.29944597s
FAIL (2025-08-16 23:03:11 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 22:48:41.883559329 (197h23m3.842656575s) [upload=205414]: Starting upload Aug 16 22:48:41.883616147 (197h23m3.842713394s) [upload=205414]: Done starting upload Aug 16 22:48:41.883698102 (197h23m3.842795348s) [upload=205414]: Uploading segments... Aug 16 22:48:41.883755229 (197h23m3.842853797s) [upload=205414]: Got next segment. Inline: true Aug 16 22:48:41.883763436 (197h23m3.842860682s) [upload=205414]: Waiting for error group managing segments... Aug 16 22:48:41.883813582 (197h23m3.842910831s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 22:48:41.883820508 (197h23m3.842917756s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 22:48:41.883824499 (197h23m3.842921747s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 22:48:41.975827358 (197h23m3.934924614s) [upload=205414]: Done uploading segments... Aug 16 22:48:41.975867347 (197h23m3.934964606s) [upload=205414]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.29947998s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
2.778532943s
FAIL (2025-08-16 23:02:29 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 791528b4431efbda984ff105020a1fa3d2f607da7e832f9772a2edd3a26490b0 != before 620c0ab2bcf8776c74e0f2a9a3fd8e53be0a8b505a80ecd7e638870652f42aca
======LOGS======
Aug 16 22:49:30.196418476 (197h23m52.155515707s) [upload=205427]: Starting upload
Aug 16 22:49:30.196474919 (197h23m52.155572164s) [upload=205427]: Done starting upload
Aug 16 22:49:30.196565257 (197h23m52.155662507s) [upload=205427]: Uploading segments...
Aug 16 22:49:30.196743883 (197h23m52.155841115s) [upload=205427]: Got next segment. Inline: false
Aug 16 22:49:30.196780331 (197h23m52.155877577s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 22:49:30.196785188 (197h23m52.155882433s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 22:49:30.483512934 (197h23m52.4426102s) [seg_pos={0 0}, upload=205427]: Begin upload segment...
Aug 16 22:49:30.483571578 (197h23m52.442668816s) [seg_pos={0 0}, upload=205427]: Done begin upload segment.
Aug 16 22:49:30.483607605 (197h23m52.44270485s) [noise=true , address=77.90.31.10:4525 , piece_id=EBOKK6AGP3TNV7DP4L3PIJTUDC4M74EOKLH6IBDBMN7IPR5Q3DOQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.484090730 (197h23m52.443187982s) [noise=true , address=104.36.82.18:4392 , piece_id=DUJGW7SOHIZ6SL36R24TZXK3WWT7FJ5U2IYR6U4LT4BYOCLHSDYA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.484459664 (197h23m52.443556918s) [noise=true , address=104.36.82.47:4540 , piece_id=IBPRQX4YHFT3RTB72A5KAWQLSCBHVA6BDN7POOQSZTADZSKX6XAQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485065081 (197h23m52.444162336s) [noise=true , address=104.36.82.38:4692 , piece_id=LXH2ORVEJ5Q24P3YY5VE4EFWLAYQS7LVCSJ6UWOV2TEEDYLOEXXQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485525349 (197h23m52.4446226s) [noise=true , address=104.36.82.16:4308 , piece_id=YUKJ2DOGYXBLFSRUJGDBT6CXTOOETTPNDBFPZUW5E6SEAXQMBAIA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485891474 (197h23m52.444988729s) [noise=true , address=104.36.82.10:4097 , piece_id=GUUN4DD7JPUSO6UVSTQ2QKB2DOES63VXMTI4BLNBJAEQ35AFA47Q, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486268568 (197h23m52.445365815s) [noise=true , address=104.36.82.20:4463 , piece_id=RYRSSCTL3N4GJYTB7MNMI4PKWR7RXLDZ2YVIXY3ERLCXLKEEP4TQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486639528 (197h23m52.445736776s) [noise=true , address=104.36.82.56:4248 , piece_id=TOBE3EZABNRXOGLO3BJ3O4QCWJK4JHS2KYUWYZW6FPFY4TZHPYFA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486976423 (197h23m52.446073669s) [noise=true , address=104.36.82.60:4353 , piece_id=PKRQ3UTWWSP6K4D6VBTXMKOJWRMRLX27PVE7MXOC7YIJFHDU5OBA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487317315 (197h23m52.446414561s) [noise=true , address=104.36.82.14:4241 , piece_id=YZWFVMVW4RIJL5JUUXOG25ZYQUZZZ3P6FZQ6AFBTRZFI74OBJ2FQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487612071 (197h23m52.446709316s) [noise=true , address=77.90.31.12:4602 , piece_id=OH27WBAU3Z5RZA423JF2DWPZ5CIFRZZDW2CQFA3UB27YMKHKAMHA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487947801 (197h23m52.447045053s) [noise=true , address=77.90.31.18:4829 , piece_id=SVYXJGIM6K5KO74OELO7YINLHRXUTPHS6RUUGGYJT7PN2IVWUV7A, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.488287344 (197h23m52.4473846s) [noise=true , address=104.36.82.2:4756 , piece_id=XHJLCWAJJ7BMONKDD5O55EJZSOJY4SE2JIXEMW7BMF5VKLIY4ZMA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.488683382 (197h23m52.447780635s) [noise=true , address=45.91.116.12:4253 , piece_id=I5KOLUJN6IOTYWPAVCYXZCXABR36WIQDVG35TDEFMWPSCYS2FNAA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489152324 (197h23m52.448249578s) [noise=true , address=104.36.82.23:4469 , piece_id=JH44FO3YNQALB6M5PRITANN5HRMNVM4RY5BOXM5OFYI35FV3LOWA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489533496 (197h23m52.448630753s) [noise=true , address=104.36.82.9:4016 , piece_id=HTRAGHQC26JUSNWBAE4MUGJ7GGD7NDR7H5S6KQ2OVC63GZLYUVYQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489992155 (197h23m52.449089406s) [noise=true , address=77.90.31.15:4728 , piece_id=RNCMK7HNBHWDD7OUQHGLPXDA4AL5IKUIFS7JBMMUJ3MNBKRJXWFA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.490332655 (197h23m52.44942991s) [noise=true , address=45.91.116.13:4161 , piece_id=5SE7HKY7PG2AXVK2PSICMLP3ZNQWUDCNTISZKL7A7MGEIZFICMGQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:31.070138080 (197h23m53.029235317s) [upload=205427]: Next returned nil segment
Aug 16 22:49:31.070156240 (197h23m53.029253485s) [upload=205427]: Waiting for error group managing segments...
Aug 16 22:49:31.244750684 (197h23m53.203847918s) [noise=true , address=104.36.82.20:4463 , piece_id=RYRSSCTL3N4GJYTB7MNMI4PKWR7RXLDZ2YVIXY3ERLCXLKEEP4TQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.273373250 (197h23m53.232470481s) [noise=true , address=104.36.82.2:4756 , piece_id=XHJLCWAJJ7BMONKDD5O55EJZSOJY4SE2JIXEMW7BMF5VKLIY4ZMA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.293132979 (197h23m53.252230244s) [noise=true , address=104.36.82.18:4392 , piece_id=DUJGW7SOHIZ6SL36R24TZXK3WWT7FJ5U2IYR6U4LT4BYOCLHSDYA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.318430962 (197h23m53.277528202s) [noise=true , address=104.36.82.60:4353 , piece_id=PKRQ3UTWWSP6K4D6VBTXMKOJWRMRLX27PVE7MXOC7YIJFHDU5OBA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.327035473 (197h23m53.286132717s) [noise=true , address=104.36.82.38:4692 , piece_id=LXH2ORVEJ5Q24P3YY5VE4EFWLAYQS7LVCSJ6UWOV2TEEDYLOEXXQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.338269683 (197h23m53.297366924s) [noise=true , address=45.91.116.13:4161 , piece_id=5SE7HKY7PG2AXVK2PSICMLP3ZNQWUDCNTISZKL7A7MGEIZFICMGQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.352408856 (197h23m53.311506088s) [noise=true , address=45.91.116.12:4253 , piece_id=I5KOLUJN6IOTYWPAVCYXZCXABR36WIQDVG35TDEFMWPSCYS2FNAA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.355334738 (197h23m53.314431976s) [noise=true , address=104.36.82.9:4016 , piece_id=HTRAGHQC26JUSNWBAE4MUGJ7GGD7NDR7H5S6KQ2OVC63GZLYUVYQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.408794808 (197h23m53.367892046s) [noise=true , address=77.90.31.18:4829 , piece_id=SVYXJGIM6K5KO74OELO7YINLHRXUTPHS6RUUGGYJT7PN2IVWUV7A, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.417776712 (197h23m53.376873947s) [noise=true , address=104.36.82.10:4097 , piece_id=GUUN4DD7JPUSO6UVSTQ2QKB2DOES63VXMTI4BLNBJAEQ35AFA47Q, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.430486727 (197h23m53.389583966s) [noise=true , address=77.90.31.15:4728 , piece_id=RNCMK7HNBHWDD7OUQHGLPXDA4AL5IKUIFS7JBMMUJ3MNBKRJXWFA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.489232668 (197h23m53.448329901s) [noise=true , address=104.36.82.16:4308 , piece_id=YUKJ2DOGYXBLFSRUJGDBT6CXTOOETTPNDBFPZUW5E6SEAXQMBAIA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.517002522 (197h23m53.476099767s) [noise=true , address=77.90.31.10:4525 , piece_id=EBOKK6AGP3TNV7DP4L3PIJTUDC4M74EOKLH6IBDBMN7IPR5Q3DOQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.627435127 (197h23m53.586532366s) [noise=true , address=104.36.82.56:4248 , piece_id=TOBE3EZABNRXOGLO3BJ3O4QCWJK4JHS2KYUWYZW6FPFY4TZHPYFA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.627456570 (197h23m53.586553809s) [seg_pos={0 0}, upload=205427]: Segment reached optimal threshold of 14 pieces.
Aug 16 22:49:31.627776426 (197h23m53.586873662s) [noise=true , address=104.36.82.14:4241 , piece_id=YZWFVMVW4RIJL5JUUXOG25ZYQUZZZ3P6FZQ6AFBTRZFI74OBJ2FQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aBy6nQScbjzmBSScfEZwTX8NCcP9c71FRQkUH54WvZhhhtXLR): protocol: expected piece hash; context canceled; EOF
Aug 16 22:49:31.627888126 (197h23m53.586985372s) [noise=true , address=77.90.31.12:4602 , piece_id=OH27WBAU3Z5RZA423JF2DWPZ5CIFRZZDW2CQFA3UB27YMKHKAMHA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf): protocol: expected piece hash; context canceled; EOF
Aug 16 22:49:31.628056687 (197h23m53.587153927s) [noise=true , address=104.36.82.23:4469 , piece_id=JH44FO3YNQALB6M5PRITANN5HRMNVM4RY5BOXM5OFYI35FV3LOWA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection; write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection
Aug 16 22:49:31.628079091 (197h23m53.587176328s) [noise=true , address=104.36.82.47:4540 , piece_id=IBPRQX4YHFT3RTB72A5KAWQLSCBHVA6BDN7POOQSZTADZSKX6XAQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection; write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection
Aug 16 22:49:31.628099133 (197h23m53.587196369s) [seg_pos={0 0}, upload=205427]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 22:49:31.628179292 (197h23m53.587276537s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 22:49:31.628195384 (197h23m53.58729263s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 22:49:31.871260215 (197h23m53.830357485s) [upload=205427]: Done uploading segments...
Aug 16 22:49:31.871286118 (197h23m53.830383351s) [upload=205427]: Upload finished. err: <nil>
Duration: 2.778565614s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............X.....................X.....X...................] duration:
1.106842017s
FAIL (2025-08-16 23:02:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 22:48:41.883559329 (197h23m3.842656575s) [upload=205414]: Starting upload Aug 16 22:48:41.883616147 (197h23m3.842713394s) [upload=205414]: Done starting upload Aug 16 22:48:41.883698102 (197h23m3.842795348s) [upload=205414]: Uploading segments... Aug 16 22:48:41.883755229 (197h23m3.842853797s) [upload=205414]: Got next segment. Inline: true Aug 16 22:48:41.883763436 (197h23m3.842860682s) [upload=205414]: Waiting for error group managing segments... Aug 16 22:48:41.883813582 (197h23m3.842910831s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 22:48:41.883820508 (197h23m3.842917756s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 22:48:41.883824499 (197h23m3.842921747s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 22:48:41.975827358 (197h23m3.934924614s) [upload=205414]: Done uploading segments... Aug 16 22:48:41.975867347 (197h23m3.934964606s) [upload=205414]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.106897116s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
3.117708235s
FAIL (2025-08-16 23:01:16 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 791528b4431efbda984ff105020a1fa3d2f607da7e832f9772a2edd3a26490b0 != before 620c0ab2bcf8776c74e0f2a9a3fd8e53be0a8b505a80ecd7e638870652f42aca
======LOGS======
Aug 16 22:49:30.196418476 (197h23m52.155515707s) [upload=205427]: Starting upload
Aug 16 22:49:30.196474919 (197h23m52.155572164s) [upload=205427]: Done starting upload
Aug 16 22:49:30.196565257 (197h23m52.155662507s) [upload=205427]: Uploading segments...
Aug 16 22:49:30.196743883 (197h23m52.155841115s) [upload=205427]: Got next segment. Inline: false
Aug 16 22:49:30.196780331 (197h23m52.155877577s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 22:49:30.196785188 (197h23m52.155882433s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 22:49:30.483512934 (197h23m52.4426102s) [seg_pos={0 0}, upload=205427]: Begin upload segment...
Aug 16 22:49:30.483571578 (197h23m52.442668816s) [seg_pos={0 0}, upload=205427]: Done begin upload segment.
Aug 16 22:49:30.483607605 (197h23m52.44270485s) [noise=true , address=77.90.31.10:4525 , piece_id=EBOKK6AGP3TNV7DP4L3PIJTUDC4M74EOKLH6IBDBMN7IPR5Q3DOQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.484090730 (197h23m52.443187982s) [noise=true , address=104.36.82.18:4392 , piece_id=DUJGW7SOHIZ6SL36R24TZXK3WWT7FJ5U2IYR6U4LT4BYOCLHSDYA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.484459664 (197h23m52.443556918s) [noise=true , address=104.36.82.47:4540 , piece_id=IBPRQX4YHFT3RTB72A5KAWQLSCBHVA6BDN7POOQSZTADZSKX6XAQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485065081 (197h23m52.444162336s) [noise=true , address=104.36.82.38:4692 , piece_id=LXH2ORVEJ5Q24P3YY5VE4EFWLAYQS7LVCSJ6UWOV2TEEDYLOEXXQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485525349 (197h23m52.4446226s) [noise=true , address=104.36.82.16:4308 , piece_id=YUKJ2DOGYXBLFSRUJGDBT6CXTOOETTPNDBFPZUW5E6SEAXQMBAIA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485891474 (197h23m52.444988729s) [noise=true , address=104.36.82.10:4097 , piece_id=GUUN4DD7JPUSO6UVSTQ2QKB2DOES63VXMTI4BLNBJAEQ35AFA47Q, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486268568 (197h23m52.445365815s) [noise=true , address=104.36.82.20:4463 , piece_id=RYRSSCTL3N4GJYTB7MNMI4PKWR7RXLDZ2YVIXY3ERLCXLKEEP4TQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486639528 (197h23m52.445736776s) [noise=true , address=104.36.82.56:4248 , piece_id=TOBE3EZABNRXOGLO3BJ3O4QCWJK4JHS2KYUWYZW6FPFY4TZHPYFA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486976423 (197h23m52.446073669s) [noise=true , address=104.36.82.60:4353 , piece_id=PKRQ3UTWWSP6K4D6VBTXMKOJWRMRLX27PVE7MXOC7YIJFHDU5OBA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487317315 (197h23m52.446414561s) [noise=true , address=104.36.82.14:4241 , piece_id=YZWFVMVW4RIJL5JUUXOG25ZYQUZZZ3P6FZQ6AFBTRZFI74OBJ2FQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487612071 (197h23m52.446709316s) [noise=true , address=77.90.31.12:4602 , piece_id=OH27WBAU3Z5RZA423JF2DWPZ5CIFRZZDW2CQFA3UB27YMKHKAMHA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487947801 (197h23m52.447045053s) [noise=true , address=77.90.31.18:4829 , piece_id=SVYXJGIM6K5KO74OELO7YINLHRXUTPHS6RUUGGYJT7PN2IVWUV7A, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.488287344 (197h23m52.4473846s) [noise=true , address=104.36.82.2:4756 , piece_id=XHJLCWAJJ7BMONKDD5O55EJZSOJY4SE2JIXEMW7BMF5VKLIY4ZMA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.488683382 (197h23m52.447780635s) [noise=true , address=45.91.116.12:4253 , piece_id=I5KOLUJN6IOTYWPAVCYXZCXABR36WIQDVG35TDEFMWPSCYS2FNAA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489152324 (197h23m52.448249578s) [noise=true , address=104.36.82.23:4469 , piece_id=JH44FO3YNQALB6M5PRITANN5HRMNVM4RY5BOXM5OFYI35FV3LOWA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489533496 (197h23m52.448630753s) [noise=true , address=104.36.82.9:4016 , piece_id=HTRAGHQC26JUSNWBAE4MUGJ7GGD7NDR7H5S6KQ2OVC63GZLYUVYQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489992155 (197h23m52.449089406s) [noise=true , address=77.90.31.15:4728 , piece_id=RNCMK7HNBHWDD7OUQHGLPXDA4AL5IKUIFS7JBMMUJ3MNBKRJXWFA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.490332655 (197h23m52.44942991s) [noise=true , address=45.91.116.13:4161 , piece_id=5SE7HKY7PG2AXVK2PSICMLP3ZNQWUDCNTISZKL7A7MGEIZFICMGQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:31.070138080 (197h23m53.029235317s) [upload=205427]: Next returned nil segment
Aug 16 22:49:31.070156240 (197h23m53.029253485s) [upload=205427]: Waiting for error group managing segments...
Aug 16 22:49:31.244750684 (197h23m53.203847918s) [noise=true , address=104.36.82.20:4463 , piece_id=RYRSSCTL3N4GJYTB7MNMI4PKWR7RXLDZ2YVIXY3ERLCXLKEEP4TQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.273373250 (197h23m53.232470481s) [noise=true , address=104.36.82.2:4756 , piece_id=XHJLCWAJJ7BMONKDD5O55EJZSOJY4SE2JIXEMW7BMF5VKLIY4ZMA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.293132979 (197h23m53.252230244s) [noise=true , address=104.36.82.18:4392 , piece_id=DUJGW7SOHIZ6SL36R24TZXK3WWT7FJ5U2IYR6U4LT4BYOCLHSDYA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.318430962 (197h23m53.277528202s) [noise=true , address=104.36.82.60:4353 , piece_id=PKRQ3UTWWSP6K4D6VBTXMKOJWRMRLX27PVE7MXOC7YIJFHDU5OBA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.327035473 (197h23m53.286132717s) [noise=true , address=104.36.82.38:4692 , piece_id=LXH2ORVEJ5Q24P3YY5VE4EFWLAYQS7LVCSJ6UWOV2TEEDYLOEXXQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.338269683 (197h23m53.297366924s) [noise=true , address=45.91.116.13:4161 , piece_id=5SE7HKY7PG2AXVK2PSICMLP3ZNQWUDCNTISZKL7A7MGEIZFICMGQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.352408856 (197h23m53.311506088s) [noise=true , address=45.91.116.12:4253 , piece_id=I5KOLUJN6IOTYWPAVCYXZCXABR36WIQDVG35TDEFMWPSCYS2FNAA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.355334738 (197h23m53.314431976s) [noise=true , address=104.36.82.9:4016 , piece_id=HTRAGHQC26JUSNWBAE4MUGJ7GGD7NDR7H5S6KQ2OVC63GZLYUVYQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.408794808 (197h23m53.367892046s) [noise=true , address=77.90.31.18:4829 , piece_id=SVYXJGIM6K5KO74OELO7YINLHRXUTPHS6RUUGGYJT7PN2IVWUV7A, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.417776712 (197h23m53.376873947s) [noise=true , address=104.36.82.10:4097 , piece_id=GUUN4DD7JPUSO6UVSTQ2QKB2DOES63VXMTI4BLNBJAEQ35AFA47Q, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.430486727 (197h23m53.389583966s) [noise=true , address=77.90.31.15:4728 , piece_id=RNCMK7HNBHWDD7OUQHGLPXDA4AL5IKUIFS7JBMMUJ3MNBKRJXWFA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.489232668 (197h23m53.448329901s) [noise=true , address=104.36.82.16:4308 , piece_id=YUKJ2DOGYXBLFSRUJGDBT6CXTOOETTPNDBFPZUW5E6SEAXQMBAIA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.517002522 (197h23m53.476099767s) [noise=true , address=77.90.31.10:4525 , piece_id=EBOKK6AGP3TNV7DP4L3PIJTUDC4M74EOKLH6IBDBMN7IPR5Q3DOQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.627435127 (197h23m53.586532366s) [noise=true , address=104.36.82.56:4248 , piece_id=TOBE3EZABNRXOGLO3BJ3O4QCWJK4JHS2KYUWYZW6FPFY4TZHPYFA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.627456570 (197h23m53.586553809s) [seg_pos={0 0}, upload=205427]: Segment reached optimal threshold of 14 pieces.
Aug 16 22:49:31.627776426 (197h23m53.586873662s) [noise=true , address=104.36.82.14:4241 , piece_id=YZWFVMVW4RIJL5JUUXOG25ZYQUZZZ3P6FZQ6AFBTRZFI74OBJ2FQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aBy6nQScbjzmBSScfEZwTX8NCcP9c71FRQkUH54WvZhhhtXLR): protocol: expected piece hash; context canceled; EOF
Aug 16 22:49:31.627888126 (197h23m53.586985372s) [noise=true , address=77.90.31.12:4602 , piece_id=OH27WBAU3Z5RZA423JF2DWPZ5CIFRZZDW2CQFA3UB27YMKHKAMHA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf): protocol: expected piece hash; context canceled; EOF
Aug 16 22:49:31.628056687 (197h23m53.587153927s) [noise=true , address=104.36.82.23:4469 , piece_id=JH44FO3YNQALB6M5PRITANN5HRMNVM4RY5BOXM5OFYI35FV3LOWA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection; write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection
Aug 16 22:49:31.628079091 (197h23m53.587176328s) [noise=true , address=104.36.82.47:4540 , piece_id=IBPRQX4YHFT3RTB72A5KAWQLSCBHVA6BDN7POOQSZTADZSKX6XAQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection; write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection
Aug 16 22:49:31.628099133 (197h23m53.587196369s) [seg_pos={0 0}, upload=205427]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 22:49:31.628179292 (197h23m53.587276537s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 22:49:31.628195384 (197h23m53.58729263s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 22:49:31.871260215 (197h23m53.830357485s) [upload=205427]: Done uploading segments...
Aug 16 22:49:31.871286118 (197h23m53.830383351s) [upload=205427]: Upload finished. err: <nil>
Duration: 3.11773713s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............X.....................X.....X..................] duration:
848.400701ms
FAIL (2025-08-16 23:01:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 22:48:41.883559329 (197h23m3.842656575s) [upload=205414]: Starting upload Aug 16 22:48:41.883616147 (197h23m3.842713394s) [upload=205414]: Done starting upload Aug 16 22:48:41.883698102 (197h23m3.842795348s) [upload=205414]: Uploading segments... Aug 16 22:48:41.883755229 (197h23m3.842853797s) [upload=205414]: Got next segment. Inline: true Aug 16 22:48:41.883763436 (197h23m3.842860682s) [upload=205414]: Waiting for error group managing segments... Aug 16 22:48:41.883813582 (197h23m3.842910831s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 22:48:41.883820508 (197h23m3.842917756s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 22:48:41.883824499 (197h23m3.842921747s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 22:48:41.975827358 (197h23m3.934924614s) [upload=205414]: Done uploading segments... Aug 16 22:48:41.975867347 (197h23m3.934964606s) [upload=205414]: Upload finished. err: metaclient: Too Many Requests
Duration: 848.434849ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
3.054425492s
FAIL (2025-08-16 23:01:01 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 791528b4431efbda984ff105020a1fa3d2f607da7e832f9772a2edd3a26490b0 != before 620c0ab2bcf8776c74e0f2a9a3fd8e53be0a8b505a80ecd7e638870652f42aca
======LOGS======
Aug 16 22:49:30.196418476 (197h23m52.155515707s) [upload=205427]: Starting upload
Aug 16 22:49:30.196474919 (197h23m52.155572164s) [upload=205427]: Done starting upload
Aug 16 22:49:30.196565257 (197h23m52.155662507s) [upload=205427]: Uploading segments...
Aug 16 22:49:30.196743883 (197h23m52.155841115s) [upload=205427]: Got next segment. Inline: false
Aug 16 22:49:30.196780331 (197h23m52.155877577s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 22:49:30.196785188 (197h23m52.155882433s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 22:49:30.483512934 (197h23m52.4426102s) [seg_pos={0 0}, upload=205427]: Begin upload segment...
Aug 16 22:49:30.483571578 (197h23m52.442668816s) [seg_pos={0 0}, upload=205427]: Done begin upload segment.
Aug 16 22:49:30.483607605 (197h23m52.44270485s) [noise=true , address=77.90.31.10:4525 , piece_id=EBOKK6AGP3TNV7DP4L3PIJTUDC4M74EOKLH6IBDBMN7IPR5Q3DOQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.484090730 (197h23m52.443187982s) [noise=true , address=104.36.82.18:4392 , piece_id=DUJGW7SOHIZ6SL36R24TZXK3WWT7FJ5U2IYR6U4LT4BYOCLHSDYA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.484459664 (197h23m52.443556918s) [noise=true , address=104.36.82.47:4540 , piece_id=IBPRQX4YHFT3RTB72A5KAWQLSCBHVA6BDN7POOQSZTADZSKX6XAQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485065081 (197h23m52.444162336s) [noise=true , address=104.36.82.38:4692 , piece_id=LXH2ORVEJ5Q24P3YY5VE4EFWLAYQS7LVCSJ6UWOV2TEEDYLOEXXQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485525349 (197h23m52.4446226s) [noise=true , address=104.36.82.16:4308 , piece_id=YUKJ2DOGYXBLFSRUJGDBT6CXTOOETTPNDBFPZUW5E6SEAXQMBAIA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485891474 (197h23m52.444988729s) [noise=true , address=104.36.82.10:4097 , piece_id=GUUN4DD7JPUSO6UVSTQ2QKB2DOES63VXMTI4BLNBJAEQ35AFA47Q, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486268568 (197h23m52.445365815s) [noise=true , address=104.36.82.20:4463 , piece_id=RYRSSCTL3N4GJYTB7MNMI4PKWR7RXLDZ2YVIXY3ERLCXLKEEP4TQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486639528 (197h23m52.445736776s) [noise=true , address=104.36.82.56:4248 , piece_id=TOBE3EZABNRXOGLO3BJ3O4QCWJK4JHS2KYUWYZW6FPFY4TZHPYFA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486976423 (197h23m52.446073669s) [noise=true , address=104.36.82.60:4353 , piece_id=PKRQ3UTWWSP6K4D6VBTXMKOJWRMRLX27PVE7MXOC7YIJFHDU5OBA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487317315 (197h23m52.446414561s) [noise=true , address=104.36.82.14:4241 , piece_id=YZWFVMVW4RIJL5JUUXOG25ZYQUZZZ3P6FZQ6AFBTRZFI74OBJ2FQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487612071 (197h23m52.446709316s) [noise=true , address=77.90.31.12:4602 , piece_id=OH27WBAU3Z5RZA423JF2DWPZ5CIFRZZDW2CQFA3UB27YMKHKAMHA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487947801 (197h23m52.447045053s) [noise=true , address=77.90.31.18:4829 , piece_id=SVYXJGIM6K5KO74OELO7YINLHRXUTPHS6RUUGGYJT7PN2IVWUV7A, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.488287344 (197h23m52.4473846s) [noise=true , address=104.36.82.2:4756 , piece_id=XHJLCWAJJ7BMONKDD5O55EJZSOJY4SE2JIXEMW7BMF5VKLIY4ZMA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.488683382 (197h23m52.447780635s) [noise=true , address=45.91.116.12:4253 , piece_id=I5KOLUJN6IOTYWPAVCYXZCXABR36WIQDVG35TDEFMWPSCYS2FNAA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489152324 (197h23m52.448249578s) [noise=true , address=104.36.82.23:4469 , piece_id=JH44FO3YNQALB6M5PRITANN5HRMNVM4RY5BOXM5OFYI35FV3LOWA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489533496 (197h23m52.448630753s) [noise=true , address=104.36.82.9:4016 , piece_id=HTRAGHQC26JUSNWBAE4MUGJ7GGD7NDR7H5S6KQ2OVC63GZLYUVYQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489992155 (197h23m52.449089406s) [noise=true , address=77.90.31.15:4728 , piece_id=RNCMK7HNBHWDD7OUQHGLPXDA4AL5IKUIFS7JBMMUJ3MNBKRJXWFA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.490332655 (197h23m52.44942991s) [noise=true , address=45.91.116.13:4161 , piece_id=5SE7HKY7PG2AXVK2PSICMLP3ZNQWUDCNTISZKL7A7MGEIZFICMGQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:31.070138080 (197h23m53.029235317s) [upload=205427]: Next returned nil segment
Aug 16 22:49:31.070156240 (197h23m53.029253485s) [upload=205427]: Waiting for error group managing segments...
Aug 16 22:49:31.244750684 (197h23m53.203847918s) [noise=true , address=104.36.82.20:4463 , piece_id=RYRSSCTL3N4GJYTB7MNMI4PKWR7RXLDZ2YVIXY3ERLCXLKEEP4TQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.273373250 (197h23m53.232470481s) [noise=true , address=104.36.82.2:4756 , piece_id=XHJLCWAJJ7BMONKDD5O55EJZSOJY4SE2JIXEMW7BMF5VKLIY4ZMA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.293132979 (197h23m53.252230244s) [noise=true , address=104.36.82.18:4392 , piece_id=DUJGW7SOHIZ6SL36R24TZXK3WWT7FJ5U2IYR6U4LT4BYOCLHSDYA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.318430962 (197h23m53.277528202s) [noise=true , address=104.36.82.60:4353 , piece_id=PKRQ3UTWWSP6K4D6VBTXMKOJWRMRLX27PVE7MXOC7YIJFHDU5OBA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.327035473 (197h23m53.286132717s) [noise=true , address=104.36.82.38:4692 , piece_id=LXH2ORVEJ5Q24P3YY5VE4EFWLAYQS7LVCSJ6UWOV2TEEDYLOEXXQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.338269683 (197h23m53.297366924s) [noise=true , address=45.91.116.13:4161 , piece_id=5SE7HKY7PG2AXVK2PSICMLP3ZNQWUDCNTISZKL7A7MGEIZFICMGQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.352408856 (197h23m53.311506088s) [noise=true , address=45.91.116.12:4253 , piece_id=I5KOLUJN6IOTYWPAVCYXZCXABR36WIQDVG35TDEFMWPSCYS2FNAA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.355334738 (197h23m53.314431976s) [noise=true , address=104.36.82.9:4016 , piece_id=HTRAGHQC26JUSNWBAE4MUGJ7GGD7NDR7H5S6KQ2OVC63GZLYUVYQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.408794808 (197h23m53.367892046s) [noise=true , address=77.90.31.18:4829 , piece_id=SVYXJGIM6K5KO74OELO7YINLHRXUTPHS6RUUGGYJT7PN2IVWUV7A, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.417776712 (197h23m53.376873947s) [noise=true , address=104.36.82.10:4097 , piece_id=GUUN4DD7JPUSO6UVSTQ2QKB2DOES63VXMTI4BLNBJAEQ35AFA47Q, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.430486727 (197h23m53.389583966s) [noise=true , address=77.90.31.15:4728 , piece_id=RNCMK7HNBHWDD7OUQHGLPXDA4AL5IKUIFS7JBMMUJ3MNBKRJXWFA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.489232668 (197h23m53.448329901s) [noise=true , address=104.36.82.16:4308 , piece_id=YUKJ2DOGYXBLFSRUJGDBT6CXTOOETTPNDBFPZUW5E6SEAXQMBAIA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.517002522 (197h23m53.476099767s) [noise=true , address=77.90.31.10:4525 , piece_id=EBOKK6AGP3TNV7DP4L3PIJTUDC4M74EOKLH6IBDBMN7IPR5Q3DOQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.627435127 (197h23m53.586532366s) [noise=true , address=104.36.82.56:4248 , piece_id=TOBE3EZABNRXOGLO3BJ3O4QCWJK4JHS2KYUWYZW6FPFY4TZHPYFA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.627456570 (197h23m53.586553809s) [seg_pos={0 0}, upload=205427]: Segment reached optimal threshold of 14 pieces.
Aug 16 22:49:31.627776426 (197h23m53.586873662s) [noise=true , address=104.36.82.14:4241 , piece_id=YZWFVMVW4RIJL5JUUXOG25ZYQUZZZ3P6FZQ6AFBTRZFI74OBJ2FQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aBy6nQScbjzmBSScfEZwTX8NCcP9c71FRQkUH54WvZhhhtXLR): protocol: expected piece hash; context canceled; EOF
Aug 16 22:49:31.627888126 (197h23m53.586985372s) [noise=true , address=77.90.31.12:4602 , piece_id=OH27WBAU3Z5RZA423JF2DWPZ5CIFRZZDW2CQFA3UB27YMKHKAMHA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf): protocol: expected piece hash; context canceled; EOF
Aug 16 22:49:31.628056687 (197h23m53.587153927s) [noise=true , address=104.36.82.23:4469 , piece_id=JH44FO3YNQALB6M5PRITANN5HRMNVM4RY5BOXM5OFYI35FV3LOWA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection; write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection
Aug 16 22:49:31.628079091 (197h23m53.587176328s) [noise=true , address=104.36.82.47:4540 , piece_id=IBPRQX4YHFT3RTB72A5KAWQLSCBHVA6BDN7POOQSZTADZSKX6XAQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection; write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection
Aug 16 22:49:31.628099133 (197h23m53.587196369s) [seg_pos={0 0}, upload=205427]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 22:49:31.628179292 (197h23m53.587276537s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 22:49:31.628195384 (197h23m53.58729263s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 22:49:31.871260215 (197h23m53.830357485s) [upload=205427]: Done uploading segments...
Aug 16 22:49:31.871286118 (197h23m53.830383351s) [upload=205427]: Upload finished. err: <nil>
Duration: 3.054481687s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
2.856470166s
FAIL (2025-08-16 23:00:07 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 791528b4431efbda984ff105020a1fa3d2f607da7e832f9772a2edd3a26490b0 != before 620c0ab2bcf8776c74e0f2a9a3fd8e53be0a8b505a80ecd7e638870652f42aca
======LOGS======
Aug 16 22:49:30.196418476 (197h23m52.155515707s) [upload=205427]: Starting upload
Aug 16 22:49:30.196474919 (197h23m52.155572164s) [upload=205427]: Done starting upload
Aug 16 22:49:30.196565257 (197h23m52.155662507s) [upload=205427]: Uploading segments...
Aug 16 22:49:30.196743883 (197h23m52.155841115s) [upload=205427]: Got next segment. Inline: false
Aug 16 22:49:30.196780331 (197h23m52.155877577s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 22:49:30.196785188 (197h23m52.155882433s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 22:49:30.483512934 (197h23m52.4426102s) [seg_pos={0 0}, upload=205427]: Begin upload segment...
Aug 16 22:49:30.483571578 (197h23m52.442668816s) [seg_pos={0 0}, upload=205427]: Done begin upload segment.
Aug 16 22:49:30.483607605 (197h23m52.44270485s) [noise=true , address=77.90.31.10:4525 , piece_id=EBOKK6AGP3TNV7DP4L3PIJTUDC4M74EOKLH6IBDBMN7IPR5Q3DOQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.484090730 (197h23m52.443187982s) [noise=true , address=104.36.82.18:4392 , piece_id=DUJGW7SOHIZ6SL36R24TZXK3WWT7FJ5U2IYR6U4LT4BYOCLHSDYA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.484459664 (197h23m52.443556918s) [noise=true , address=104.36.82.47:4540 , piece_id=IBPRQX4YHFT3RTB72A5KAWQLSCBHVA6BDN7POOQSZTADZSKX6XAQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485065081 (197h23m52.444162336s) [noise=true , address=104.36.82.38:4692 , piece_id=LXH2ORVEJ5Q24P3YY5VE4EFWLAYQS7LVCSJ6UWOV2TEEDYLOEXXQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485525349 (197h23m52.4446226s) [noise=true , address=104.36.82.16:4308 , piece_id=YUKJ2DOGYXBLFSRUJGDBT6CXTOOETTPNDBFPZUW5E6SEAXQMBAIA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485891474 (197h23m52.444988729s) [noise=true , address=104.36.82.10:4097 , piece_id=GUUN4DD7JPUSO6UVSTQ2QKB2DOES63VXMTI4BLNBJAEQ35AFA47Q, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486268568 (197h23m52.445365815s) [noise=true , address=104.36.82.20:4463 , piece_id=RYRSSCTL3N4GJYTB7MNMI4PKWR7RXLDZ2YVIXY3ERLCXLKEEP4TQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486639528 (197h23m52.445736776s) [noise=true , address=104.36.82.56:4248 , piece_id=TOBE3EZABNRXOGLO3BJ3O4QCWJK4JHS2KYUWYZW6FPFY4TZHPYFA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486976423 (197h23m52.446073669s) [noise=true , address=104.36.82.60:4353 , piece_id=PKRQ3UTWWSP6K4D6VBTXMKOJWRMRLX27PVE7MXOC7YIJFHDU5OBA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487317315 (197h23m52.446414561s) [noise=true , address=104.36.82.14:4241 , piece_id=YZWFVMVW4RIJL5JUUXOG25ZYQUZZZ3P6FZQ6AFBTRZFI74OBJ2FQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487612071 (197h23m52.446709316s) [noise=true , address=77.90.31.12:4602 , piece_id=OH27WBAU3Z5RZA423JF2DWPZ5CIFRZZDW2CQFA3UB27YMKHKAMHA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487947801 (197h23m52.447045053s) [noise=true , address=77.90.31.18:4829 , piece_id=SVYXJGIM6K5KO74OELO7YINLHRXUTPHS6RUUGGYJT7PN2IVWUV7A, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.488287344 (197h23m52.4473846s) [noise=true , address=104.36.82.2:4756 , piece_id=XHJLCWAJJ7BMONKDD5O55EJZSOJY4SE2JIXEMW7BMF5VKLIY4ZMA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.488683382 (197h23m52.447780635s) [noise=true , address=45.91.116.12:4253 , piece_id=I5KOLUJN6IOTYWPAVCYXZCXABR36WIQDVG35TDEFMWPSCYS2FNAA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489152324 (197h23m52.448249578s) [noise=true , address=104.36.82.23:4469 , piece_id=JH44FO3YNQALB6M5PRITANN5HRMNVM4RY5BOXM5OFYI35FV3LOWA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489533496 (197h23m52.448630753s) [noise=true , address=104.36.82.9:4016 , piece_id=HTRAGHQC26JUSNWBAE4MUGJ7GGD7NDR7H5S6KQ2OVC63GZLYUVYQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489992155 (197h23m52.449089406s) [noise=true , address=77.90.31.15:4728 , piece_id=RNCMK7HNBHWDD7OUQHGLPXDA4AL5IKUIFS7JBMMUJ3MNBKRJXWFA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.490332655 (197h23m52.44942991s) [noise=true , address=45.91.116.13:4161 , piece_id=5SE7HKY7PG2AXVK2PSICMLP3ZNQWUDCNTISZKL7A7MGEIZFICMGQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:31.070138080 (197h23m53.029235317s) [upload=205427]: Next returned nil segment
Aug 16 22:49:31.070156240 (197h23m53.029253485s) [upload=205427]: Waiting for error group managing segments...
Aug 16 22:49:31.244750684 (197h23m53.203847918s) [noise=true , address=104.36.82.20:4463 , piece_id=RYRSSCTL3N4GJYTB7MNMI4PKWR7RXLDZ2YVIXY3ERLCXLKEEP4TQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.273373250 (197h23m53.232470481s) [noise=true , address=104.36.82.2:4756 , piece_id=XHJLCWAJJ7BMONKDD5O55EJZSOJY4SE2JIXEMW7BMF5VKLIY4ZMA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.293132979 (197h23m53.252230244s) [noise=true , address=104.36.82.18:4392 , piece_id=DUJGW7SOHIZ6SL36R24TZXK3WWT7FJ5U2IYR6U4LT4BYOCLHSDYA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.318430962 (197h23m53.277528202s) [noise=true , address=104.36.82.60:4353 , piece_id=PKRQ3UTWWSP6K4D6VBTXMKOJWRMRLX27PVE7MXOC7YIJFHDU5OBA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.327035473 (197h23m53.286132717s) [noise=true , address=104.36.82.38:4692 , piece_id=LXH2ORVEJ5Q24P3YY5VE4EFWLAYQS7LVCSJ6UWOV2TEEDYLOEXXQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.338269683 (197h23m53.297366924s) [noise=true , address=45.91.116.13:4161 , piece_id=5SE7HKY7PG2AXVK2PSICMLP3ZNQWUDCNTISZKL7A7MGEIZFICMGQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.352408856 (197h23m53.311506088s) [noise=true , address=45.91.116.12:4253 , piece_id=I5KOLUJN6IOTYWPAVCYXZCXABR36WIQDVG35TDEFMWPSCYS2FNAA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.355334738 (197h23m53.314431976s) [noise=true , address=104.36.82.9:4016 , piece_id=HTRAGHQC26JUSNWBAE4MUGJ7GGD7NDR7H5S6KQ2OVC63GZLYUVYQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.408794808 (197h23m53.367892046s) [noise=true , address=77.90.31.18:4829 , piece_id=SVYXJGIM6K5KO74OELO7YINLHRXUTPHS6RUUGGYJT7PN2IVWUV7A, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.417776712 (197h23m53.376873947s) [noise=true , address=104.36.82.10:4097 , piece_id=GUUN4DD7JPUSO6UVSTQ2QKB2DOES63VXMTI4BLNBJAEQ35AFA47Q, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.430486727 (197h23m53.389583966s) [noise=true , address=77.90.31.15:4728 , piece_id=RNCMK7HNBHWDD7OUQHGLPXDA4AL5IKUIFS7JBMMUJ3MNBKRJXWFA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.489232668 (197h23m53.448329901s) [noise=true , address=104.36.82.16:4308 , piece_id=YUKJ2DOGYXBLFSRUJGDBT6CXTOOETTPNDBFPZUW5E6SEAXQMBAIA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.517002522 (197h23m53.476099767s) [noise=true , address=77.90.31.10:4525 , piece_id=EBOKK6AGP3TNV7DP4L3PIJTUDC4M74EOKLH6IBDBMN7IPR5Q3DOQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.627435127 (197h23m53.586532366s) [noise=true , address=104.36.82.56:4248 , piece_id=TOBE3EZABNRXOGLO3BJ3O4QCWJK4JHS2KYUWYZW6FPFY4TZHPYFA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.627456570 (197h23m53.586553809s) [seg_pos={0 0}, upload=205427]: Segment reached optimal threshold of 14 pieces.
Aug 16 22:49:31.627776426 (197h23m53.586873662s) [noise=true , address=104.36.82.14:4241 , piece_id=YZWFVMVW4RIJL5JUUXOG25ZYQUZZZ3P6FZQ6AFBTRZFI74OBJ2FQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aBy6nQScbjzmBSScfEZwTX8NCcP9c71FRQkUH54WvZhhhtXLR): protocol: expected piece hash; context canceled; EOF
Aug 16 22:49:31.627888126 (197h23m53.586985372s) [noise=true , address=77.90.31.12:4602 , piece_id=OH27WBAU3Z5RZA423JF2DWPZ5CIFRZZDW2CQFA3UB27YMKHKAMHA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf): protocol: expected piece hash; context canceled; EOF
Aug 16 22:49:31.628056687 (197h23m53.587153927s) [noise=true , address=104.36.82.23:4469 , piece_id=JH44FO3YNQALB6M5PRITANN5HRMNVM4RY5BOXM5OFYI35FV3LOWA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection; write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection
Aug 16 22:49:31.628079091 (197h23m53.587176328s) [noise=true , address=104.36.82.47:4540 , piece_id=IBPRQX4YHFT3RTB72A5KAWQLSCBHVA6BDN7POOQSZTADZSKX6XAQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection; write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection
Aug 16 22:49:31.628099133 (197h23m53.587196369s) [seg_pos={0 0}, upload=205427]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 22:49:31.628179292 (197h23m53.587276537s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 22:49:31.628195384 (197h23m53.58729263s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 22:49:31.871260215 (197h23m53.830357485s) [upload=205427]: Done uploading segments...
Aug 16 22:49:31.871286118 (197h23m53.830383351s) [upload=205427]: Upload finished. err: <nil>
Duration: 2.856537791s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..............X.....................X.....X.................] duration:
932.30218ms
FAIL (2025-08-16 22:59:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 22:48:41.883559329 (197h23m3.842656575s) [upload=205414]: Starting upload Aug 16 22:48:41.883616147 (197h23m3.842713394s) [upload=205414]: Done starting upload Aug 16 22:48:41.883698102 (197h23m3.842795348s) [upload=205414]: Uploading segments... Aug 16 22:48:41.883755229 (197h23m3.842853797s) [upload=205414]: Got next segment. Inline: true Aug 16 22:48:41.883763436 (197h23m3.842860682s) [upload=205414]: Waiting for error group managing segments... Aug 16 22:48:41.883813582 (197h23m3.842910831s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 22:48:41.883820508 (197h23m3.842917756s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 22:48:41.883824499 (197h23m3.842921747s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 22:48:41.975827358 (197h23m3.934924614s) [upload=205414]: Done uploading segments... Aug 16 22:48:41.975867347 (197h23m3.934964606s) [upload=205414]: Upload finished. err: metaclient: Too Many Requests
Duration: 932.331647ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
2.740153126s
FAIL (2025-08-16 22:59:14 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 791528b4431efbda984ff105020a1fa3d2f607da7e832f9772a2edd3a26490b0 != before 620c0ab2bcf8776c74e0f2a9a3fd8e53be0a8b505a80ecd7e638870652f42aca
======LOGS======
Aug 16 22:49:30.196418476 (197h23m52.155515707s) [upload=205427]: Starting upload
Aug 16 22:49:30.196474919 (197h23m52.155572164s) [upload=205427]: Done starting upload
Aug 16 22:49:30.196565257 (197h23m52.155662507s) [upload=205427]: Uploading segments...
Aug 16 22:49:30.196743883 (197h23m52.155841115s) [upload=205427]: Got next segment. Inline: false
Aug 16 22:49:30.196780331 (197h23m52.155877577s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 22:49:30.196785188 (197h23m52.155882433s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 22:49:30.483512934 (197h23m52.4426102s) [seg_pos={0 0}, upload=205427]: Begin upload segment...
Aug 16 22:49:30.483571578 (197h23m52.442668816s) [seg_pos={0 0}, upload=205427]: Done begin upload segment.
Aug 16 22:49:30.483607605 (197h23m52.44270485s) [noise=true , address=77.90.31.10:4525 , piece_id=EBOKK6AGP3TNV7DP4L3PIJTUDC4M74EOKLH6IBDBMN7IPR5Q3DOQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.484090730 (197h23m52.443187982s) [noise=true , address=104.36.82.18:4392 , piece_id=DUJGW7SOHIZ6SL36R24TZXK3WWT7FJ5U2IYR6U4LT4BYOCLHSDYA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.484459664 (197h23m52.443556918s) [noise=true , address=104.36.82.47:4540 , piece_id=IBPRQX4YHFT3RTB72A5KAWQLSCBHVA6BDN7POOQSZTADZSKX6XAQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485065081 (197h23m52.444162336s) [noise=true , address=104.36.82.38:4692 , piece_id=LXH2ORVEJ5Q24P3YY5VE4EFWLAYQS7LVCSJ6UWOV2TEEDYLOEXXQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485525349 (197h23m52.4446226s) [noise=true , address=104.36.82.16:4308 , piece_id=YUKJ2DOGYXBLFSRUJGDBT6CXTOOETTPNDBFPZUW5E6SEAXQMBAIA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485891474 (197h23m52.444988729s) [noise=true , address=104.36.82.10:4097 , piece_id=GUUN4DD7JPUSO6UVSTQ2QKB2DOES63VXMTI4BLNBJAEQ35AFA47Q, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486268568 (197h23m52.445365815s) [noise=true , address=104.36.82.20:4463 , piece_id=RYRSSCTL3N4GJYTB7MNMI4PKWR7RXLDZ2YVIXY3ERLCXLKEEP4TQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486639528 (197h23m52.445736776s) [noise=true , address=104.36.82.56:4248 , piece_id=TOBE3EZABNRXOGLO3BJ3O4QCWJK4JHS2KYUWYZW6FPFY4TZHPYFA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486976423 (197h23m52.446073669s) [noise=true , address=104.36.82.60:4353 , piece_id=PKRQ3UTWWSP6K4D6VBTXMKOJWRMRLX27PVE7MXOC7YIJFHDU5OBA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487317315 (197h23m52.446414561s) [noise=true , address=104.36.82.14:4241 , piece_id=YZWFVMVW4RIJL5JUUXOG25ZYQUZZZ3P6FZQ6AFBTRZFI74OBJ2FQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487612071 (197h23m52.446709316s) [noise=true , address=77.90.31.12:4602 , piece_id=OH27WBAU3Z5RZA423JF2DWPZ5CIFRZZDW2CQFA3UB27YMKHKAMHA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487947801 (197h23m52.447045053s) [noise=true , address=77.90.31.18:4829 , piece_id=SVYXJGIM6K5KO74OELO7YINLHRXUTPHS6RUUGGYJT7PN2IVWUV7A, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.488287344 (197h23m52.4473846s) [noise=true , address=104.36.82.2:4756 , piece_id=XHJLCWAJJ7BMONKDD5O55EJZSOJY4SE2JIXEMW7BMF5VKLIY4ZMA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.488683382 (197h23m52.447780635s) [noise=true , address=45.91.116.12:4253 , piece_id=I5KOLUJN6IOTYWPAVCYXZCXABR36WIQDVG35TDEFMWPSCYS2FNAA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489152324 (197h23m52.448249578s) [noise=true , address=104.36.82.23:4469 , piece_id=JH44FO3YNQALB6M5PRITANN5HRMNVM4RY5BOXM5OFYI35FV3LOWA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489533496 (197h23m52.448630753s) [noise=true , address=104.36.82.9:4016 , piece_id=HTRAGHQC26JUSNWBAE4MUGJ7GGD7NDR7H5S6KQ2OVC63GZLYUVYQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489992155 (197h23m52.449089406s) [noise=true , address=77.90.31.15:4728 , piece_id=RNCMK7HNBHWDD7OUQHGLPXDA4AL5IKUIFS7JBMMUJ3MNBKRJXWFA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.490332655 (197h23m52.44942991s) [noise=true , address=45.91.116.13:4161 , piece_id=5SE7HKY7PG2AXVK2PSICMLP3ZNQWUDCNTISZKL7A7MGEIZFICMGQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:31.070138080 (197h23m53.029235317s) [upload=205427]: Next returned nil segment
Aug 16 22:49:31.070156240 (197h23m53.029253485s) [upload=205427]: Waiting for error group managing segments...
Aug 16 22:49:31.244750684 (197h23m53.203847918s) [noise=true , address=104.36.82.20:4463 , piece_id=RYRSSCTL3N4GJYTB7MNMI4PKWR7RXLDZ2YVIXY3ERLCXLKEEP4TQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.273373250 (197h23m53.232470481s) [noise=true , address=104.36.82.2:4756 , piece_id=XHJLCWAJJ7BMONKDD5O55EJZSOJY4SE2JIXEMW7BMF5VKLIY4ZMA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.293132979 (197h23m53.252230244s) [noise=true , address=104.36.82.18:4392 , piece_id=DUJGW7SOHIZ6SL36R24TZXK3WWT7FJ5U2IYR6U4LT4BYOCLHSDYA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.318430962 (197h23m53.277528202s) [noise=true , address=104.36.82.60:4353 , piece_id=PKRQ3UTWWSP6K4D6VBTXMKOJWRMRLX27PVE7MXOC7YIJFHDU5OBA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.327035473 (197h23m53.286132717s) [noise=true , address=104.36.82.38:4692 , piece_id=LXH2ORVEJ5Q24P3YY5VE4EFWLAYQS7LVCSJ6UWOV2TEEDYLOEXXQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.338269683 (197h23m53.297366924s) [noise=true , address=45.91.116.13:4161 , piece_id=5SE7HKY7PG2AXVK2PSICMLP3ZNQWUDCNTISZKL7A7MGEIZFICMGQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.352408856 (197h23m53.311506088s) [noise=true , address=45.91.116.12:4253 , piece_id=I5KOLUJN6IOTYWPAVCYXZCXABR36WIQDVG35TDEFMWPSCYS2FNAA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.355334738 (197h23m53.314431976s) [noise=true , address=104.36.82.9:4016 , piece_id=HTRAGHQC26JUSNWBAE4MUGJ7GGD7NDR7H5S6KQ2OVC63GZLYUVYQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.408794808 (197h23m53.367892046s) [noise=true , address=77.90.31.18:4829 , piece_id=SVYXJGIM6K5KO74OELO7YINLHRXUTPHS6RUUGGYJT7PN2IVWUV7A, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.417776712 (197h23m53.376873947s) [noise=true , address=104.36.82.10:4097 , piece_id=GUUN4DD7JPUSO6UVSTQ2QKB2DOES63VXMTI4BLNBJAEQ35AFA47Q, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.430486727 (197h23m53.389583966s) [noise=true , address=77.90.31.15:4728 , piece_id=RNCMK7HNBHWDD7OUQHGLPXDA4AL5IKUIFS7JBMMUJ3MNBKRJXWFA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.489232668 (197h23m53.448329901s) [noise=true , address=104.36.82.16:4308 , piece_id=YUKJ2DOGYXBLFSRUJGDBT6CXTOOETTPNDBFPZUW5E6SEAXQMBAIA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.517002522 (197h23m53.476099767s) [noise=true , address=77.90.31.10:4525 , piece_id=EBOKK6AGP3TNV7DP4L3PIJTUDC4M74EOKLH6IBDBMN7IPR5Q3DOQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.627435127 (197h23m53.586532366s) [noise=true , address=104.36.82.56:4248 , piece_id=TOBE3EZABNRXOGLO3BJ3O4QCWJK4JHS2KYUWYZW6FPFY4TZHPYFA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.627456570 (197h23m53.586553809s) [seg_pos={0 0}, upload=205427]: Segment reached optimal threshold of 14 pieces.
Aug 16 22:49:31.627776426 (197h23m53.586873662s) [noise=true , address=104.36.82.14:4241 , piece_id=YZWFVMVW4RIJL5JUUXOG25ZYQUZZZ3P6FZQ6AFBTRZFI74OBJ2FQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aBy6nQScbjzmBSScfEZwTX8NCcP9c71FRQkUH54WvZhhhtXLR): protocol: expected piece hash; context canceled; EOF
Aug 16 22:49:31.627888126 (197h23m53.586985372s) [noise=true , address=77.90.31.12:4602 , piece_id=OH27WBAU3Z5RZA423JF2DWPZ5CIFRZZDW2CQFA3UB27YMKHKAMHA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf): protocol: expected piece hash; context canceled; EOF
Aug 16 22:49:31.628056687 (197h23m53.587153927s) [noise=true , address=104.36.82.23:4469 , piece_id=JH44FO3YNQALB6M5PRITANN5HRMNVM4RY5BOXM5OFYI35FV3LOWA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection; write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection
Aug 16 22:49:31.628079091 (197h23m53.587176328s) [noise=true , address=104.36.82.47:4540 , piece_id=IBPRQX4YHFT3RTB72A5KAWQLSCBHVA6BDN7POOQSZTADZSKX6XAQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection; write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection
Aug 16 22:49:31.628099133 (197h23m53.587196369s) [seg_pos={0 0}, upload=205427]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 22:49:31.628179292 (197h23m53.587276537s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 22:49:31.628195384 (197h23m53.58729263s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 22:49:31.871260215 (197h23m53.830357485s) [upload=205427]: Done uploading segments...
Aug 16 22:49:31.871286118 (197h23m53.830383351s) [upload=205427]: Upload finished. err: <nil>
Duration: 2.740180764s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...............X.....................X.....X................] duration:
904.732375ms
FAIL (2025-08-16 22:58:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 22:48:41.883559329 (197h23m3.842656575s) [upload=205414]: Starting upload Aug 16 22:48:41.883616147 (197h23m3.842713394s) [upload=205414]: Done starting upload Aug 16 22:48:41.883698102 (197h23m3.842795348s) [upload=205414]: Uploading segments... Aug 16 22:48:41.883755229 (197h23m3.842853797s) [upload=205414]: Got next segment. Inline: true Aug 16 22:48:41.883763436 (197h23m3.842860682s) [upload=205414]: Waiting for error group managing segments... Aug 16 22:48:41.883813582 (197h23m3.842910831s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 22:48:41.883820508 (197h23m3.842917756s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 22:48:41.883824499 (197h23m3.842921747s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 22:48:41.975827358 (197h23m3.934924614s) [upload=205414]: Done uploading segments... Aug 16 22:48:41.975867347 (197h23m3.934964606s) [upload=205414]: Upload finished. err: metaclient: Too Many Requests
Duration: 904.7662ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [................X.....................X.....X...............] duration:
1.006690841s
FAIL (2025-08-16 22:58:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 22:48:41.883559329 (197h23m3.842656575s) [upload=205414]: Starting upload Aug 16 22:48:41.883616147 (197h23m3.842713394s) [upload=205414]: Done starting upload Aug 16 22:48:41.883698102 (197h23m3.842795348s) [upload=205414]: Uploading segments... Aug 16 22:48:41.883755229 (197h23m3.842853797s) [upload=205414]: Got next segment. Inline: true Aug 16 22:48:41.883763436 (197h23m3.842860682s) [upload=205414]: Waiting for error group managing segments... Aug 16 22:48:41.883813582 (197h23m3.842910831s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 22:48:41.883820508 (197h23m3.842917756s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 22:48:41.883824499 (197h23m3.842921747s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 22:48:41.975827358 (197h23m3.934924614s) [upload=205414]: Done uploading segments... Aug 16 22:48:41.975867347 (197h23m3.934964606s) [upload=205414]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.006719486s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
3.208957995s
FAIL (2025-08-16 22:58:22 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 791528b4431efbda984ff105020a1fa3d2f607da7e832f9772a2edd3a26490b0 != before 620c0ab2bcf8776c74e0f2a9a3fd8e53be0a8b505a80ecd7e638870652f42aca
======LOGS======
Aug 16 22:49:30.196418476 (197h23m52.155515707s) [upload=205427]: Starting upload
Aug 16 22:49:30.196474919 (197h23m52.155572164s) [upload=205427]: Done starting upload
Aug 16 22:49:30.196565257 (197h23m52.155662507s) [upload=205427]: Uploading segments...
Aug 16 22:49:30.196743883 (197h23m52.155841115s) [upload=205427]: Got next segment. Inline: false
Aug 16 22:49:30.196780331 (197h23m52.155877577s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 22:49:30.196785188 (197h23m52.155882433s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 22:49:30.483512934 (197h23m52.4426102s) [seg_pos={0 0}, upload=205427]: Begin upload segment...
Aug 16 22:49:30.483571578 (197h23m52.442668816s) [seg_pos={0 0}, upload=205427]: Done begin upload segment.
Aug 16 22:49:30.483607605 (197h23m52.44270485s) [noise=true , address=77.90.31.10:4525 , piece_id=EBOKK6AGP3TNV7DP4L3PIJTUDC4M74EOKLH6IBDBMN7IPR5Q3DOQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.484090730 (197h23m52.443187982s) [noise=true , address=104.36.82.18:4392 , piece_id=DUJGW7SOHIZ6SL36R24TZXK3WWT7FJ5U2IYR6U4LT4BYOCLHSDYA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.484459664 (197h23m52.443556918s) [noise=true , address=104.36.82.47:4540 , piece_id=IBPRQX4YHFT3RTB72A5KAWQLSCBHVA6BDN7POOQSZTADZSKX6XAQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485065081 (197h23m52.444162336s) [noise=true , address=104.36.82.38:4692 , piece_id=LXH2ORVEJ5Q24P3YY5VE4EFWLAYQS7LVCSJ6UWOV2TEEDYLOEXXQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485525349 (197h23m52.4446226s) [noise=true , address=104.36.82.16:4308 , piece_id=YUKJ2DOGYXBLFSRUJGDBT6CXTOOETTPNDBFPZUW5E6SEAXQMBAIA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485891474 (197h23m52.444988729s) [noise=true , address=104.36.82.10:4097 , piece_id=GUUN4DD7JPUSO6UVSTQ2QKB2DOES63VXMTI4BLNBJAEQ35AFA47Q, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486268568 (197h23m52.445365815s) [noise=true , address=104.36.82.20:4463 , piece_id=RYRSSCTL3N4GJYTB7MNMI4PKWR7RXLDZ2YVIXY3ERLCXLKEEP4TQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486639528 (197h23m52.445736776s) [noise=true , address=104.36.82.56:4248 , piece_id=TOBE3EZABNRXOGLO3BJ3O4QCWJK4JHS2KYUWYZW6FPFY4TZHPYFA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486976423 (197h23m52.446073669s) [noise=true , address=104.36.82.60:4353 , piece_id=PKRQ3UTWWSP6K4D6VBTXMKOJWRMRLX27PVE7MXOC7YIJFHDU5OBA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487317315 (197h23m52.446414561s) [noise=true , address=104.36.82.14:4241 , piece_id=YZWFVMVW4RIJL5JUUXOG25ZYQUZZZ3P6FZQ6AFBTRZFI74OBJ2FQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487612071 (197h23m52.446709316s) [noise=true , address=77.90.31.12:4602 , piece_id=OH27WBAU3Z5RZA423JF2DWPZ5CIFRZZDW2CQFA3UB27YMKHKAMHA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487947801 (197h23m52.447045053s) [noise=true , address=77.90.31.18:4829 , piece_id=SVYXJGIM6K5KO74OELO7YINLHRXUTPHS6RUUGGYJT7PN2IVWUV7A, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.488287344 (197h23m52.4473846s) [noise=true , address=104.36.82.2:4756 , piece_id=XHJLCWAJJ7BMONKDD5O55EJZSOJY4SE2JIXEMW7BMF5VKLIY4ZMA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.488683382 (197h23m52.447780635s) [noise=true , address=45.91.116.12:4253 , piece_id=I5KOLUJN6IOTYWPAVCYXZCXABR36WIQDVG35TDEFMWPSCYS2FNAA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489152324 (197h23m52.448249578s) [noise=true , address=104.36.82.23:4469 , piece_id=JH44FO3YNQALB6M5PRITANN5HRMNVM4RY5BOXM5OFYI35FV3LOWA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489533496 (197h23m52.448630753s) [noise=true , address=104.36.82.9:4016 , piece_id=HTRAGHQC26JUSNWBAE4MUGJ7GGD7NDR7H5S6KQ2OVC63GZLYUVYQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489992155 (197h23m52.449089406s) [noise=true , address=77.90.31.15:4728 , piece_id=RNCMK7HNBHWDD7OUQHGLPXDA4AL5IKUIFS7JBMMUJ3MNBKRJXWFA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.490332655 (197h23m52.44942991s) [noise=true , address=45.91.116.13:4161 , piece_id=5SE7HKY7PG2AXVK2PSICMLP3ZNQWUDCNTISZKL7A7MGEIZFICMGQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:31.070138080 (197h23m53.029235317s) [upload=205427]: Next returned nil segment
Aug 16 22:49:31.070156240 (197h23m53.029253485s) [upload=205427]: Waiting for error group managing segments...
Aug 16 22:49:31.244750684 (197h23m53.203847918s) [noise=true , address=104.36.82.20:4463 , piece_id=RYRSSCTL3N4GJYTB7MNMI4PKWR7RXLDZ2YVIXY3ERLCXLKEEP4TQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.273373250 (197h23m53.232470481s) [noise=true , address=104.36.82.2:4756 , piece_id=XHJLCWAJJ7BMONKDD5O55EJZSOJY4SE2JIXEMW7BMF5VKLIY4ZMA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.293132979 (197h23m53.252230244s) [noise=true , address=104.36.82.18:4392 , piece_id=DUJGW7SOHIZ6SL36R24TZXK3WWT7FJ5U2IYR6U4LT4BYOCLHSDYA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.318430962 (197h23m53.277528202s) [noise=true , address=104.36.82.60:4353 , piece_id=PKRQ3UTWWSP6K4D6VBTXMKOJWRMRLX27PVE7MXOC7YIJFHDU5OBA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.327035473 (197h23m53.286132717s) [noise=true , address=104.36.82.38:4692 , piece_id=LXH2ORVEJ5Q24P3YY5VE4EFWLAYQS7LVCSJ6UWOV2TEEDYLOEXXQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.338269683 (197h23m53.297366924s) [noise=true , address=45.91.116.13:4161 , piece_id=5SE7HKY7PG2AXVK2PSICMLP3ZNQWUDCNTISZKL7A7MGEIZFICMGQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.352408856 (197h23m53.311506088s) [noise=true , address=45.91.116.12:4253 , piece_id=I5KOLUJN6IOTYWPAVCYXZCXABR36WIQDVG35TDEFMWPSCYS2FNAA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.355334738 (197h23m53.314431976s) [noise=true , address=104.36.82.9:4016 , piece_id=HTRAGHQC26JUSNWBAE4MUGJ7GGD7NDR7H5S6KQ2OVC63GZLYUVYQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.408794808 (197h23m53.367892046s) [noise=true , address=77.90.31.18:4829 , piece_id=SVYXJGIM6K5KO74OELO7YINLHRXUTPHS6RUUGGYJT7PN2IVWUV7A, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.417776712 (197h23m53.376873947s) [noise=true , address=104.36.82.10:4097 , piece_id=GUUN4DD7JPUSO6UVSTQ2QKB2DOES63VXMTI4BLNBJAEQ35AFA47Q, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.430486727 (197h23m53.389583966s) [noise=true , address=77.90.31.15:4728 , piece_id=RNCMK7HNBHWDD7OUQHGLPXDA4AL5IKUIFS7JBMMUJ3MNBKRJXWFA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.489232668 (197h23m53.448329901s) [noise=true , address=104.36.82.16:4308 , piece_id=YUKJ2DOGYXBLFSRUJGDBT6CXTOOETTPNDBFPZUW5E6SEAXQMBAIA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.517002522 (197h23m53.476099767s) [noise=true , address=77.90.31.10:4525 , piece_id=EBOKK6AGP3TNV7DP4L3PIJTUDC4M74EOKLH6IBDBMN7IPR5Q3DOQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.627435127 (197h23m53.586532366s) [noise=true , address=104.36.82.56:4248 , piece_id=TOBE3EZABNRXOGLO3BJ3O4QCWJK4JHS2KYUWYZW6FPFY4TZHPYFA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.627456570 (197h23m53.586553809s) [seg_pos={0 0}, upload=205427]: Segment reached optimal threshold of 14 pieces.
Aug 16 22:49:31.627776426 (197h23m53.586873662s) [noise=true , address=104.36.82.14:4241 , piece_id=YZWFVMVW4RIJL5JUUXOG25ZYQUZZZ3P6FZQ6AFBTRZFI74OBJ2FQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aBy6nQScbjzmBSScfEZwTX8NCcP9c71FRQkUH54WvZhhhtXLR): protocol: expected piece hash; context canceled; EOF
Aug 16 22:49:31.627888126 (197h23m53.586985372s) [noise=true , address=77.90.31.12:4602 , piece_id=OH27WBAU3Z5RZA423JF2DWPZ5CIFRZZDW2CQFA3UB27YMKHKAMHA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf): protocol: expected piece hash; context canceled; EOF
Aug 16 22:49:31.628056687 (197h23m53.587153927s) [noise=true , address=104.36.82.23:4469 , piece_id=JH44FO3YNQALB6M5PRITANN5HRMNVM4RY5BOXM5OFYI35FV3LOWA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection; write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection
Aug 16 22:49:31.628079091 (197h23m53.587176328s) [noise=true , address=104.36.82.47:4540 , piece_id=IBPRQX4YHFT3RTB72A5KAWQLSCBHVA6BDN7POOQSZTADZSKX6XAQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection; write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection
Aug 16 22:49:31.628099133 (197h23m53.587196369s) [seg_pos={0 0}, upload=205427]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 22:49:31.628179292 (197h23m53.587276537s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 22:49:31.628195384 (197h23m53.58729263s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 22:49:31.871260215 (197h23m53.830357485s) [upload=205427]: Done uploading segments...
Aug 16 22:49:31.871286118 (197h23m53.830383351s) [upload=205427]: Upload finished. err: <nil>
Duration: 3.208998064s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.................X.....................X.....X..............] duration:
846.733861ms
FAIL (2025-08-16 22:58:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 22:48:41.883559329 (197h23m3.842656575s) [upload=205414]: Starting upload Aug 16 22:48:41.883616147 (197h23m3.842713394s) [upload=205414]: Done starting upload Aug 16 22:48:41.883698102 (197h23m3.842795348s) [upload=205414]: Uploading segments... Aug 16 22:48:41.883755229 (197h23m3.842853797s) [upload=205414]: Got next segment. Inline: true Aug 16 22:48:41.883763436 (197h23m3.842860682s) [upload=205414]: Waiting for error group managing segments... Aug 16 22:48:41.883813582 (197h23m3.842910831s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 22:48:41.883820508 (197h23m3.842917756s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 22:48:41.883824499 (197h23m3.842921747s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 22:48:41.975827358 (197h23m3.934924614s) [upload=205414]: Done uploading segments... Aug 16 22:48:41.975867347 (197h23m3.934964606s) [upload=205414]: Upload finished. err: metaclient: Too Many Requests
Duration: 846.767167ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
2.952372114s
FAIL (2025-08-16 22:57:44 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 791528b4431efbda984ff105020a1fa3d2f607da7e832f9772a2edd3a26490b0 != before 620c0ab2bcf8776c74e0f2a9a3fd8e53be0a8b505a80ecd7e638870652f42aca
======LOGS======
Aug 16 22:49:30.196418476 (197h23m52.155515707s) [upload=205427]: Starting upload
Aug 16 22:49:30.196474919 (197h23m52.155572164s) [upload=205427]: Done starting upload
Aug 16 22:49:30.196565257 (197h23m52.155662507s) [upload=205427]: Uploading segments...
Aug 16 22:49:30.196743883 (197h23m52.155841115s) [upload=205427]: Got next segment. Inline: false
Aug 16 22:49:30.196780331 (197h23m52.155877577s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 22:49:30.196785188 (197h23m52.155882433s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 22:49:30.483512934 (197h23m52.4426102s) [seg_pos={0 0}, upload=205427]: Begin upload segment...
Aug 16 22:49:30.483571578 (197h23m52.442668816s) [seg_pos={0 0}, upload=205427]: Done begin upload segment.
Aug 16 22:49:30.483607605 (197h23m52.44270485s) [noise=true , address=77.90.31.10:4525 , piece_id=EBOKK6AGP3TNV7DP4L3PIJTUDC4M74EOKLH6IBDBMN7IPR5Q3DOQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.484090730 (197h23m52.443187982s) [noise=true , address=104.36.82.18:4392 , piece_id=DUJGW7SOHIZ6SL36R24TZXK3WWT7FJ5U2IYR6U4LT4BYOCLHSDYA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.484459664 (197h23m52.443556918s) [noise=true , address=104.36.82.47:4540 , piece_id=IBPRQX4YHFT3RTB72A5KAWQLSCBHVA6BDN7POOQSZTADZSKX6XAQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485065081 (197h23m52.444162336s) [noise=true , address=104.36.82.38:4692 , piece_id=LXH2ORVEJ5Q24P3YY5VE4EFWLAYQS7LVCSJ6UWOV2TEEDYLOEXXQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485525349 (197h23m52.4446226s) [noise=true , address=104.36.82.16:4308 , piece_id=YUKJ2DOGYXBLFSRUJGDBT6CXTOOETTPNDBFPZUW5E6SEAXQMBAIA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485891474 (197h23m52.444988729s) [noise=true , address=104.36.82.10:4097 , piece_id=GUUN4DD7JPUSO6UVSTQ2QKB2DOES63VXMTI4BLNBJAEQ35AFA47Q, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486268568 (197h23m52.445365815s) [noise=true , address=104.36.82.20:4463 , piece_id=RYRSSCTL3N4GJYTB7MNMI4PKWR7RXLDZ2YVIXY3ERLCXLKEEP4TQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486639528 (197h23m52.445736776s) [noise=true , address=104.36.82.56:4248 , piece_id=TOBE3EZABNRXOGLO3BJ3O4QCWJK4JHS2KYUWYZW6FPFY4TZHPYFA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486976423 (197h23m52.446073669s) [noise=true , address=104.36.82.60:4353 , piece_id=PKRQ3UTWWSP6K4D6VBTXMKOJWRMRLX27PVE7MXOC7YIJFHDU5OBA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487317315 (197h23m52.446414561s) [noise=true , address=104.36.82.14:4241 , piece_id=YZWFVMVW4RIJL5JUUXOG25ZYQUZZZ3P6FZQ6AFBTRZFI74OBJ2FQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487612071 (197h23m52.446709316s) [noise=true , address=77.90.31.12:4602 , piece_id=OH27WBAU3Z5RZA423JF2DWPZ5CIFRZZDW2CQFA3UB27YMKHKAMHA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487947801 (197h23m52.447045053s) [noise=true , address=77.90.31.18:4829 , piece_id=SVYXJGIM6K5KO74OELO7YINLHRXUTPHS6RUUGGYJT7PN2IVWUV7A, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.488287344 (197h23m52.4473846s) [noise=true , address=104.36.82.2:4756 , piece_id=XHJLCWAJJ7BMONKDD5O55EJZSOJY4SE2JIXEMW7BMF5VKLIY4ZMA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.488683382 (197h23m52.447780635s) [noise=true , address=45.91.116.12:4253 , piece_id=I5KOLUJN6IOTYWPAVCYXZCXABR36WIQDVG35TDEFMWPSCYS2FNAA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489152324 (197h23m52.448249578s) [noise=true , address=104.36.82.23:4469 , piece_id=JH44FO3YNQALB6M5PRITANN5HRMNVM4RY5BOXM5OFYI35FV3LOWA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489533496 (197h23m52.448630753s) [noise=true , address=104.36.82.9:4016 , piece_id=HTRAGHQC26JUSNWBAE4MUGJ7GGD7NDR7H5S6KQ2OVC63GZLYUVYQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489992155 (197h23m52.449089406s) [noise=true , address=77.90.31.15:4728 , piece_id=RNCMK7HNBHWDD7OUQHGLPXDA4AL5IKUIFS7JBMMUJ3MNBKRJXWFA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.490332655 (197h23m52.44942991s) [noise=true , address=45.91.116.13:4161 , piece_id=5SE7HKY7PG2AXVK2PSICMLP3ZNQWUDCNTISZKL7A7MGEIZFICMGQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:31.070138080 (197h23m53.029235317s) [upload=205427]: Next returned nil segment
Aug 16 22:49:31.070156240 (197h23m53.029253485s) [upload=205427]: Waiting for error group managing segments...
Aug 16 22:49:31.244750684 (197h23m53.203847918s) [noise=true , address=104.36.82.20:4463 , piece_id=RYRSSCTL3N4GJYTB7MNMI4PKWR7RXLDZ2YVIXY3ERLCXLKEEP4TQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.273373250 (197h23m53.232470481s) [noise=true , address=104.36.82.2:4756 , piece_id=XHJLCWAJJ7BMONKDD5O55EJZSOJY4SE2JIXEMW7BMF5VKLIY4ZMA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.293132979 (197h23m53.252230244s) [noise=true , address=104.36.82.18:4392 , piece_id=DUJGW7SOHIZ6SL36R24TZXK3WWT7FJ5U2IYR6U4LT4BYOCLHSDYA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.318430962 (197h23m53.277528202s) [noise=true , address=104.36.82.60:4353 , piece_id=PKRQ3UTWWSP6K4D6VBTXMKOJWRMRLX27PVE7MXOC7YIJFHDU5OBA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.327035473 (197h23m53.286132717s) [noise=true , address=104.36.82.38:4692 , piece_id=LXH2ORVEJ5Q24P3YY5VE4EFWLAYQS7LVCSJ6UWOV2TEEDYLOEXXQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.338269683 (197h23m53.297366924s) [noise=true , address=45.91.116.13:4161 , piece_id=5SE7HKY7PG2AXVK2PSICMLP3ZNQWUDCNTISZKL7A7MGEIZFICMGQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.352408856 (197h23m53.311506088s) [noise=true , address=45.91.116.12:4253 , piece_id=I5KOLUJN6IOTYWPAVCYXZCXABR36WIQDVG35TDEFMWPSCYS2FNAA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.355334738 (197h23m53.314431976s) [noise=true , address=104.36.82.9:4016 , piece_id=HTRAGHQC26JUSNWBAE4MUGJ7GGD7NDR7H5S6KQ2OVC63GZLYUVYQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.408794808 (197h23m53.367892046s) [noise=true , address=77.90.31.18:4829 , piece_id=SVYXJGIM6K5KO74OELO7YINLHRXUTPHS6RUUGGYJT7PN2IVWUV7A, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.417776712 (197h23m53.376873947s) [noise=true , address=104.36.82.10:4097 , piece_id=GUUN4DD7JPUSO6UVSTQ2QKB2DOES63VXMTI4BLNBJAEQ35AFA47Q, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.430486727 (197h23m53.389583966s) [noise=true , address=77.90.31.15:4728 , piece_id=RNCMK7HNBHWDD7OUQHGLPXDA4AL5IKUIFS7JBMMUJ3MNBKRJXWFA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.489232668 (197h23m53.448329901s) [noise=true , address=104.36.82.16:4308 , piece_id=YUKJ2DOGYXBLFSRUJGDBT6CXTOOETTPNDBFPZUW5E6SEAXQMBAIA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.517002522 (197h23m53.476099767s) [noise=true , address=77.90.31.10:4525 , piece_id=EBOKK6AGP3TNV7DP4L3PIJTUDC4M74EOKLH6IBDBMN7IPR5Q3DOQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.627435127 (197h23m53.586532366s) [noise=true , address=104.36.82.56:4248 , piece_id=TOBE3EZABNRXOGLO3BJ3O4QCWJK4JHS2KYUWYZW6FPFY4TZHPYFA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.627456570 (197h23m53.586553809s) [seg_pos={0 0}, upload=205427]: Segment reached optimal threshold of 14 pieces.
Aug 16 22:49:31.627776426 (197h23m53.586873662s) [noise=true , address=104.36.82.14:4241 , piece_id=YZWFVMVW4RIJL5JUUXOG25ZYQUZZZ3P6FZQ6AFBTRZFI74OBJ2FQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aBy6nQScbjzmBSScfEZwTX8NCcP9c71FRQkUH54WvZhhhtXLR): protocol: expected piece hash; context canceled; EOF
Aug 16 22:49:31.627888126 (197h23m53.586985372s) [noise=true , address=77.90.31.12:4602 , piece_id=OH27WBAU3Z5RZA423JF2DWPZ5CIFRZZDW2CQFA3UB27YMKHKAMHA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf): protocol: expected piece hash; context canceled; EOF
Aug 16 22:49:31.628056687 (197h23m53.587153927s) [noise=true , address=104.36.82.23:4469 , piece_id=JH44FO3YNQALB6M5PRITANN5HRMNVM4RY5BOXM5OFYI35FV3LOWA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection; write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection
Aug 16 22:49:31.628079091 (197h23m53.587176328s) [noise=true , address=104.36.82.47:4540 , piece_id=IBPRQX4YHFT3RTB72A5KAWQLSCBHVA6BDN7POOQSZTADZSKX6XAQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection; write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection
Aug 16 22:49:31.628099133 (197h23m53.587196369s) [seg_pos={0 0}, upload=205427]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 22:49:31.628179292 (197h23m53.587276537s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 22:49:31.628195384 (197h23m53.58729263s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 22:49:31.871260215 (197h23m53.830357485s) [upload=205427]: Done uploading segments...
Aug 16 22:49:31.871286118 (197h23m53.830383351s) [upload=205427]: Upload finished. err: <nil>
Duration: 2.952458885s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..................X.....................X.....X.............] duration:
887.055588ms
FAIL (2025-08-16 22:56:59 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 22:48:41.883559329 (197h23m3.842656575s) [upload=205414]: Starting upload Aug 16 22:48:41.883616147 (197h23m3.842713394s) [upload=205414]: Done starting upload Aug 16 22:48:41.883698102 (197h23m3.842795348s) [upload=205414]: Uploading segments... Aug 16 22:48:41.883755229 (197h23m3.842853797s) [upload=205414]: Got next segment. Inline: true Aug 16 22:48:41.883763436 (197h23m3.842860682s) [upload=205414]: Waiting for error group managing segments... Aug 16 22:48:41.883813582 (197h23m3.842910831s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 22:48:41.883820508 (197h23m3.842917756s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 22:48:41.883824499 (197h23m3.842921747s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 22:48:41.975827358 (197h23m3.934924614s) [upload=205414]: Done uploading segments... Aug 16 22:48:41.975867347 (197h23m3.934964606s) [upload=205414]: Upload finished. err: metaclient: Too Many Requests
Duration: 887.089183ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
3.187813441s
FAIL (2025-08-16 22:56:54 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 791528b4431efbda984ff105020a1fa3d2f607da7e832f9772a2edd3a26490b0 != before 620c0ab2bcf8776c74e0f2a9a3fd8e53be0a8b505a80ecd7e638870652f42aca
======LOGS======
Aug 16 22:49:30.196418476 (197h23m52.155515707s) [upload=205427]: Starting upload
Aug 16 22:49:30.196474919 (197h23m52.155572164s) [upload=205427]: Done starting upload
Aug 16 22:49:30.196565257 (197h23m52.155662507s) [upload=205427]: Uploading segments...
Aug 16 22:49:30.196743883 (197h23m52.155841115s) [upload=205427]: Got next segment. Inline: false
Aug 16 22:49:30.196780331 (197h23m52.155877577s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 22:49:30.196785188 (197h23m52.155882433s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 22:49:30.483512934 (197h23m52.4426102s) [seg_pos={0 0}, upload=205427]: Begin upload segment...
Aug 16 22:49:30.483571578 (197h23m52.442668816s) [seg_pos={0 0}, upload=205427]: Done begin upload segment.
Aug 16 22:49:30.483607605 (197h23m52.44270485s) [noise=true , address=77.90.31.10:4525 , piece_id=EBOKK6AGP3TNV7DP4L3PIJTUDC4M74EOKLH6IBDBMN7IPR5Q3DOQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.484090730 (197h23m52.443187982s) [noise=true , address=104.36.82.18:4392 , piece_id=DUJGW7SOHIZ6SL36R24TZXK3WWT7FJ5U2IYR6U4LT4BYOCLHSDYA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.484459664 (197h23m52.443556918s) [noise=true , address=104.36.82.47:4540 , piece_id=IBPRQX4YHFT3RTB72A5KAWQLSCBHVA6BDN7POOQSZTADZSKX6XAQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485065081 (197h23m52.444162336s) [noise=true , address=104.36.82.38:4692 , piece_id=LXH2ORVEJ5Q24P3YY5VE4EFWLAYQS7LVCSJ6UWOV2TEEDYLOEXXQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485525349 (197h23m52.4446226s) [noise=true , address=104.36.82.16:4308 , piece_id=YUKJ2DOGYXBLFSRUJGDBT6CXTOOETTPNDBFPZUW5E6SEAXQMBAIA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485891474 (197h23m52.444988729s) [noise=true , address=104.36.82.10:4097 , piece_id=GUUN4DD7JPUSO6UVSTQ2QKB2DOES63VXMTI4BLNBJAEQ35AFA47Q, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486268568 (197h23m52.445365815s) [noise=true , address=104.36.82.20:4463 , piece_id=RYRSSCTL3N4GJYTB7MNMI4PKWR7RXLDZ2YVIXY3ERLCXLKEEP4TQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486639528 (197h23m52.445736776s) [noise=true , address=104.36.82.56:4248 , piece_id=TOBE3EZABNRXOGLO3BJ3O4QCWJK4JHS2KYUWYZW6FPFY4TZHPYFA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486976423 (197h23m52.446073669s) [noise=true , address=104.36.82.60:4353 , piece_id=PKRQ3UTWWSP6K4D6VBTXMKOJWRMRLX27PVE7MXOC7YIJFHDU5OBA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487317315 (197h23m52.446414561s) [noise=true , address=104.36.82.14:4241 , piece_id=YZWFVMVW4RIJL5JUUXOG25ZYQUZZZ3P6FZQ6AFBTRZFI74OBJ2FQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487612071 (197h23m52.446709316s) [noise=true , address=77.90.31.12:4602 , piece_id=OH27WBAU3Z5RZA423JF2DWPZ5CIFRZZDW2CQFA3UB27YMKHKAMHA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487947801 (197h23m52.447045053s) [noise=true , address=77.90.31.18:4829 , piece_id=SVYXJGIM6K5KO74OELO7YINLHRXUTPHS6RUUGGYJT7PN2IVWUV7A, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.488287344 (197h23m52.4473846s) [noise=true , address=104.36.82.2:4756 , piece_id=XHJLCWAJJ7BMONKDD5O55EJZSOJY4SE2JIXEMW7BMF5VKLIY4ZMA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.488683382 (197h23m52.447780635s) [noise=true , address=45.91.116.12:4253 , piece_id=I5KOLUJN6IOTYWPAVCYXZCXABR36WIQDVG35TDEFMWPSCYS2FNAA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489152324 (197h23m52.448249578s) [noise=true , address=104.36.82.23:4469 , piece_id=JH44FO3YNQALB6M5PRITANN5HRMNVM4RY5BOXM5OFYI35FV3LOWA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489533496 (197h23m52.448630753s) [noise=true , address=104.36.82.9:4016 , piece_id=HTRAGHQC26JUSNWBAE4MUGJ7GGD7NDR7H5S6KQ2OVC63GZLYUVYQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489992155 (197h23m52.449089406s) [noise=true , address=77.90.31.15:4728 , piece_id=RNCMK7HNBHWDD7OUQHGLPXDA4AL5IKUIFS7JBMMUJ3MNBKRJXWFA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.490332655 (197h23m52.44942991s) [noise=true , address=45.91.116.13:4161 , piece_id=5SE7HKY7PG2AXVK2PSICMLP3ZNQWUDCNTISZKL7A7MGEIZFICMGQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:31.070138080 (197h23m53.029235317s) [upload=205427]: Next returned nil segment
Aug 16 22:49:31.070156240 (197h23m53.029253485s) [upload=205427]: Waiting for error group managing segments...
Aug 16 22:49:31.244750684 (197h23m53.203847918s) [noise=true , address=104.36.82.20:4463 , piece_id=RYRSSCTL3N4GJYTB7MNMI4PKWR7RXLDZ2YVIXY3ERLCXLKEEP4TQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.273373250 (197h23m53.232470481s) [noise=true , address=104.36.82.2:4756 , piece_id=XHJLCWAJJ7BMONKDD5O55EJZSOJY4SE2JIXEMW7BMF5VKLIY4ZMA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.293132979 (197h23m53.252230244s) [noise=true , address=104.36.82.18:4392 , piece_id=DUJGW7SOHIZ6SL36R24TZXK3WWT7FJ5U2IYR6U4LT4BYOCLHSDYA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.318430962 (197h23m53.277528202s) [noise=true , address=104.36.82.60:4353 , piece_id=PKRQ3UTWWSP6K4D6VBTXMKOJWRMRLX27PVE7MXOC7YIJFHDU5OBA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.327035473 (197h23m53.286132717s) [noise=true , address=104.36.82.38:4692 , piece_id=LXH2ORVEJ5Q24P3YY5VE4EFWLAYQS7LVCSJ6UWOV2TEEDYLOEXXQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.338269683 (197h23m53.297366924s) [noise=true , address=45.91.116.13:4161 , piece_id=5SE7HKY7PG2AXVK2PSICMLP3ZNQWUDCNTISZKL7A7MGEIZFICMGQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.352408856 (197h23m53.311506088s) [noise=true , address=45.91.116.12:4253 , piece_id=I5KOLUJN6IOTYWPAVCYXZCXABR36WIQDVG35TDEFMWPSCYS2FNAA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.355334738 (197h23m53.314431976s) [noise=true , address=104.36.82.9:4016 , piece_id=HTRAGHQC26JUSNWBAE4MUGJ7GGD7NDR7H5S6KQ2OVC63GZLYUVYQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.408794808 (197h23m53.367892046s) [noise=true , address=77.90.31.18:4829 , piece_id=SVYXJGIM6K5KO74OELO7YINLHRXUTPHS6RUUGGYJT7PN2IVWUV7A, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.417776712 (197h23m53.376873947s) [noise=true , address=104.36.82.10:4097 , piece_id=GUUN4DD7JPUSO6UVSTQ2QKB2DOES63VXMTI4BLNBJAEQ35AFA47Q, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.430486727 (197h23m53.389583966s) [noise=true , address=77.90.31.15:4728 , piece_id=RNCMK7HNBHWDD7OUQHGLPXDA4AL5IKUIFS7JBMMUJ3MNBKRJXWFA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.489232668 (197h23m53.448329901s) [noise=true , address=104.36.82.16:4308 , piece_id=YUKJ2DOGYXBLFSRUJGDBT6CXTOOETTPNDBFPZUW5E6SEAXQMBAIA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.517002522 (197h23m53.476099767s) [noise=true , address=77.90.31.10:4525 , piece_id=EBOKK6AGP3TNV7DP4L3PIJTUDC4M74EOKLH6IBDBMN7IPR5Q3DOQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.627435127 (197h23m53.586532366s) [noise=true , address=104.36.82.56:4248 , piece_id=TOBE3EZABNRXOGLO3BJ3O4QCWJK4JHS2KYUWYZW6FPFY4TZHPYFA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.627456570 (197h23m53.586553809s) [seg_pos={0 0}, upload=205427]: Segment reached optimal threshold of 14 pieces.
Aug 16 22:49:31.627776426 (197h23m53.586873662s) [noise=true , address=104.36.82.14:4241 , piece_id=YZWFVMVW4RIJL5JUUXOG25ZYQUZZZ3P6FZQ6AFBTRZFI74OBJ2FQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aBy6nQScbjzmBSScfEZwTX8NCcP9c71FRQkUH54WvZhhhtXLR): protocol: expected piece hash; context canceled; EOF
Aug 16 22:49:31.627888126 (197h23m53.586985372s) [noise=true , address=77.90.31.12:4602 , piece_id=OH27WBAU3Z5RZA423JF2DWPZ5CIFRZZDW2CQFA3UB27YMKHKAMHA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf): protocol: expected piece hash; context canceled; EOF
Aug 16 22:49:31.628056687 (197h23m53.587153927s) [noise=true , address=104.36.82.23:4469 , piece_id=JH44FO3YNQALB6M5PRITANN5HRMNVM4RY5BOXM5OFYI35FV3LOWA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection; write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection
Aug 16 22:49:31.628079091 (197h23m53.587176328s) [noise=true , address=104.36.82.47:4540 , piece_id=IBPRQX4YHFT3RTB72A5KAWQLSCBHVA6BDN7POOQSZTADZSKX6XAQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection; write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection
Aug 16 22:49:31.628099133 (197h23m53.587196369s) [seg_pos={0 0}, upload=205427]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 22:49:31.628179292 (197h23m53.587276537s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 22:49:31.628195384 (197h23m53.58729263s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 22:49:31.871260215 (197h23m53.830357485s) [upload=205427]: Done uploading segments...
Aug 16 22:49:31.871286118 (197h23m53.830383351s) [upload=205427]: Upload finished. err: <nil>
Duration: 3.187848991s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
3.909527515s
FAIL (2025-08-16 22:56:17 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 791528b4431efbda984ff105020a1fa3d2f607da7e832f9772a2edd3a26490b0 != before 620c0ab2bcf8776c74e0f2a9a3fd8e53be0a8b505a80ecd7e638870652f42aca
======LOGS======
Aug 16 22:49:30.196418476 (197h23m52.155515707s) [upload=205427]: Starting upload
Aug 16 22:49:30.196474919 (197h23m52.155572164s) [upload=205427]: Done starting upload
Aug 16 22:49:30.196565257 (197h23m52.155662507s) [upload=205427]: Uploading segments...
Aug 16 22:49:30.196743883 (197h23m52.155841115s) [upload=205427]: Got next segment. Inline: false
Aug 16 22:49:30.196780331 (197h23m52.155877577s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 22:49:30.196785188 (197h23m52.155882433s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 22:49:30.483512934 (197h23m52.4426102s) [seg_pos={0 0}, upload=205427]: Begin upload segment...
Aug 16 22:49:30.483571578 (197h23m52.442668816s) [seg_pos={0 0}, upload=205427]: Done begin upload segment.
Aug 16 22:49:30.483607605 (197h23m52.44270485s) [noise=true , address=77.90.31.10:4525 , piece_id=EBOKK6AGP3TNV7DP4L3PIJTUDC4M74EOKLH6IBDBMN7IPR5Q3DOQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.484090730 (197h23m52.443187982s) [noise=true , address=104.36.82.18:4392 , piece_id=DUJGW7SOHIZ6SL36R24TZXK3WWT7FJ5U2IYR6U4LT4BYOCLHSDYA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.484459664 (197h23m52.443556918s) [noise=true , address=104.36.82.47:4540 , piece_id=IBPRQX4YHFT3RTB72A5KAWQLSCBHVA6BDN7POOQSZTADZSKX6XAQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485065081 (197h23m52.444162336s) [noise=true , address=104.36.82.38:4692 , piece_id=LXH2ORVEJ5Q24P3YY5VE4EFWLAYQS7LVCSJ6UWOV2TEEDYLOEXXQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485525349 (197h23m52.4446226s) [noise=true , address=104.36.82.16:4308 , piece_id=YUKJ2DOGYXBLFSRUJGDBT6CXTOOETTPNDBFPZUW5E6SEAXQMBAIA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485891474 (197h23m52.444988729s) [noise=true , address=104.36.82.10:4097 , piece_id=GUUN4DD7JPUSO6UVSTQ2QKB2DOES63VXMTI4BLNBJAEQ35AFA47Q, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486268568 (197h23m52.445365815s) [noise=true , address=104.36.82.20:4463 , piece_id=RYRSSCTL3N4GJYTB7MNMI4PKWR7RXLDZ2YVIXY3ERLCXLKEEP4TQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486639528 (197h23m52.445736776s) [noise=true , address=104.36.82.56:4248 , piece_id=TOBE3EZABNRXOGLO3BJ3O4QCWJK4JHS2KYUWYZW6FPFY4TZHPYFA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486976423 (197h23m52.446073669s) [noise=true , address=104.36.82.60:4353 , piece_id=PKRQ3UTWWSP6K4D6VBTXMKOJWRMRLX27PVE7MXOC7YIJFHDU5OBA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487317315 (197h23m52.446414561s) [noise=true , address=104.36.82.14:4241 , piece_id=YZWFVMVW4RIJL5JUUXOG25ZYQUZZZ3P6FZQ6AFBTRZFI74OBJ2FQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487612071 (197h23m52.446709316s) [noise=true , address=77.90.31.12:4602 , piece_id=OH27WBAU3Z5RZA423JF2DWPZ5CIFRZZDW2CQFA3UB27YMKHKAMHA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487947801 (197h23m52.447045053s) [noise=true , address=77.90.31.18:4829 , piece_id=SVYXJGIM6K5KO74OELO7YINLHRXUTPHS6RUUGGYJT7PN2IVWUV7A, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.488287344 (197h23m52.4473846s) [noise=true , address=104.36.82.2:4756 , piece_id=XHJLCWAJJ7BMONKDD5O55EJZSOJY4SE2JIXEMW7BMF5VKLIY4ZMA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.488683382 (197h23m52.447780635s) [noise=true , address=45.91.116.12:4253 , piece_id=I5KOLUJN6IOTYWPAVCYXZCXABR36WIQDVG35TDEFMWPSCYS2FNAA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489152324 (197h23m52.448249578s) [noise=true , address=104.36.82.23:4469 , piece_id=JH44FO3YNQALB6M5PRITANN5HRMNVM4RY5BOXM5OFYI35FV3LOWA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489533496 (197h23m52.448630753s) [noise=true , address=104.36.82.9:4016 , piece_id=HTRAGHQC26JUSNWBAE4MUGJ7GGD7NDR7H5S6KQ2OVC63GZLYUVYQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489992155 (197h23m52.449089406s) [noise=true , address=77.90.31.15:4728 , piece_id=RNCMK7HNBHWDD7OUQHGLPXDA4AL5IKUIFS7JBMMUJ3MNBKRJXWFA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.490332655 (197h23m52.44942991s) [noise=true , address=45.91.116.13:4161 , piece_id=5SE7HKY7PG2AXVK2PSICMLP3ZNQWUDCNTISZKL7A7MGEIZFICMGQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:31.070138080 (197h23m53.029235317s) [upload=205427]: Next returned nil segment
Aug 16 22:49:31.070156240 (197h23m53.029253485s) [upload=205427]: Waiting for error group managing segments...
Aug 16 22:49:31.244750684 (197h23m53.203847918s) [noise=true , address=104.36.82.20:4463 , piece_id=RYRSSCTL3N4GJYTB7MNMI4PKWR7RXLDZ2YVIXY3ERLCXLKEEP4TQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.273373250 (197h23m53.232470481s) [noise=true , address=104.36.82.2:4756 , piece_id=XHJLCWAJJ7BMONKDD5O55EJZSOJY4SE2JIXEMW7BMF5VKLIY4ZMA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.293132979 (197h23m53.252230244s) [noise=true , address=104.36.82.18:4392 , piece_id=DUJGW7SOHIZ6SL36R24TZXK3WWT7FJ5U2IYR6U4LT4BYOCLHSDYA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.318430962 (197h23m53.277528202s) [noise=true , address=104.36.82.60:4353 , piece_id=PKRQ3UTWWSP6K4D6VBTXMKOJWRMRLX27PVE7MXOC7YIJFHDU5OBA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.327035473 (197h23m53.286132717s) [noise=true , address=104.36.82.38:4692 , piece_id=LXH2ORVEJ5Q24P3YY5VE4EFWLAYQS7LVCSJ6UWOV2TEEDYLOEXXQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.338269683 (197h23m53.297366924s) [noise=true , address=45.91.116.13:4161 , piece_id=5SE7HKY7PG2AXVK2PSICMLP3ZNQWUDCNTISZKL7A7MGEIZFICMGQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.352408856 (197h23m53.311506088s) [noise=true , address=45.91.116.12:4253 , piece_id=I5KOLUJN6IOTYWPAVCYXZCXABR36WIQDVG35TDEFMWPSCYS2FNAA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.355334738 (197h23m53.314431976s) [noise=true , address=104.36.82.9:4016 , piece_id=HTRAGHQC26JUSNWBAE4MUGJ7GGD7NDR7H5S6KQ2OVC63GZLYUVYQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.408794808 (197h23m53.367892046s) [noise=true , address=77.90.31.18:4829 , piece_id=SVYXJGIM6K5KO74OELO7YINLHRXUTPHS6RUUGGYJT7PN2IVWUV7A, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.417776712 (197h23m53.376873947s) [noise=true , address=104.36.82.10:4097 , piece_id=GUUN4DD7JPUSO6UVSTQ2QKB2DOES63VXMTI4BLNBJAEQ35AFA47Q, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.430486727 (197h23m53.389583966s) [noise=true , address=77.90.31.15:4728 , piece_id=RNCMK7HNBHWDD7OUQHGLPXDA4AL5IKUIFS7JBMMUJ3MNBKRJXWFA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.489232668 (197h23m53.448329901s) [noise=true , address=104.36.82.16:4308 , piece_id=YUKJ2DOGYXBLFSRUJGDBT6CXTOOETTPNDBFPZUW5E6SEAXQMBAIA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.517002522 (197h23m53.476099767s) [noise=true , address=77.90.31.10:4525 , piece_id=EBOKK6AGP3TNV7DP4L3PIJTUDC4M74EOKLH6IBDBMN7IPR5Q3DOQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.627435127 (197h23m53.586532366s) [noise=true , address=104.36.82.56:4248 , piece_id=TOBE3EZABNRXOGLO3BJ3O4QCWJK4JHS2KYUWYZW6FPFY4TZHPYFA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.627456570 (197h23m53.586553809s) [seg_pos={0 0}, upload=205427]: Segment reached optimal threshold of 14 pieces.
Aug 16 22:49:31.627776426 (197h23m53.586873662s) [noise=true , address=104.36.82.14:4241 , piece_id=YZWFVMVW4RIJL5JUUXOG25ZYQUZZZ3P6FZQ6AFBTRZFI74OBJ2FQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aBy6nQScbjzmBSScfEZwTX8NCcP9c71FRQkUH54WvZhhhtXLR): protocol: expected piece hash; context canceled; EOF
Aug 16 22:49:31.627888126 (197h23m53.586985372s) [noise=true , address=77.90.31.12:4602 , piece_id=OH27WBAU3Z5RZA423JF2DWPZ5CIFRZZDW2CQFA3UB27YMKHKAMHA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf): protocol: expected piece hash; context canceled; EOF
Aug 16 22:49:31.628056687 (197h23m53.587153927s) [noise=true , address=104.36.82.23:4469 , piece_id=JH44FO3YNQALB6M5PRITANN5HRMNVM4RY5BOXM5OFYI35FV3LOWA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection; write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection
Aug 16 22:49:31.628079091 (197h23m53.587176328s) [noise=true , address=104.36.82.47:4540 , piece_id=IBPRQX4YHFT3RTB72A5KAWQLSCBHVA6BDN7POOQSZTADZSKX6XAQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection; write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection
Aug 16 22:49:31.628099133 (197h23m53.587196369s) [seg_pos={0 0}, upload=205427]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 22:49:31.628179292 (197h23m53.587276537s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 22:49:31.628195384 (197h23m53.58729263s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 22:49:31.871260215 (197h23m53.830357485s) [upload=205427]: Done uploading segments...
Aug 16 22:49:31.871286118 (197h23m53.830383351s) [upload=205427]: Upload finished. err: <nil>
Duration: 3.90956463s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...................X.....................X.....X............] duration:
1.946695806s
FAIL (2025-08-16 22:56:16 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 22:48:41.883559329 (197h23m3.842656575s) [upload=205414]: Starting upload Aug 16 22:48:41.883616147 (197h23m3.842713394s) [upload=205414]: Done starting upload Aug 16 22:48:41.883698102 (197h23m3.842795348s) [upload=205414]: Uploading segments... Aug 16 22:48:41.883755229 (197h23m3.842853797s) [upload=205414]: Got next segment. Inline: true Aug 16 22:48:41.883763436 (197h23m3.842860682s) [upload=205414]: Waiting for error group managing segments... Aug 16 22:48:41.883813582 (197h23m3.842910831s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 22:48:41.883820508 (197h23m3.842917756s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 22:48:41.883824499 (197h23m3.842921747s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 22:48:41.975827358 (197h23m3.934924614s) [upload=205414]: Done uploading segments... Aug 16 22:48:41.975867347 (197h23m3.934964606s) [upload=205414]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.946747646s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....................X.....................X.....X...........] duration:
838.8352ms
FAIL (2025-08-16 22:55:58 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 22:48:41.883559329 (197h23m3.842656575s) [upload=205414]: Starting upload Aug 16 22:48:41.883616147 (197h23m3.842713394s) [upload=205414]: Done starting upload Aug 16 22:48:41.883698102 (197h23m3.842795348s) [upload=205414]: Uploading segments... Aug 16 22:48:41.883755229 (197h23m3.842853797s) [upload=205414]: Got next segment. Inline: true Aug 16 22:48:41.883763436 (197h23m3.842860682s) [upload=205414]: Waiting for error group managing segments... Aug 16 22:48:41.883813582 (197h23m3.842910831s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 22:48:41.883820508 (197h23m3.842917756s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 22:48:41.883824499 (197h23m3.842921747s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 22:48:41.975827358 (197h23m3.934924614s) [upload=205414]: Done uploading segments... Aug 16 22:48:41.975867347 (197h23m3.934964606s) [upload=205414]: Upload finished. err: metaclient: Too Many Requests
Duration: 838.93696ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
2.645788737s
FAIL (2025-08-16 22:55:39 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 791528b4431efbda984ff105020a1fa3d2f607da7e832f9772a2edd3a26490b0 != before 620c0ab2bcf8776c74e0f2a9a3fd8e53be0a8b505a80ecd7e638870652f42aca
======LOGS======
Aug 16 22:49:30.196418476 (197h23m52.155515707s) [upload=205427]: Starting upload
Aug 16 22:49:30.196474919 (197h23m52.155572164s) [upload=205427]: Done starting upload
Aug 16 22:49:30.196565257 (197h23m52.155662507s) [upload=205427]: Uploading segments...
Aug 16 22:49:30.196743883 (197h23m52.155841115s) [upload=205427]: Got next segment. Inline: false
Aug 16 22:49:30.196780331 (197h23m52.155877577s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 22:49:30.196785188 (197h23m52.155882433s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 22:49:30.483512934 (197h23m52.4426102s) [seg_pos={0 0}, upload=205427]: Begin upload segment...
Aug 16 22:49:30.483571578 (197h23m52.442668816s) [seg_pos={0 0}, upload=205427]: Done begin upload segment.
Aug 16 22:49:30.483607605 (197h23m52.44270485s) [noise=true , address=77.90.31.10:4525 , piece_id=EBOKK6AGP3TNV7DP4L3PIJTUDC4M74EOKLH6IBDBMN7IPR5Q3DOQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.484090730 (197h23m52.443187982s) [noise=true , address=104.36.82.18:4392 , piece_id=DUJGW7SOHIZ6SL36R24TZXK3WWT7FJ5U2IYR6U4LT4BYOCLHSDYA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.484459664 (197h23m52.443556918s) [noise=true , address=104.36.82.47:4540 , piece_id=IBPRQX4YHFT3RTB72A5KAWQLSCBHVA6BDN7POOQSZTADZSKX6XAQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485065081 (197h23m52.444162336s) [noise=true , address=104.36.82.38:4692 , piece_id=LXH2ORVEJ5Q24P3YY5VE4EFWLAYQS7LVCSJ6UWOV2TEEDYLOEXXQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485525349 (197h23m52.4446226s) [noise=true , address=104.36.82.16:4308 , piece_id=YUKJ2DOGYXBLFSRUJGDBT6CXTOOETTPNDBFPZUW5E6SEAXQMBAIA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485891474 (197h23m52.444988729s) [noise=true , address=104.36.82.10:4097 , piece_id=GUUN4DD7JPUSO6UVSTQ2QKB2DOES63VXMTI4BLNBJAEQ35AFA47Q, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486268568 (197h23m52.445365815s) [noise=true , address=104.36.82.20:4463 , piece_id=RYRSSCTL3N4GJYTB7MNMI4PKWR7RXLDZ2YVIXY3ERLCXLKEEP4TQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486639528 (197h23m52.445736776s) [noise=true , address=104.36.82.56:4248 , piece_id=TOBE3EZABNRXOGLO3BJ3O4QCWJK4JHS2KYUWYZW6FPFY4TZHPYFA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486976423 (197h23m52.446073669s) [noise=true , address=104.36.82.60:4353 , piece_id=PKRQ3UTWWSP6K4D6VBTXMKOJWRMRLX27PVE7MXOC7YIJFHDU5OBA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487317315 (197h23m52.446414561s) [noise=true , address=104.36.82.14:4241 , piece_id=YZWFVMVW4RIJL5JUUXOG25ZYQUZZZ3P6FZQ6AFBTRZFI74OBJ2FQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487612071 (197h23m52.446709316s) [noise=true , address=77.90.31.12:4602 , piece_id=OH27WBAU3Z5RZA423JF2DWPZ5CIFRZZDW2CQFA3UB27YMKHKAMHA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487947801 (197h23m52.447045053s) [noise=true , address=77.90.31.18:4829 , piece_id=SVYXJGIM6K5KO74OELO7YINLHRXUTPHS6RUUGGYJT7PN2IVWUV7A, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.488287344 (197h23m52.4473846s) [noise=true , address=104.36.82.2:4756 , piece_id=XHJLCWAJJ7BMONKDD5O55EJZSOJY4SE2JIXEMW7BMF5VKLIY4ZMA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.488683382 (197h23m52.447780635s) [noise=true , address=45.91.116.12:4253 , piece_id=I5KOLUJN6IOTYWPAVCYXZCXABR36WIQDVG35TDEFMWPSCYS2FNAA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489152324 (197h23m52.448249578s) [noise=true , address=104.36.82.23:4469 , piece_id=JH44FO3YNQALB6M5PRITANN5HRMNVM4RY5BOXM5OFYI35FV3LOWA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489533496 (197h23m52.448630753s) [noise=true , address=104.36.82.9:4016 , piece_id=HTRAGHQC26JUSNWBAE4MUGJ7GGD7NDR7H5S6KQ2OVC63GZLYUVYQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489992155 (197h23m52.449089406s) [noise=true , address=77.90.31.15:4728 , piece_id=RNCMK7HNBHWDD7OUQHGLPXDA4AL5IKUIFS7JBMMUJ3MNBKRJXWFA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.490332655 (197h23m52.44942991s) [noise=true , address=45.91.116.13:4161 , piece_id=5SE7HKY7PG2AXVK2PSICMLP3ZNQWUDCNTISZKL7A7MGEIZFICMGQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:31.070138080 (197h23m53.029235317s) [upload=205427]: Next returned nil segment
Aug 16 22:49:31.070156240 (197h23m53.029253485s) [upload=205427]: Waiting for error group managing segments...
Aug 16 22:49:31.244750684 (197h23m53.203847918s) [noise=true , address=104.36.82.20:4463 , piece_id=RYRSSCTL3N4GJYTB7MNMI4PKWR7RXLDZ2YVIXY3ERLCXLKEEP4TQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.273373250 (197h23m53.232470481s) [noise=true , address=104.36.82.2:4756 , piece_id=XHJLCWAJJ7BMONKDD5O55EJZSOJY4SE2JIXEMW7BMF5VKLIY4ZMA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.293132979 (197h23m53.252230244s) [noise=true , address=104.36.82.18:4392 , piece_id=DUJGW7SOHIZ6SL36R24TZXK3WWT7FJ5U2IYR6U4LT4BYOCLHSDYA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.318430962 (197h23m53.277528202s) [noise=true , address=104.36.82.60:4353 , piece_id=PKRQ3UTWWSP6K4D6VBTXMKOJWRMRLX27PVE7MXOC7YIJFHDU5OBA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.327035473 (197h23m53.286132717s) [noise=true , address=104.36.82.38:4692 , piece_id=LXH2ORVEJ5Q24P3YY5VE4EFWLAYQS7LVCSJ6UWOV2TEEDYLOEXXQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.338269683 (197h23m53.297366924s) [noise=true , address=45.91.116.13:4161 , piece_id=5SE7HKY7PG2AXVK2PSICMLP3ZNQWUDCNTISZKL7A7MGEIZFICMGQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.352408856 (197h23m53.311506088s) [noise=true , address=45.91.116.12:4253 , piece_id=I5KOLUJN6IOTYWPAVCYXZCXABR36WIQDVG35TDEFMWPSCYS2FNAA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.355334738 (197h23m53.314431976s) [noise=true , address=104.36.82.9:4016 , piece_id=HTRAGHQC26JUSNWBAE4MUGJ7GGD7NDR7H5S6KQ2OVC63GZLYUVYQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.408794808 (197h23m53.367892046s) [noise=true , address=77.90.31.18:4829 , piece_id=SVYXJGIM6K5KO74OELO7YINLHRXUTPHS6RUUGGYJT7PN2IVWUV7A, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.417776712 (197h23m53.376873947s) [noise=true , address=104.36.82.10:4097 , piece_id=GUUN4DD7JPUSO6UVSTQ2QKB2DOES63VXMTI4BLNBJAEQ35AFA47Q, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.430486727 (197h23m53.389583966s) [noise=true , address=77.90.31.15:4728 , piece_id=RNCMK7HNBHWDD7OUQHGLPXDA4AL5IKUIFS7JBMMUJ3MNBKRJXWFA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.489232668 (197h23m53.448329901s) [noise=true , address=104.36.82.16:4308 , piece_id=YUKJ2DOGYXBLFSRUJGDBT6CXTOOETTPNDBFPZUW5E6SEAXQMBAIA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.517002522 (197h23m53.476099767s) [noise=true , address=77.90.31.10:4525 , piece_id=EBOKK6AGP3TNV7DP4L3PIJTUDC4M74EOKLH6IBDBMN7IPR5Q3DOQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.627435127 (197h23m53.586532366s) [noise=true , address=104.36.82.56:4248 , piece_id=TOBE3EZABNRXOGLO3BJ3O4QCWJK4JHS2KYUWYZW6FPFY4TZHPYFA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.627456570 (197h23m53.586553809s) [seg_pos={0 0}, upload=205427]: Segment reached optimal threshold of 14 pieces.
Aug 16 22:49:31.627776426 (197h23m53.586873662s) [noise=true , address=104.36.82.14:4241 , piece_id=YZWFVMVW4RIJL5JUUXOG25ZYQUZZZ3P6FZQ6AFBTRZFI74OBJ2FQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aBy6nQScbjzmBSScfEZwTX8NCcP9c71FRQkUH54WvZhhhtXLR): protocol: expected piece hash; context canceled; EOF
Aug 16 22:49:31.627888126 (197h23m53.586985372s) [noise=true , address=77.90.31.12:4602 , piece_id=OH27WBAU3Z5RZA423JF2DWPZ5CIFRZZDW2CQFA3UB27YMKHKAMHA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf): protocol: expected piece hash; context canceled; EOF
Aug 16 22:49:31.628056687 (197h23m53.587153927s) [noise=true , address=104.36.82.23:4469 , piece_id=JH44FO3YNQALB6M5PRITANN5HRMNVM4RY5BOXM5OFYI35FV3LOWA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection; write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection
Aug 16 22:49:31.628079091 (197h23m53.587176328s) [noise=true , address=104.36.82.47:4540 , piece_id=IBPRQX4YHFT3RTB72A5KAWQLSCBHVA6BDN7POOQSZTADZSKX6XAQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection; write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection
Aug 16 22:49:31.628099133 (197h23m53.587196369s) [seg_pos={0 0}, upload=205427]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 22:49:31.628179292 (197h23m53.587276537s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 22:49:31.628195384 (197h23m53.58729263s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 22:49:31.871260215 (197h23m53.830357485s) [upload=205427]: Done uploading segments...
Aug 16 22:49:31.871286118 (197h23m53.830383351s) [upload=205427]: Upload finished. err: <nil>
Duration: 2.645844583s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....................X.....................X.....X..........] duration:
902.822146ms
FAIL (2025-08-16 22:55:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 22:48:41.883559329 (197h23m3.842656575s) [upload=205414]: Starting upload Aug 16 22:48:41.883616147 (197h23m3.842713394s) [upload=205414]: Done starting upload Aug 16 22:48:41.883698102 (197h23m3.842795348s) [upload=205414]: Uploading segments... Aug 16 22:48:41.883755229 (197h23m3.842853797s) [upload=205414]: Got next segment. Inline: true Aug 16 22:48:41.883763436 (197h23m3.842860682s) [upload=205414]: Waiting for error group managing segments... Aug 16 22:48:41.883813582 (197h23m3.842910831s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 22:48:41.883820508 (197h23m3.842917756s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 22:48:41.883824499 (197h23m3.842921747s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 22:48:41.975827358 (197h23m3.934924614s) [upload=205414]: Done uploading segments... Aug 16 22:48:41.975867347 (197h23m3.934964606s) [upload=205414]: Upload finished. err: metaclient: Too Many Requests
Duration: 902.852713ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
2.99782637s
FAIL (2025-08-16 22:54:34 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 791528b4431efbda984ff105020a1fa3d2f607da7e832f9772a2edd3a26490b0 != before 620c0ab2bcf8776c74e0f2a9a3fd8e53be0a8b505a80ecd7e638870652f42aca
======LOGS======
Aug 16 22:49:30.196418476 (197h23m52.155515707s) [upload=205427]: Starting upload
Aug 16 22:49:30.196474919 (197h23m52.155572164s) [upload=205427]: Done starting upload
Aug 16 22:49:30.196565257 (197h23m52.155662507s) [upload=205427]: Uploading segments...
Aug 16 22:49:30.196743883 (197h23m52.155841115s) [upload=205427]: Got next segment. Inline: false
Aug 16 22:49:30.196780331 (197h23m52.155877577s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 22:49:30.196785188 (197h23m52.155882433s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 22:49:30.483512934 (197h23m52.4426102s) [seg_pos={0 0}, upload=205427]: Begin upload segment...
Aug 16 22:49:30.483571578 (197h23m52.442668816s) [seg_pos={0 0}, upload=205427]: Done begin upload segment.
Aug 16 22:49:30.483607605 (197h23m52.44270485s) [noise=true , address=77.90.31.10:4525 , piece_id=EBOKK6AGP3TNV7DP4L3PIJTUDC4M74EOKLH6IBDBMN7IPR5Q3DOQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.484090730 (197h23m52.443187982s) [noise=true , address=104.36.82.18:4392 , piece_id=DUJGW7SOHIZ6SL36R24TZXK3WWT7FJ5U2IYR6U4LT4BYOCLHSDYA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.484459664 (197h23m52.443556918s) [noise=true , address=104.36.82.47:4540 , piece_id=IBPRQX4YHFT3RTB72A5KAWQLSCBHVA6BDN7POOQSZTADZSKX6XAQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485065081 (197h23m52.444162336s) [noise=true , address=104.36.82.38:4692 , piece_id=LXH2ORVEJ5Q24P3YY5VE4EFWLAYQS7LVCSJ6UWOV2TEEDYLOEXXQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485525349 (197h23m52.4446226s) [noise=true , address=104.36.82.16:4308 , piece_id=YUKJ2DOGYXBLFSRUJGDBT6CXTOOETTPNDBFPZUW5E6SEAXQMBAIA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485891474 (197h23m52.444988729s) [noise=true , address=104.36.82.10:4097 , piece_id=GUUN4DD7JPUSO6UVSTQ2QKB2DOES63VXMTI4BLNBJAEQ35AFA47Q, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486268568 (197h23m52.445365815s) [noise=true , address=104.36.82.20:4463 , piece_id=RYRSSCTL3N4GJYTB7MNMI4PKWR7RXLDZ2YVIXY3ERLCXLKEEP4TQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486639528 (197h23m52.445736776s) [noise=true , address=104.36.82.56:4248 , piece_id=TOBE3EZABNRXOGLO3BJ3O4QCWJK4JHS2KYUWYZW6FPFY4TZHPYFA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486976423 (197h23m52.446073669s) [noise=true , address=104.36.82.60:4353 , piece_id=PKRQ3UTWWSP6K4D6VBTXMKOJWRMRLX27PVE7MXOC7YIJFHDU5OBA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487317315 (197h23m52.446414561s) [noise=true , address=104.36.82.14:4241 , piece_id=YZWFVMVW4RIJL5JUUXOG25ZYQUZZZ3P6FZQ6AFBTRZFI74OBJ2FQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487612071 (197h23m52.446709316s) [noise=true , address=77.90.31.12:4602 , piece_id=OH27WBAU3Z5RZA423JF2DWPZ5CIFRZZDW2CQFA3UB27YMKHKAMHA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487947801 (197h23m52.447045053s) [noise=true , address=77.90.31.18:4829 , piece_id=SVYXJGIM6K5KO74OELO7YINLHRXUTPHS6RUUGGYJT7PN2IVWUV7A, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.488287344 (197h23m52.4473846s) [noise=true , address=104.36.82.2:4756 , piece_id=XHJLCWAJJ7BMONKDD5O55EJZSOJY4SE2JIXEMW7BMF5VKLIY4ZMA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.488683382 (197h23m52.447780635s) [noise=true , address=45.91.116.12:4253 , piece_id=I5KOLUJN6IOTYWPAVCYXZCXABR36WIQDVG35TDEFMWPSCYS2FNAA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489152324 (197h23m52.448249578s) [noise=true , address=104.36.82.23:4469 , piece_id=JH44FO3YNQALB6M5PRITANN5HRMNVM4RY5BOXM5OFYI35FV3LOWA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489533496 (197h23m52.448630753s) [noise=true , address=104.36.82.9:4016 , piece_id=HTRAGHQC26JUSNWBAE4MUGJ7GGD7NDR7H5S6KQ2OVC63GZLYUVYQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489992155 (197h23m52.449089406s) [noise=true , address=77.90.31.15:4728 , piece_id=RNCMK7HNBHWDD7OUQHGLPXDA4AL5IKUIFS7JBMMUJ3MNBKRJXWFA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.490332655 (197h23m52.44942991s) [noise=true , address=45.91.116.13:4161 , piece_id=5SE7HKY7PG2AXVK2PSICMLP3ZNQWUDCNTISZKL7A7MGEIZFICMGQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:31.070138080 (197h23m53.029235317s) [upload=205427]: Next returned nil segment
Aug 16 22:49:31.070156240 (197h23m53.029253485s) [upload=205427]: Waiting for error group managing segments...
Aug 16 22:49:31.244750684 (197h23m53.203847918s) [noise=true , address=104.36.82.20:4463 , piece_id=RYRSSCTL3N4GJYTB7MNMI4PKWR7RXLDZ2YVIXY3ERLCXLKEEP4TQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.273373250 (197h23m53.232470481s) [noise=true , address=104.36.82.2:4756 , piece_id=XHJLCWAJJ7BMONKDD5O55EJZSOJY4SE2JIXEMW7BMF5VKLIY4ZMA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.293132979 (197h23m53.252230244s) [noise=true , address=104.36.82.18:4392 , piece_id=DUJGW7SOHIZ6SL36R24TZXK3WWT7FJ5U2IYR6U4LT4BYOCLHSDYA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.318430962 (197h23m53.277528202s) [noise=true , address=104.36.82.60:4353 , piece_id=PKRQ3UTWWSP6K4D6VBTXMKOJWRMRLX27PVE7MXOC7YIJFHDU5OBA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.327035473 (197h23m53.286132717s) [noise=true , address=104.36.82.38:4692 , piece_id=LXH2ORVEJ5Q24P3YY5VE4EFWLAYQS7LVCSJ6UWOV2TEEDYLOEXXQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.338269683 (197h23m53.297366924s) [noise=true , address=45.91.116.13:4161 , piece_id=5SE7HKY7PG2AXVK2PSICMLP3ZNQWUDCNTISZKL7A7MGEIZFICMGQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.352408856 (197h23m53.311506088s) [noise=true , address=45.91.116.12:4253 , piece_id=I5KOLUJN6IOTYWPAVCYXZCXABR36WIQDVG35TDEFMWPSCYS2FNAA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.355334738 (197h23m53.314431976s) [noise=true , address=104.36.82.9:4016 , piece_id=HTRAGHQC26JUSNWBAE4MUGJ7GGD7NDR7H5S6KQ2OVC63GZLYUVYQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.408794808 (197h23m53.367892046s) [noise=true , address=77.90.31.18:4829 , piece_id=SVYXJGIM6K5KO74OELO7YINLHRXUTPHS6RUUGGYJT7PN2IVWUV7A, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.417776712 (197h23m53.376873947s) [noise=true , address=104.36.82.10:4097 , piece_id=GUUN4DD7JPUSO6UVSTQ2QKB2DOES63VXMTI4BLNBJAEQ35AFA47Q, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.430486727 (197h23m53.389583966s) [noise=true , address=77.90.31.15:4728 , piece_id=RNCMK7HNBHWDD7OUQHGLPXDA4AL5IKUIFS7JBMMUJ3MNBKRJXWFA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.489232668 (197h23m53.448329901s) [noise=true , address=104.36.82.16:4308 , piece_id=YUKJ2DOGYXBLFSRUJGDBT6CXTOOETTPNDBFPZUW5E6SEAXQMBAIA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.517002522 (197h23m53.476099767s) [noise=true , address=77.90.31.10:4525 , piece_id=EBOKK6AGP3TNV7DP4L3PIJTUDC4M74EOKLH6IBDBMN7IPR5Q3DOQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.627435127 (197h23m53.586532366s) [noise=true , address=104.36.82.56:4248 , piece_id=TOBE3EZABNRXOGLO3BJ3O4QCWJK4JHS2KYUWYZW6FPFY4TZHPYFA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.627456570 (197h23m53.586553809s) [seg_pos={0 0}, upload=205427]: Segment reached optimal threshold of 14 pieces.
Aug 16 22:49:31.627776426 (197h23m53.586873662s) [noise=true , address=104.36.82.14:4241 , piece_id=YZWFVMVW4RIJL5JUUXOG25ZYQUZZZ3P6FZQ6AFBTRZFI74OBJ2FQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aBy6nQScbjzmBSScfEZwTX8NCcP9c71FRQkUH54WvZhhhtXLR): protocol: expected piece hash; context canceled; EOF
Aug 16 22:49:31.627888126 (197h23m53.586985372s) [noise=true , address=77.90.31.12:4602 , piece_id=OH27WBAU3Z5RZA423JF2DWPZ5CIFRZZDW2CQFA3UB27YMKHKAMHA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf): protocol: expected piece hash; context canceled; EOF
Aug 16 22:49:31.628056687 (197h23m53.587153927s) [noise=true , address=104.36.82.23:4469 , piece_id=JH44FO3YNQALB6M5PRITANN5HRMNVM4RY5BOXM5OFYI35FV3LOWA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection; write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection
Aug 16 22:49:31.628079091 (197h23m53.587176328s) [noise=true , address=104.36.82.47:4540 , piece_id=IBPRQX4YHFT3RTB72A5KAWQLSCBHVA6BDN7POOQSZTADZSKX6XAQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection; write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection
Aug 16 22:49:31.628099133 (197h23m53.587196369s) [seg_pos={0 0}, upload=205427]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 22:49:31.628179292 (197h23m53.587276537s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 22:49:31.628195384 (197h23m53.58729263s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 22:49:31.871260215 (197h23m53.830357485s) [upload=205427]: Done uploading segments...
Aug 16 22:49:31.871286118 (197h23m53.830383351s) [upload=205427]: Upload finished. err: <nil>
Duration: 2.997990272s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [X.....................X.....................X.....X.........] duration:
877.522707ms
FAIL (2025-08-16 22:54:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 22:48:41.883559329 (197h23m3.842656575s) [upload=205414]: Starting upload Aug 16 22:48:41.883616147 (197h23m3.842713394s) [upload=205414]: Done starting upload Aug 16 22:48:41.883698102 (197h23m3.842795348s) [upload=205414]: Uploading segments... Aug 16 22:48:41.883755229 (197h23m3.842853797s) [upload=205414]: Got next segment. Inline: true Aug 16 22:48:41.883763436 (197h23m3.842860682s) [upload=205414]: Waiting for error group managing segments... Aug 16 22:48:41.883813582 (197h23m3.842910831s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 22:48:41.883820508 (197h23m3.842917756s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 22:48:41.883824499 (197h23m3.842921747s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 22:48:41.975827358 (197h23m3.934924614s) [upload=205414]: Done uploading segments... Aug 16 22:48:41.975867347 (197h23m3.934964606s) [upload=205414]: Upload finished. err: metaclient: Too Many Requests
Duration: 877.552047ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.X.....................X.....................X.....X........] duration:
2.2774995s
FAIL (2025-08-16 22:54:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 22:48:41.883559329 (197h23m3.842656575s) [upload=205414]: Starting upload Aug 16 22:48:41.883616147 (197h23m3.842713394s) [upload=205414]: Done starting upload Aug 16 22:48:41.883698102 (197h23m3.842795348s) [upload=205414]: Uploading segments... Aug 16 22:48:41.883755229 (197h23m3.842853797s) [upload=205414]: Got next segment. Inline: true Aug 16 22:48:41.883763436 (197h23m3.842860682s) [upload=205414]: Waiting for error group managing segments... Aug 16 22:48:41.883813582 (197h23m3.842910831s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 22:48:41.883820508 (197h23m3.842917756s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 22:48:41.883824499 (197h23m3.842921747s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 22:48:41.975827358 (197h23m3.934924614s) [upload=205414]: Done uploading segments... Aug 16 22:48:41.975867347 (197h23m3.934964606s) [upload=205414]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.277519607s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
3.058324849s
FAIL (2025-08-16 22:53:52 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 791528b4431efbda984ff105020a1fa3d2f607da7e832f9772a2edd3a26490b0 != before 620c0ab2bcf8776c74e0f2a9a3fd8e53be0a8b505a80ecd7e638870652f42aca
======LOGS======
Aug 16 22:49:30.196418476 (197h23m52.155515707s) [upload=205427]: Starting upload
Aug 16 22:49:30.196474919 (197h23m52.155572164s) [upload=205427]: Done starting upload
Aug 16 22:49:30.196565257 (197h23m52.155662507s) [upload=205427]: Uploading segments...
Aug 16 22:49:30.196743883 (197h23m52.155841115s) [upload=205427]: Got next segment. Inline: false
Aug 16 22:49:30.196780331 (197h23m52.155877577s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 22:49:30.196785188 (197h23m52.155882433s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 22:49:30.483512934 (197h23m52.4426102s) [seg_pos={0 0}, upload=205427]: Begin upload segment...
Aug 16 22:49:30.483571578 (197h23m52.442668816s) [seg_pos={0 0}, upload=205427]: Done begin upload segment.
Aug 16 22:49:30.483607605 (197h23m52.44270485s) [noise=true , address=77.90.31.10:4525 , piece_id=EBOKK6AGP3TNV7DP4L3PIJTUDC4M74EOKLH6IBDBMN7IPR5Q3DOQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.484090730 (197h23m52.443187982s) [noise=true , address=104.36.82.18:4392 , piece_id=DUJGW7SOHIZ6SL36R24TZXK3WWT7FJ5U2IYR6U4LT4BYOCLHSDYA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.484459664 (197h23m52.443556918s) [noise=true , address=104.36.82.47:4540 , piece_id=IBPRQX4YHFT3RTB72A5KAWQLSCBHVA6BDN7POOQSZTADZSKX6XAQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485065081 (197h23m52.444162336s) [noise=true , address=104.36.82.38:4692 , piece_id=LXH2ORVEJ5Q24P3YY5VE4EFWLAYQS7LVCSJ6UWOV2TEEDYLOEXXQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485525349 (197h23m52.4446226s) [noise=true , address=104.36.82.16:4308 , piece_id=YUKJ2DOGYXBLFSRUJGDBT6CXTOOETTPNDBFPZUW5E6SEAXQMBAIA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485891474 (197h23m52.444988729s) [noise=true , address=104.36.82.10:4097 , piece_id=GUUN4DD7JPUSO6UVSTQ2QKB2DOES63VXMTI4BLNBJAEQ35AFA47Q, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486268568 (197h23m52.445365815s) [noise=true , address=104.36.82.20:4463 , piece_id=RYRSSCTL3N4GJYTB7MNMI4PKWR7RXLDZ2YVIXY3ERLCXLKEEP4TQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486639528 (197h23m52.445736776s) [noise=true , address=104.36.82.56:4248 , piece_id=TOBE3EZABNRXOGLO3BJ3O4QCWJK4JHS2KYUWYZW6FPFY4TZHPYFA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486976423 (197h23m52.446073669s) [noise=true , address=104.36.82.60:4353 , piece_id=PKRQ3UTWWSP6K4D6VBTXMKOJWRMRLX27PVE7MXOC7YIJFHDU5OBA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487317315 (197h23m52.446414561s) [noise=true , address=104.36.82.14:4241 , piece_id=YZWFVMVW4RIJL5JUUXOG25ZYQUZZZ3P6FZQ6AFBTRZFI74OBJ2FQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487612071 (197h23m52.446709316s) [noise=true , address=77.90.31.12:4602 , piece_id=OH27WBAU3Z5RZA423JF2DWPZ5CIFRZZDW2CQFA3UB27YMKHKAMHA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487947801 (197h23m52.447045053s) [noise=true , address=77.90.31.18:4829 , piece_id=SVYXJGIM6K5KO74OELO7YINLHRXUTPHS6RUUGGYJT7PN2IVWUV7A, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.488287344 (197h23m52.4473846s) [noise=true , address=104.36.82.2:4756 , piece_id=XHJLCWAJJ7BMONKDD5O55EJZSOJY4SE2JIXEMW7BMF5VKLIY4ZMA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.488683382 (197h23m52.447780635s) [noise=true , address=45.91.116.12:4253 , piece_id=I5KOLUJN6IOTYWPAVCYXZCXABR36WIQDVG35TDEFMWPSCYS2FNAA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489152324 (197h23m52.448249578s) [noise=true , address=104.36.82.23:4469 , piece_id=JH44FO3YNQALB6M5PRITANN5HRMNVM4RY5BOXM5OFYI35FV3LOWA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489533496 (197h23m52.448630753s) [noise=true , address=104.36.82.9:4016 , piece_id=HTRAGHQC26JUSNWBAE4MUGJ7GGD7NDR7H5S6KQ2OVC63GZLYUVYQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489992155 (197h23m52.449089406s) [noise=true , address=77.90.31.15:4728 , piece_id=RNCMK7HNBHWDD7OUQHGLPXDA4AL5IKUIFS7JBMMUJ3MNBKRJXWFA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.490332655 (197h23m52.44942991s) [noise=true , address=45.91.116.13:4161 , piece_id=5SE7HKY7PG2AXVK2PSICMLP3ZNQWUDCNTISZKL7A7MGEIZFICMGQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:31.070138080 (197h23m53.029235317s) [upload=205427]: Next returned nil segment
Aug 16 22:49:31.070156240 (197h23m53.029253485s) [upload=205427]: Waiting for error group managing segments...
Aug 16 22:49:31.244750684 (197h23m53.203847918s) [noise=true , address=104.36.82.20:4463 , piece_id=RYRSSCTL3N4GJYTB7MNMI4PKWR7RXLDZ2YVIXY3ERLCXLKEEP4TQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.273373250 (197h23m53.232470481s) [noise=true , address=104.36.82.2:4756 , piece_id=XHJLCWAJJ7BMONKDD5O55EJZSOJY4SE2JIXEMW7BMF5VKLIY4ZMA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.293132979 (197h23m53.252230244s) [noise=true , address=104.36.82.18:4392 , piece_id=DUJGW7SOHIZ6SL36R24TZXK3WWT7FJ5U2IYR6U4LT4BYOCLHSDYA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.318430962 (197h23m53.277528202s) [noise=true , address=104.36.82.60:4353 , piece_id=PKRQ3UTWWSP6K4D6VBTXMKOJWRMRLX27PVE7MXOC7YIJFHDU5OBA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.327035473 (197h23m53.286132717s) [noise=true , address=104.36.82.38:4692 , piece_id=LXH2ORVEJ5Q24P3YY5VE4EFWLAYQS7LVCSJ6UWOV2TEEDYLOEXXQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.338269683 (197h23m53.297366924s) [noise=true , address=45.91.116.13:4161 , piece_id=5SE7HKY7PG2AXVK2PSICMLP3ZNQWUDCNTISZKL7A7MGEIZFICMGQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.352408856 (197h23m53.311506088s) [noise=true , address=45.91.116.12:4253 , piece_id=I5KOLUJN6IOTYWPAVCYXZCXABR36WIQDVG35TDEFMWPSCYS2FNAA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.355334738 (197h23m53.314431976s) [noise=true , address=104.36.82.9:4016 , piece_id=HTRAGHQC26JUSNWBAE4MUGJ7GGD7NDR7H5S6KQ2OVC63GZLYUVYQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.408794808 (197h23m53.367892046s) [noise=true , address=77.90.31.18:4829 , piece_id=SVYXJGIM6K5KO74OELO7YINLHRXUTPHS6RUUGGYJT7PN2IVWUV7A, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.417776712 (197h23m53.376873947s) [noise=true , address=104.36.82.10:4097 , piece_id=GUUN4DD7JPUSO6UVSTQ2QKB2DOES63VXMTI4BLNBJAEQ35AFA47Q, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.430486727 (197h23m53.389583966s) [noise=true , address=77.90.31.15:4728 , piece_id=RNCMK7HNBHWDD7OUQHGLPXDA4AL5IKUIFS7JBMMUJ3MNBKRJXWFA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.489232668 (197h23m53.448329901s) [noise=true , address=104.36.82.16:4308 , piece_id=YUKJ2DOGYXBLFSRUJGDBT6CXTOOETTPNDBFPZUW5E6SEAXQMBAIA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.517002522 (197h23m53.476099767s) [noise=true , address=77.90.31.10:4525 , piece_id=EBOKK6AGP3TNV7DP4L3PIJTUDC4M74EOKLH6IBDBMN7IPR5Q3DOQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.627435127 (197h23m53.586532366s) [noise=true , address=104.36.82.56:4248 , piece_id=TOBE3EZABNRXOGLO3BJ3O4QCWJK4JHS2KYUWYZW6FPFY4TZHPYFA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.627456570 (197h23m53.586553809s) [seg_pos={0 0}, upload=205427]: Segment reached optimal threshold of 14 pieces.
Aug 16 22:49:31.627776426 (197h23m53.586873662s) [noise=true , address=104.36.82.14:4241 , piece_id=YZWFVMVW4RIJL5JUUXOG25ZYQUZZZ3P6FZQ6AFBTRZFI74OBJ2FQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aBy6nQScbjzmBSScfEZwTX8NCcP9c71FRQkUH54WvZhhhtXLR): protocol: expected piece hash; context canceled; EOF
Aug 16 22:49:31.627888126 (197h23m53.586985372s) [noise=true , address=77.90.31.12:4602 , piece_id=OH27WBAU3Z5RZA423JF2DWPZ5CIFRZZDW2CQFA3UB27YMKHKAMHA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf): protocol: expected piece hash; context canceled; EOF
Aug 16 22:49:31.628056687 (197h23m53.587153927s) [noise=true , address=104.36.82.23:4469 , piece_id=JH44FO3YNQALB6M5PRITANN5HRMNVM4RY5BOXM5OFYI35FV3LOWA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection; write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection
Aug 16 22:49:31.628079091 (197h23m53.587176328s) [noise=true , address=104.36.82.47:4540 , piece_id=IBPRQX4YHFT3RTB72A5KAWQLSCBHVA6BDN7POOQSZTADZSKX6XAQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection; write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection
Aug 16 22:49:31.628099133 (197h23m53.587196369s) [seg_pos={0 0}, upload=205427]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 22:49:31.628179292 (197h23m53.587276537s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 22:49:31.628195384 (197h23m53.58729263s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 22:49:31.871260215 (197h23m53.830357485s) [upload=205427]: Done uploading segments...
Aug 16 22:49:31.871286118 (197h23m53.830383351s) [upload=205427]: Upload finished. err: <nil>
Duration: 3.058353714s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
2.676526844s
FAIL (2025-08-16 22:53:29 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 791528b4431efbda984ff105020a1fa3d2f607da7e832f9772a2edd3a26490b0 != before 620c0ab2bcf8776c74e0f2a9a3fd8e53be0a8b505a80ecd7e638870652f42aca
======LOGS======
Aug 16 22:49:30.196418476 (197h23m52.155515707s) [upload=205427]: Starting upload
Aug 16 22:49:30.196474919 (197h23m52.155572164s) [upload=205427]: Done starting upload
Aug 16 22:49:30.196565257 (197h23m52.155662507s) [upload=205427]: Uploading segments...
Aug 16 22:49:30.196743883 (197h23m52.155841115s) [upload=205427]: Got next segment. Inline: false
Aug 16 22:49:30.196780331 (197h23m52.155877577s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 22:49:30.196785188 (197h23m52.155882433s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 22:49:30.483512934 (197h23m52.4426102s) [seg_pos={0 0}, upload=205427]: Begin upload segment...
Aug 16 22:49:30.483571578 (197h23m52.442668816s) [seg_pos={0 0}, upload=205427]: Done begin upload segment.
Aug 16 22:49:30.483607605 (197h23m52.44270485s) [noise=true , address=77.90.31.10:4525 , piece_id=EBOKK6AGP3TNV7DP4L3PIJTUDC4M74EOKLH6IBDBMN7IPR5Q3DOQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.484090730 (197h23m52.443187982s) [noise=true , address=104.36.82.18:4392 , piece_id=DUJGW7SOHIZ6SL36R24TZXK3WWT7FJ5U2IYR6U4LT4BYOCLHSDYA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.484459664 (197h23m52.443556918s) [noise=true , address=104.36.82.47:4540 , piece_id=IBPRQX4YHFT3RTB72A5KAWQLSCBHVA6BDN7POOQSZTADZSKX6XAQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485065081 (197h23m52.444162336s) [noise=true , address=104.36.82.38:4692 , piece_id=LXH2ORVEJ5Q24P3YY5VE4EFWLAYQS7LVCSJ6UWOV2TEEDYLOEXXQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485525349 (197h23m52.4446226s) [noise=true , address=104.36.82.16:4308 , piece_id=YUKJ2DOGYXBLFSRUJGDBT6CXTOOETTPNDBFPZUW5E6SEAXQMBAIA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485891474 (197h23m52.444988729s) [noise=true , address=104.36.82.10:4097 , piece_id=GUUN4DD7JPUSO6UVSTQ2QKB2DOES63VXMTI4BLNBJAEQ35AFA47Q, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486268568 (197h23m52.445365815s) [noise=true , address=104.36.82.20:4463 , piece_id=RYRSSCTL3N4GJYTB7MNMI4PKWR7RXLDZ2YVIXY3ERLCXLKEEP4TQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486639528 (197h23m52.445736776s) [noise=true , address=104.36.82.56:4248 , piece_id=TOBE3EZABNRXOGLO3BJ3O4QCWJK4JHS2KYUWYZW6FPFY4TZHPYFA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486976423 (197h23m52.446073669s) [noise=true , address=104.36.82.60:4353 , piece_id=PKRQ3UTWWSP6K4D6VBTXMKOJWRMRLX27PVE7MXOC7YIJFHDU5OBA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487317315 (197h23m52.446414561s) [noise=true , address=104.36.82.14:4241 , piece_id=YZWFVMVW4RIJL5JUUXOG25ZYQUZZZ3P6FZQ6AFBTRZFI74OBJ2FQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487612071 (197h23m52.446709316s) [noise=true , address=77.90.31.12:4602 , piece_id=OH27WBAU3Z5RZA423JF2DWPZ5CIFRZZDW2CQFA3UB27YMKHKAMHA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487947801 (197h23m52.447045053s) [noise=true , address=77.90.31.18:4829 , piece_id=SVYXJGIM6K5KO74OELO7YINLHRXUTPHS6RUUGGYJT7PN2IVWUV7A, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.488287344 (197h23m52.4473846s) [noise=true , address=104.36.82.2:4756 , piece_id=XHJLCWAJJ7BMONKDD5O55EJZSOJY4SE2JIXEMW7BMF5VKLIY4ZMA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.488683382 (197h23m52.447780635s) [noise=true , address=45.91.116.12:4253 , piece_id=I5KOLUJN6IOTYWPAVCYXZCXABR36WIQDVG35TDEFMWPSCYS2FNAA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489152324 (197h23m52.448249578s) [noise=true , address=104.36.82.23:4469 , piece_id=JH44FO3YNQALB6M5PRITANN5HRMNVM4RY5BOXM5OFYI35FV3LOWA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489533496 (197h23m52.448630753s) [noise=true , address=104.36.82.9:4016 , piece_id=HTRAGHQC26JUSNWBAE4MUGJ7GGD7NDR7H5S6KQ2OVC63GZLYUVYQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489992155 (197h23m52.449089406s) [noise=true , address=77.90.31.15:4728 , piece_id=RNCMK7HNBHWDD7OUQHGLPXDA4AL5IKUIFS7JBMMUJ3MNBKRJXWFA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.490332655 (197h23m52.44942991s) [noise=true , address=45.91.116.13:4161 , piece_id=5SE7HKY7PG2AXVK2PSICMLP3ZNQWUDCNTISZKL7A7MGEIZFICMGQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:31.070138080 (197h23m53.029235317s) [upload=205427]: Next returned nil segment
Aug 16 22:49:31.070156240 (197h23m53.029253485s) [upload=205427]: Waiting for error group managing segments...
Aug 16 22:49:31.244750684 (197h23m53.203847918s) [noise=true , address=104.36.82.20:4463 , piece_id=RYRSSCTL3N4GJYTB7MNMI4PKWR7RXLDZ2YVIXY3ERLCXLKEEP4TQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.273373250 (197h23m53.232470481s) [noise=true , address=104.36.82.2:4756 , piece_id=XHJLCWAJJ7BMONKDD5O55EJZSOJY4SE2JIXEMW7BMF5VKLIY4ZMA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.293132979 (197h23m53.252230244s) [noise=true , address=104.36.82.18:4392 , piece_id=DUJGW7SOHIZ6SL36R24TZXK3WWT7FJ5U2IYR6U4LT4BYOCLHSDYA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.318430962 (197h23m53.277528202s) [noise=true , address=104.36.82.60:4353 , piece_id=PKRQ3UTWWSP6K4D6VBTXMKOJWRMRLX27PVE7MXOC7YIJFHDU5OBA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.327035473 (197h23m53.286132717s) [noise=true , address=104.36.82.38:4692 , piece_id=LXH2ORVEJ5Q24P3YY5VE4EFWLAYQS7LVCSJ6UWOV2TEEDYLOEXXQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.338269683 (197h23m53.297366924s) [noise=true , address=45.91.116.13:4161 , piece_id=5SE7HKY7PG2AXVK2PSICMLP3ZNQWUDCNTISZKL7A7MGEIZFICMGQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.352408856 (197h23m53.311506088s) [noise=true , address=45.91.116.12:4253 , piece_id=I5KOLUJN6IOTYWPAVCYXZCXABR36WIQDVG35TDEFMWPSCYS2FNAA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.355334738 (197h23m53.314431976s) [noise=true , address=104.36.82.9:4016 , piece_id=HTRAGHQC26JUSNWBAE4MUGJ7GGD7NDR7H5S6KQ2OVC63GZLYUVYQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.408794808 (197h23m53.367892046s) [noise=true , address=77.90.31.18:4829 , piece_id=SVYXJGIM6K5KO74OELO7YINLHRXUTPHS6RUUGGYJT7PN2IVWUV7A, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.417776712 (197h23m53.376873947s) [noise=true , address=104.36.82.10:4097 , piece_id=GUUN4DD7JPUSO6UVSTQ2QKB2DOES63VXMTI4BLNBJAEQ35AFA47Q, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.430486727 (197h23m53.389583966s) [noise=true , address=77.90.31.15:4728 , piece_id=RNCMK7HNBHWDD7OUQHGLPXDA4AL5IKUIFS7JBMMUJ3MNBKRJXWFA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.489232668 (197h23m53.448329901s) [noise=true , address=104.36.82.16:4308 , piece_id=YUKJ2DOGYXBLFSRUJGDBT6CXTOOETTPNDBFPZUW5E6SEAXQMBAIA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.517002522 (197h23m53.476099767s) [noise=true , address=77.90.31.10:4525 , piece_id=EBOKK6AGP3TNV7DP4L3PIJTUDC4M74EOKLH6IBDBMN7IPR5Q3DOQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.627435127 (197h23m53.586532366s) [noise=true , address=104.36.82.56:4248 , piece_id=TOBE3EZABNRXOGLO3BJ3O4QCWJK4JHS2KYUWYZW6FPFY4TZHPYFA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.627456570 (197h23m53.586553809s) [seg_pos={0 0}, upload=205427]: Segment reached optimal threshold of 14 pieces.
Aug 16 22:49:31.627776426 (197h23m53.586873662s) [noise=true , address=104.36.82.14:4241 , piece_id=YZWFVMVW4RIJL5JUUXOG25ZYQUZZZ3P6FZQ6AFBTRZFI74OBJ2FQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aBy6nQScbjzmBSScfEZwTX8NCcP9c71FRQkUH54WvZhhhtXLR): protocol: expected piece hash; context canceled; EOF
Aug 16 22:49:31.627888126 (197h23m53.586985372s) [noise=true , address=77.90.31.12:4602 , piece_id=OH27WBAU3Z5RZA423JF2DWPZ5CIFRZZDW2CQFA3UB27YMKHKAMHA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf): protocol: expected piece hash; context canceled; EOF
Aug 16 22:49:31.628056687 (197h23m53.587153927s) [noise=true , address=104.36.82.23:4469 , piece_id=JH44FO3YNQALB6M5PRITANN5HRMNVM4RY5BOXM5OFYI35FV3LOWA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection; write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection
Aug 16 22:49:31.628079091 (197h23m53.587176328s) [noise=true , address=104.36.82.47:4540 , piece_id=IBPRQX4YHFT3RTB72A5KAWQLSCBHVA6BDN7POOQSZTADZSKX6XAQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection; write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection
Aug 16 22:49:31.628099133 (197h23m53.587196369s) [seg_pos={0 0}, upload=205427]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 22:49:31.628179292 (197h23m53.587276537s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 22:49:31.628195384 (197h23m53.58729263s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 22:49:31.871260215 (197h23m53.830357485s) [upload=205427]: Done uploading segments...
Aug 16 22:49:31.871286118 (197h23m53.830383351s) [upload=205427]: Upload finished. err: <nil>
Duration: 2.676555694s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..X.....................X.....................X.....X.......] duration:
874.892376ms
FAIL (2025-08-16 22:52:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 22:48:41.883559329 (197h23m3.842656575s) [upload=205414]: Starting upload Aug 16 22:48:41.883616147 (197h23m3.842713394s) [upload=205414]: Done starting upload Aug 16 22:48:41.883698102 (197h23m3.842795348s) [upload=205414]: Uploading segments... Aug 16 22:48:41.883755229 (197h23m3.842853797s) [upload=205414]: Got next segment. Inline: true Aug 16 22:48:41.883763436 (197h23m3.842860682s) [upload=205414]: Waiting for error group managing segments... Aug 16 22:48:41.883813582 (197h23m3.842910831s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 22:48:41.883820508 (197h23m3.842917756s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 22:48:41.883824499 (197h23m3.842921747s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 22:48:41.975827358 (197h23m3.934924614s) [upload=205414]: Done uploading segments... Aug 16 22:48:41.975867347 (197h23m3.934964606s) [upload=205414]: Upload finished. err: metaclient: Too Many Requests
Duration: 874.925913ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...X.....................X.....................X.....X......] duration:
977.40689ms
FAIL (2025-08-16 22:52:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 22:48:41.883559329 (197h23m3.842656575s) [upload=205414]: Starting upload Aug 16 22:48:41.883616147 (197h23m3.842713394s) [upload=205414]: Done starting upload Aug 16 22:48:41.883698102 (197h23m3.842795348s) [upload=205414]: Uploading segments... Aug 16 22:48:41.883755229 (197h23m3.842853797s) [upload=205414]: Got next segment. Inline: true Aug 16 22:48:41.883763436 (197h23m3.842860682s) [upload=205414]: Waiting for error group managing segments... Aug 16 22:48:41.883813582 (197h23m3.842910831s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 22:48:41.883820508 (197h23m3.842917756s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 22:48:41.883824499 (197h23m3.842921747s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 22:48:41.975827358 (197h23m3.934924614s) [upload=205414]: Done uploading segments... Aug 16 22:48:41.975867347 (197h23m3.934964606s) [upload=205414]: Upload finished. err: metaclient: Too Many Requests
Duration: 977.436295ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
2.814492287s
FAIL (2025-08-16 22:52:16 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 791528b4431efbda984ff105020a1fa3d2f607da7e832f9772a2edd3a26490b0 != before 620c0ab2bcf8776c74e0f2a9a3fd8e53be0a8b505a80ecd7e638870652f42aca
======LOGS======
Aug 16 22:49:30.196418476 (197h23m52.155515707s) [upload=205427]: Starting upload
Aug 16 22:49:30.196474919 (197h23m52.155572164s) [upload=205427]: Done starting upload
Aug 16 22:49:30.196565257 (197h23m52.155662507s) [upload=205427]: Uploading segments...
Aug 16 22:49:30.196743883 (197h23m52.155841115s) [upload=205427]: Got next segment. Inline: false
Aug 16 22:49:30.196780331 (197h23m52.155877577s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 22:49:30.196785188 (197h23m52.155882433s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 22:49:30.483512934 (197h23m52.4426102s) [seg_pos={0 0}, upload=205427]: Begin upload segment...
Aug 16 22:49:30.483571578 (197h23m52.442668816s) [seg_pos={0 0}, upload=205427]: Done begin upload segment.
Aug 16 22:49:30.483607605 (197h23m52.44270485s) [noise=true , address=77.90.31.10:4525 , piece_id=EBOKK6AGP3TNV7DP4L3PIJTUDC4M74EOKLH6IBDBMN7IPR5Q3DOQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.484090730 (197h23m52.443187982s) [noise=true , address=104.36.82.18:4392 , piece_id=DUJGW7SOHIZ6SL36R24TZXK3WWT7FJ5U2IYR6U4LT4BYOCLHSDYA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.484459664 (197h23m52.443556918s) [noise=true , address=104.36.82.47:4540 , piece_id=IBPRQX4YHFT3RTB72A5KAWQLSCBHVA6BDN7POOQSZTADZSKX6XAQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485065081 (197h23m52.444162336s) [noise=true , address=104.36.82.38:4692 , piece_id=LXH2ORVEJ5Q24P3YY5VE4EFWLAYQS7LVCSJ6UWOV2TEEDYLOEXXQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485525349 (197h23m52.4446226s) [noise=true , address=104.36.82.16:4308 , piece_id=YUKJ2DOGYXBLFSRUJGDBT6CXTOOETTPNDBFPZUW5E6SEAXQMBAIA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485891474 (197h23m52.444988729s) [noise=true , address=104.36.82.10:4097 , piece_id=GUUN4DD7JPUSO6UVSTQ2QKB2DOES63VXMTI4BLNBJAEQ35AFA47Q, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486268568 (197h23m52.445365815s) [noise=true , address=104.36.82.20:4463 , piece_id=RYRSSCTL3N4GJYTB7MNMI4PKWR7RXLDZ2YVIXY3ERLCXLKEEP4TQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486639528 (197h23m52.445736776s) [noise=true , address=104.36.82.56:4248 , piece_id=TOBE3EZABNRXOGLO3BJ3O4QCWJK4JHS2KYUWYZW6FPFY4TZHPYFA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486976423 (197h23m52.446073669s) [noise=true , address=104.36.82.60:4353 , piece_id=PKRQ3UTWWSP6K4D6VBTXMKOJWRMRLX27PVE7MXOC7YIJFHDU5OBA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487317315 (197h23m52.446414561s) [noise=true , address=104.36.82.14:4241 , piece_id=YZWFVMVW4RIJL5JUUXOG25ZYQUZZZ3P6FZQ6AFBTRZFI74OBJ2FQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487612071 (197h23m52.446709316s) [noise=true , address=77.90.31.12:4602 , piece_id=OH27WBAU3Z5RZA423JF2DWPZ5CIFRZZDW2CQFA3UB27YMKHKAMHA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487947801 (197h23m52.447045053s) [noise=true , address=77.90.31.18:4829 , piece_id=SVYXJGIM6K5KO74OELO7YINLHRXUTPHS6RUUGGYJT7PN2IVWUV7A, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.488287344 (197h23m52.4473846s) [noise=true , address=104.36.82.2:4756 , piece_id=XHJLCWAJJ7BMONKDD5O55EJZSOJY4SE2JIXEMW7BMF5VKLIY4ZMA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.488683382 (197h23m52.447780635s) [noise=true , address=45.91.116.12:4253 , piece_id=I5KOLUJN6IOTYWPAVCYXZCXABR36WIQDVG35TDEFMWPSCYS2FNAA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489152324 (197h23m52.448249578s) [noise=true , address=104.36.82.23:4469 , piece_id=JH44FO3YNQALB6M5PRITANN5HRMNVM4RY5BOXM5OFYI35FV3LOWA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489533496 (197h23m52.448630753s) [noise=true , address=104.36.82.9:4016 , piece_id=HTRAGHQC26JUSNWBAE4MUGJ7GGD7NDR7H5S6KQ2OVC63GZLYUVYQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489992155 (197h23m52.449089406s) [noise=true , address=77.90.31.15:4728 , piece_id=RNCMK7HNBHWDD7OUQHGLPXDA4AL5IKUIFS7JBMMUJ3MNBKRJXWFA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.490332655 (197h23m52.44942991s) [noise=true , address=45.91.116.13:4161 , piece_id=5SE7HKY7PG2AXVK2PSICMLP3ZNQWUDCNTISZKL7A7MGEIZFICMGQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:31.070138080 (197h23m53.029235317s) [upload=205427]: Next returned nil segment
Aug 16 22:49:31.070156240 (197h23m53.029253485s) [upload=205427]: Waiting for error group managing segments...
Aug 16 22:49:31.244750684 (197h23m53.203847918s) [noise=true , address=104.36.82.20:4463 , piece_id=RYRSSCTL3N4GJYTB7MNMI4PKWR7RXLDZ2YVIXY3ERLCXLKEEP4TQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.273373250 (197h23m53.232470481s) [noise=true , address=104.36.82.2:4756 , piece_id=XHJLCWAJJ7BMONKDD5O55EJZSOJY4SE2JIXEMW7BMF5VKLIY4ZMA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.293132979 (197h23m53.252230244s) [noise=true , address=104.36.82.18:4392 , piece_id=DUJGW7SOHIZ6SL36R24TZXK3WWT7FJ5U2IYR6U4LT4BYOCLHSDYA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.318430962 (197h23m53.277528202s) [noise=true , address=104.36.82.60:4353 , piece_id=PKRQ3UTWWSP6K4D6VBTXMKOJWRMRLX27PVE7MXOC7YIJFHDU5OBA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.327035473 (197h23m53.286132717s) [noise=true , address=104.36.82.38:4692 , piece_id=LXH2ORVEJ5Q24P3YY5VE4EFWLAYQS7LVCSJ6UWOV2TEEDYLOEXXQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.338269683 (197h23m53.297366924s) [noise=true , address=45.91.116.13:4161 , piece_id=5SE7HKY7PG2AXVK2PSICMLP3ZNQWUDCNTISZKL7A7MGEIZFICMGQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.352408856 (197h23m53.311506088s) [noise=true , address=45.91.116.12:4253 , piece_id=I5KOLUJN6IOTYWPAVCYXZCXABR36WIQDVG35TDEFMWPSCYS2FNAA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.355334738 (197h23m53.314431976s) [noise=true , address=104.36.82.9:4016 , piece_id=HTRAGHQC26JUSNWBAE4MUGJ7GGD7NDR7H5S6KQ2OVC63GZLYUVYQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.408794808 (197h23m53.367892046s) [noise=true , address=77.90.31.18:4829 , piece_id=SVYXJGIM6K5KO74OELO7YINLHRXUTPHS6RUUGGYJT7PN2IVWUV7A, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.417776712 (197h23m53.376873947s) [noise=true , address=104.36.82.10:4097 , piece_id=GUUN4DD7JPUSO6UVSTQ2QKB2DOES63VXMTI4BLNBJAEQ35AFA47Q, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.430486727 (197h23m53.389583966s) [noise=true , address=77.90.31.15:4728 , piece_id=RNCMK7HNBHWDD7OUQHGLPXDA4AL5IKUIFS7JBMMUJ3MNBKRJXWFA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.489232668 (197h23m53.448329901s) [noise=true , address=104.36.82.16:4308 , piece_id=YUKJ2DOGYXBLFSRUJGDBT6CXTOOETTPNDBFPZUW5E6SEAXQMBAIA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.517002522 (197h23m53.476099767s) [noise=true , address=77.90.31.10:4525 , piece_id=EBOKK6AGP3TNV7DP4L3PIJTUDC4M74EOKLH6IBDBMN7IPR5Q3DOQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.627435127 (197h23m53.586532366s) [noise=true , address=104.36.82.56:4248 , piece_id=TOBE3EZABNRXOGLO3BJ3O4QCWJK4JHS2KYUWYZW6FPFY4TZHPYFA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.627456570 (197h23m53.586553809s) [seg_pos={0 0}, upload=205427]: Segment reached optimal threshold of 14 pieces.
Aug 16 22:49:31.627776426 (197h23m53.586873662s) [noise=true , address=104.36.82.14:4241 , piece_id=YZWFVMVW4RIJL5JUUXOG25ZYQUZZZ3P6FZQ6AFBTRZFI74OBJ2FQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aBy6nQScbjzmBSScfEZwTX8NCcP9c71FRQkUH54WvZhhhtXLR): protocol: expected piece hash; context canceled; EOF
Aug 16 22:49:31.627888126 (197h23m53.586985372s) [noise=true , address=77.90.31.12:4602 , piece_id=OH27WBAU3Z5RZA423JF2DWPZ5CIFRZZDW2CQFA3UB27YMKHKAMHA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf): protocol: expected piece hash; context canceled; EOF
Aug 16 22:49:31.628056687 (197h23m53.587153927s) [noise=true , address=104.36.82.23:4469 , piece_id=JH44FO3YNQALB6M5PRITANN5HRMNVM4RY5BOXM5OFYI35FV3LOWA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection; write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection
Aug 16 22:49:31.628079091 (197h23m53.587176328s) [noise=true , address=104.36.82.47:4540 , piece_id=IBPRQX4YHFT3RTB72A5KAWQLSCBHVA6BDN7POOQSZTADZSKX6XAQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection; write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection
Aug 16 22:49:31.628099133 (197h23m53.587196369s) [seg_pos={0 0}, upload=205427]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 22:49:31.628179292 (197h23m53.587276537s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 22:49:31.628195384 (197h23m53.58729263s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 22:49:31.871260215 (197h23m53.830357485s) [upload=205427]: Done uploading segments...
Aug 16 22:49:31.871286118 (197h23m53.830383351s) [upload=205427]: Upload finished. err: <nil>
Duration: 2.814520317s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [....X.....................X.....................X.....X.....] duration:
1.220004885s
FAIL (2025-08-16 22:51:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 22:48:41.883559329 (197h23m3.842656575s) [upload=205414]: Starting upload Aug 16 22:48:41.883616147 (197h23m3.842713394s) [upload=205414]: Done starting upload Aug 16 22:48:41.883698102 (197h23m3.842795348s) [upload=205414]: Uploading segments... Aug 16 22:48:41.883755229 (197h23m3.842853797s) [upload=205414]: Got next segment. Inline: true Aug 16 22:48:41.883763436 (197h23m3.842860682s) [upload=205414]: Waiting for error group managing segments... Aug 16 22:48:41.883813582 (197h23m3.842910831s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 22:48:41.883820508 (197h23m3.842917756s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 22:48:41.883824499 (197h23m3.842921747s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 22:48:41.975827358 (197h23m3.934924614s) [upload=205414]: Done uploading segments... Aug 16 22:48:41.975867347 (197h23m3.934964606s) [upload=205414]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.220051984s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
2.669652669s
FAIL (2025-08-16 22:51:03 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 791528b4431efbda984ff105020a1fa3d2f607da7e832f9772a2edd3a26490b0 != before 620c0ab2bcf8776c74e0f2a9a3fd8e53be0a8b505a80ecd7e638870652f42aca
======LOGS======
Aug 16 22:49:30.196418476 (197h23m52.155515707s) [upload=205427]: Starting upload
Aug 16 22:49:30.196474919 (197h23m52.155572164s) [upload=205427]: Done starting upload
Aug 16 22:49:30.196565257 (197h23m52.155662507s) [upload=205427]: Uploading segments...
Aug 16 22:49:30.196743883 (197h23m52.155841115s) [upload=205427]: Got next segment. Inline: false
Aug 16 22:49:30.196780331 (197h23m52.155877577s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 22:49:30.196785188 (197h23m52.155882433s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 22:49:30.483512934 (197h23m52.4426102s) [seg_pos={0 0}, upload=205427]: Begin upload segment...
Aug 16 22:49:30.483571578 (197h23m52.442668816s) [seg_pos={0 0}, upload=205427]: Done begin upload segment.
Aug 16 22:49:30.483607605 (197h23m52.44270485s) [noise=true , address=77.90.31.10:4525 , piece_id=EBOKK6AGP3TNV7DP4L3PIJTUDC4M74EOKLH6IBDBMN7IPR5Q3DOQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.484090730 (197h23m52.443187982s) [noise=true , address=104.36.82.18:4392 , piece_id=DUJGW7SOHIZ6SL36R24TZXK3WWT7FJ5U2IYR6U4LT4BYOCLHSDYA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.484459664 (197h23m52.443556918s) [noise=true , address=104.36.82.47:4540 , piece_id=IBPRQX4YHFT3RTB72A5KAWQLSCBHVA6BDN7POOQSZTADZSKX6XAQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485065081 (197h23m52.444162336s) [noise=true , address=104.36.82.38:4692 , piece_id=LXH2ORVEJ5Q24P3YY5VE4EFWLAYQS7LVCSJ6UWOV2TEEDYLOEXXQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485525349 (197h23m52.4446226s) [noise=true , address=104.36.82.16:4308 , piece_id=YUKJ2DOGYXBLFSRUJGDBT6CXTOOETTPNDBFPZUW5E6SEAXQMBAIA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485891474 (197h23m52.444988729s) [noise=true , address=104.36.82.10:4097 , piece_id=GUUN4DD7JPUSO6UVSTQ2QKB2DOES63VXMTI4BLNBJAEQ35AFA47Q, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486268568 (197h23m52.445365815s) [noise=true , address=104.36.82.20:4463 , piece_id=RYRSSCTL3N4GJYTB7MNMI4PKWR7RXLDZ2YVIXY3ERLCXLKEEP4TQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486639528 (197h23m52.445736776s) [noise=true , address=104.36.82.56:4248 , piece_id=TOBE3EZABNRXOGLO3BJ3O4QCWJK4JHS2KYUWYZW6FPFY4TZHPYFA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486976423 (197h23m52.446073669s) [noise=true , address=104.36.82.60:4353 , piece_id=PKRQ3UTWWSP6K4D6VBTXMKOJWRMRLX27PVE7MXOC7YIJFHDU5OBA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487317315 (197h23m52.446414561s) [noise=true , address=104.36.82.14:4241 , piece_id=YZWFVMVW4RIJL5JUUXOG25ZYQUZZZ3P6FZQ6AFBTRZFI74OBJ2FQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487612071 (197h23m52.446709316s) [noise=true , address=77.90.31.12:4602 , piece_id=OH27WBAU3Z5RZA423JF2DWPZ5CIFRZZDW2CQFA3UB27YMKHKAMHA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487947801 (197h23m52.447045053s) [noise=true , address=77.90.31.18:4829 , piece_id=SVYXJGIM6K5KO74OELO7YINLHRXUTPHS6RUUGGYJT7PN2IVWUV7A, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.488287344 (197h23m52.4473846s) [noise=true , address=104.36.82.2:4756 , piece_id=XHJLCWAJJ7BMONKDD5O55EJZSOJY4SE2JIXEMW7BMF5VKLIY4ZMA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.488683382 (197h23m52.447780635s) [noise=true , address=45.91.116.12:4253 , piece_id=I5KOLUJN6IOTYWPAVCYXZCXABR36WIQDVG35TDEFMWPSCYS2FNAA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489152324 (197h23m52.448249578s) [noise=true , address=104.36.82.23:4469 , piece_id=JH44FO3YNQALB6M5PRITANN5HRMNVM4RY5BOXM5OFYI35FV3LOWA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489533496 (197h23m52.448630753s) [noise=true , address=104.36.82.9:4016 , piece_id=HTRAGHQC26JUSNWBAE4MUGJ7GGD7NDR7H5S6KQ2OVC63GZLYUVYQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489992155 (197h23m52.449089406s) [noise=true , address=77.90.31.15:4728 , piece_id=RNCMK7HNBHWDD7OUQHGLPXDA4AL5IKUIFS7JBMMUJ3MNBKRJXWFA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.490332655 (197h23m52.44942991s) [noise=true , address=45.91.116.13:4161 , piece_id=5SE7HKY7PG2AXVK2PSICMLP3ZNQWUDCNTISZKL7A7MGEIZFICMGQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:31.070138080 (197h23m53.029235317s) [upload=205427]: Next returned nil segment
Aug 16 22:49:31.070156240 (197h23m53.029253485s) [upload=205427]: Waiting for error group managing segments...
Aug 16 22:49:31.244750684 (197h23m53.203847918s) [noise=true , address=104.36.82.20:4463 , piece_id=RYRSSCTL3N4GJYTB7MNMI4PKWR7RXLDZ2YVIXY3ERLCXLKEEP4TQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.273373250 (197h23m53.232470481s) [noise=true , address=104.36.82.2:4756 , piece_id=XHJLCWAJJ7BMONKDD5O55EJZSOJY4SE2JIXEMW7BMF5VKLIY4ZMA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.293132979 (197h23m53.252230244s) [noise=true , address=104.36.82.18:4392 , piece_id=DUJGW7SOHIZ6SL36R24TZXK3WWT7FJ5U2IYR6U4LT4BYOCLHSDYA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.318430962 (197h23m53.277528202s) [noise=true , address=104.36.82.60:4353 , piece_id=PKRQ3UTWWSP6K4D6VBTXMKOJWRMRLX27PVE7MXOC7YIJFHDU5OBA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.327035473 (197h23m53.286132717s) [noise=true , address=104.36.82.38:4692 , piece_id=LXH2ORVEJ5Q24P3YY5VE4EFWLAYQS7LVCSJ6UWOV2TEEDYLOEXXQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.338269683 (197h23m53.297366924s) [noise=true , address=45.91.116.13:4161 , piece_id=5SE7HKY7PG2AXVK2PSICMLP3ZNQWUDCNTISZKL7A7MGEIZFICMGQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.352408856 (197h23m53.311506088s) [noise=true , address=45.91.116.12:4253 , piece_id=I5KOLUJN6IOTYWPAVCYXZCXABR36WIQDVG35TDEFMWPSCYS2FNAA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.355334738 (197h23m53.314431976s) [noise=true , address=104.36.82.9:4016 , piece_id=HTRAGHQC26JUSNWBAE4MUGJ7GGD7NDR7H5S6KQ2OVC63GZLYUVYQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.408794808 (197h23m53.367892046s) [noise=true , address=77.90.31.18:4829 , piece_id=SVYXJGIM6K5KO74OELO7YINLHRXUTPHS6RUUGGYJT7PN2IVWUV7A, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.417776712 (197h23m53.376873947s) [noise=true , address=104.36.82.10:4097 , piece_id=GUUN4DD7JPUSO6UVSTQ2QKB2DOES63VXMTI4BLNBJAEQ35AFA47Q, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.430486727 (197h23m53.389583966s) [noise=true , address=77.90.31.15:4728 , piece_id=RNCMK7HNBHWDD7OUQHGLPXDA4AL5IKUIFS7JBMMUJ3MNBKRJXWFA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.489232668 (197h23m53.448329901s) [noise=true , address=104.36.82.16:4308 , piece_id=YUKJ2DOGYXBLFSRUJGDBT6CXTOOETTPNDBFPZUW5E6SEAXQMBAIA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.517002522 (197h23m53.476099767s) [noise=true , address=77.90.31.10:4525 , piece_id=EBOKK6AGP3TNV7DP4L3PIJTUDC4M74EOKLH6IBDBMN7IPR5Q3DOQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.627435127 (197h23m53.586532366s) [noise=true , address=104.36.82.56:4248 , piece_id=TOBE3EZABNRXOGLO3BJ3O4QCWJK4JHS2KYUWYZW6FPFY4TZHPYFA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.627456570 (197h23m53.586553809s) [seg_pos={0 0}, upload=205427]: Segment reached optimal threshold of 14 pieces.
Aug 16 22:49:31.627776426 (197h23m53.586873662s) [noise=true , address=104.36.82.14:4241 , piece_id=YZWFVMVW4RIJL5JUUXOG25ZYQUZZZ3P6FZQ6AFBTRZFI74OBJ2FQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aBy6nQScbjzmBSScfEZwTX8NCcP9c71FRQkUH54WvZhhhtXLR): protocol: expected piece hash; context canceled; EOF
Aug 16 22:49:31.627888126 (197h23m53.586985372s) [noise=true , address=77.90.31.12:4602 , piece_id=OH27WBAU3Z5RZA423JF2DWPZ5CIFRZZDW2CQFA3UB27YMKHKAMHA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf): protocol: expected piece hash; context canceled; EOF
Aug 16 22:49:31.628056687 (197h23m53.587153927s) [noise=true , address=104.36.82.23:4469 , piece_id=JH44FO3YNQALB6M5PRITANN5HRMNVM4RY5BOXM5OFYI35FV3LOWA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection; write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection
Aug 16 22:49:31.628079091 (197h23m53.587176328s) [noise=true , address=104.36.82.47:4540 , piece_id=IBPRQX4YHFT3RTB72A5KAWQLSCBHVA6BDN7POOQSZTADZSKX6XAQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection; write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection
Aug 16 22:49:31.628099133 (197h23m53.587196369s) [seg_pos={0 0}, upload=205427]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 22:49:31.628179292 (197h23m53.587276537s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 22:49:31.628195384 (197h23m53.58729263s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 22:49:31.871260215 (197h23m53.830357485s) [upload=205427]: Done uploading segments...
Aug 16 22:49:31.871286118 (197h23m53.830383351s) [upload=205427]: Upload finished. err: <nil>
Duration: 2.669685411s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.....X.....................X.....................X.....X....] duration:
1.022172192s
FAIL (2025-08-16 22:50:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 22:48:41.883559329 (197h23m3.842656575s) [upload=205414]: Starting upload Aug 16 22:48:41.883616147 (197h23m3.842713394s) [upload=205414]: Done starting upload Aug 16 22:48:41.883698102 (197h23m3.842795348s) [upload=205414]: Uploading segments... Aug 16 22:48:41.883755229 (197h23m3.842853797s) [upload=205414]: Got next segment. Inline: true Aug 16 22:48:41.883763436 (197h23m3.842860682s) [upload=205414]: Waiting for error group managing segments... Aug 16 22:48:41.883813582 (197h23m3.842910831s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 22:48:41.883820508 (197h23m3.842917756s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 22:48:41.883824499 (197h23m3.842921747s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 22:48:41.975827358 (197h23m3.934924614s) [upload=205414]: Done uploading segments... Aug 16 22:48:41.975867347 (197h23m3.934964606s) [upload=205414]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.022208422s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [......X.....................X.....................X.....X...] duration:
923.702915ms
FAIL (2025-08-16 22:50:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 22:48:41.883559329 (197h23m3.842656575s) [upload=205414]: Starting upload Aug 16 22:48:41.883616147 (197h23m3.842713394s) [upload=205414]: Done starting upload Aug 16 22:48:41.883698102 (197h23m3.842795348s) [upload=205414]: Uploading segments... Aug 16 22:48:41.883755229 (197h23m3.842853797s) [upload=205414]: Got next segment. Inline: true Aug 16 22:48:41.883763436 (197h23m3.842860682s) [upload=205414]: Waiting for error group managing segments... Aug 16 22:48:41.883813582 (197h23m3.842910831s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 22:48:41.883820508 (197h23m3.842917756s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 22:48:41.883824499 (197h23m3.842921747s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 22:48:41.975827358 (197h23m3.934924614s) [upload=205414]: Done uploading segments... Aug 16 22:48:41.975867347 (197h23m3.934964606s) [upload=205414]: Upload finished. err: metaclient: Too Many Requests
Duration: 923.75659ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
3.03712192s
FAIL (2025-08-16 22:49:57 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 791528b4431efbda984ff105020a1fa3d2f607da7e832f9772a2edd3a26490b0 != before 620c0ab2bcf8776c74e0f2a9a3fd8e53be0a8b505a80ecd7e638870652f42aca
======LOGS======
Aug 16 22:49:30.196418476 (197h23m52.155515707s) [upload=205427]: Starting upload
Aug 16 22:49:30.196474919 (197h23m52.155572164s) [upload=205427]: Done starting upload
Aug 16 22:49:30.196565257 (197h23m52.155662507s) [upload=205427]: Uploading segments...
Aug 16 22:49:30.196743883 (197h23m52.155841115s) [upload=205427]: Got next segment. Inline: false
Aug 16 22:49:30.196780331 (197h23m52.155877577s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 22:49:30.196785188 (197h23m52.155882433s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 22:49:30.483512934 (197h23m52.4426102s) [seg_pos={0 0}, upload=205427]: Begin upload segment...
Aug 16 22:49:30.483571578 (197h23m52.442668816s) [seg_pos={0 0}, upload=205427]: Done begin upload segment.
Aug 16 22:49:30.483607605 (197h23m52.44270485s) [noise=true , address=77.90.31.10:4525 , piece_id=EBOKK6AGP3TNV7DP4L3PIJTUDC4M74EOKLH6IBDBMN7IPR5Q3DOQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.484090730 (197h23m52.443187982s) [noise=true , address=104.36.82.18:4392 , piece_id=DUJGW7SOHIZ6SL36R24TZXK3WWT7FJ5U2IYR6U4LT4BYOCLHSDYA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.484459664 (197h23m52.443556918s) [noise=true , address=104.36.82.47:4540 , piece_id=IBPRQX4YHFT3RTB72A5KAWQLSCBHVA6BDN7POOQSZTADZSKX6XAQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485065081 (197h23m52.444162336s) [noise=true , address=104.36.82.38:4692 , piece_id=LXH2ORVEJ5Q24P3YY5VE4EFWLAYQS7LVCSJ6UWOV2TEEDYLOEXXQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485525349 (197h23m52.4446226s) [noise=true , address=104.36.82.16:4308 , piece_id=YUKJ2DOGYXBLFSRUJGDBT6CXTOOETTPNDBFPZUW5E6SEAXQMBAIA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485891474 (197h23m52.444988729s) [noise=true , address=104.36.82.10:4097 , piece_id=GUUN4DD7JPUSO6UVSTQ2QKB2DOES63VXMTI4BLNBJAEQ35AFA47Q, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486268568 (197h23m52.445365815s) [noise=true , address=104.36.82.20:4463 , piece_id=RYRSSCTL3N4GJYTB7MNMI4PKWR7RXLDZ2YVIXY3ERLCXLKEEP4TQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486639528 (197h23m52.445736776s) [noise=true , address=104.36.82.56:4248 , piece_id=TOBE3EZABNRXOGLO3BJ3O4QCWJK4JHS2KYUWYZW6FPFY4TZHPYFA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486976423 (197h23m52.446073669s) [noise=true , address=104.36.82.60:4353 , piece_id=PKRQ3UTWWSP6K4D6VBTXMKOJWRMRLX27PVE7MXOC7YIJFHDU5OBA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487317315 (197h23m52.446414561s) [noise=true , address=104.36.82.14:4241 , piece_id=YZWFVMVW4RIJL5JUUXOG25ZYQUZZZ3P6FZQ6AFBTRZFI74OBJ2FQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487612071 (197h23m52.446709316s) [noise=true , address=77.90.31.12:4602 , piece_id=OH27WBAU3Z5RZA423JF2DWPZ5CIFRZZDW2CQFA3UB27YMKHKAMHA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487947801 (197h23m52.447045053s) [noise=true , address=77.90.31.18:4829 , piece_id=SVYXJGIM6K5KO74OELO7YINLHRXUTPHS6RUUGGYJT7PN2IVWUV7A, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.488287344 (197h23m52.4473846s) [noise=true , address=104.36.82.2:4756 , piece_id=XHJLCWAJJ7BMONKDD5O55EJZSOJY4SE2JIXEMW7BMF5VKLIY4ZMA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.488683382 (197h23m52.447780635s) [noise=true , address=45.91.116.12:4253 , piece_id=I5KOLUJN6IOTYWPAVCYXZCXABR36WIQDVG35TDEFMWPSCYS2FNAA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489152324 (197h23m52.448249578s) [noise=true , address=104.36.82.23:4469 , piece_id=JH44FO3YNQALB6M5PRITANN5HRMNVM4RY5BOXM5OFYI35FV3LOWA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489533496 (197h23m52.448630753s) [noise=true , address=104.36.82.9:4016 , piece_id=HTRAGHQC26JUSNWBAE4MUGJ7GGD7NDR7H5S6KQ2OVC63GZLYUVYQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489992155 (197h23m52.449089406s) [noise=true , address=77.90.31.15:4728 , piece_id=RNCMK7HNBHWDD7OUQHGLPXDA4AL5IKUIFS7JBMMUJ3MNBKRJXWFA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.490332655 (197h23m52.44942991s) [noise=true , address=45.91.116.13:4161 , piece_id=5SE7HKY7PG2AXVK2PSICMLP3ZNQWUDCNTISZKL7A7MGEIZFICMGQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:31.070138080 (197h23m53.029235317s) [upload=205427]: Next returned nil segment
Aug 16 22:49:31.070156240 (197h23m53.029253485s) [upload=205427]: Waiting for error group managing segments...
Aug 16 22:49:31.244750684 (197h23m53.203847918s) [noise=true , address=104.36.82.20:4463 , piece_id=RYRSSCTL3N4GJYTB7MNMI4PKWR7RXLDZ2YVIXY3ERLCXLKEEP4TQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.273373250 (197h23m53.232470481s) [noise=true , address=104.36.82.2:4756 , piece_id=XHJLCWAJJ7BMONKDD5O55EJZSOJY4SE2JIXEMW7BMF5VKLIY4ZMA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.293132979 (197h23m53.252230244s) [noise=true , address=104.36.82.18:4392 , piece_id=DUJGW7SOHIZ6SL36R24TZXK3WWT7FJ5U2IYR6U4LT4BYOCLHSDYA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.318430962 (197h23m53.277528202s) [noise=true , address=104.36.82.60:4353 , piece_id=PKRQ3UTWWSP6K4D6VBTXMKOJWRMRLX27PVE7MXOC7YIJFHDU5OBA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.327035473 (197h23m53.286132717s) [noise=true , address=104.36.82.38:4692 , piece_id=LXH2ORVEJ5Q24P3YY5VE4EFWLAYQS7LVCSJ6UWOV2TEEDYLOEXXQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.338269683 (197h23m53.297366924s) [noise=true , address=45.91.116.13:4161 , piece_id=5SE7HKY7PG2AXVK2PSICMLP3ZNQWUDCNTISZKL7A7MGEIZFICMGQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.352408856 (197h23m53.311506088s) [noise=true , address=45.91.116.12:4253 , piece_id=I5KOLUJN6IOTYWPAVCYXZCXABR36WIQDVG35TDEFMWPSCYS2FNAA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.355334738 (197h23m53.314431976s) [noise=true , address=104.36.82.9:4016 , piece_id=HTRAGHQC26JUSNWBAE4MUGJ7GGD7NDR7H5S6KQ2OVC63GZLYUVYQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.408794808 (197h23m53.367892046s) [noise=true , address=77.90.31.18:4829 , piece_id=SVYXJGIM6K5KO74OELO7YINLHRXUTPHS6RUUGGYJT7PN2IVWUV7A, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.417776712 (197h23m53.376873947s) [noise=true , address=104.36.82.10:4097 , piece_id=GUUN4DD7JPUSO6UVSTQ2QKB2DOES63VXMTI4BLNBJAEQ35AFA47Q, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.430486727 (197h23m53.389583966s) [noise=true , address=77.90.31.15:4728 , piece_id=RNCMK7HNBHWDD7OUQHGLPXDA4AL5IKUIFS7JBMMUJ3MNBKRJXWFA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.489232668 (197h23m53.448329901s) [noise=true , address=104.36.82.16:4308 , piece_id=YUKJ2DOGYXBLFSRUJGDBT6CXTOOETTPNDBFPZUW5E6SEAXQMBAIA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.517002522 (197h23m53.476099767s) [noise=true , address=77.90.31.10:4525 , piece_id=EBOKK6AGP3TNV7DP4L3PIJTUDC4M74EOKLH6IBDBMN7IPR5Q3DOQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.627435127 (197h23m53.586532366s) [noise=true , address=104.36.82.56:4248 , piece_id=TOBE3EZABNRXOGLO3BJ3O4QCWJK4JHS2KYUWYZW6FPFY4TZHPYFA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.627456570 (197h23m53.586553809s) [seg_pos={0 0}, upload=205427]: Segment reached optimal threshold of 14 pieces.
Aug 16 22:49:31.627776426 (197h23m53.586873662s) [noise=true , address=104.36.82.14:4241 , piece_id=YZWFVMVW4RIJL5JUUXOG25ZYQUZZZ3P6FZQ6AFBTRZFI74OBJ2FQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aBy6nQScbjzmBSScfEZwTX8NCcP9c71FRQkUH54WvZhhhtXLR): protocol: expected piece hash; context canceled; EOF
Aug 16 22:49:31.627888126 (197h23m53.586985372s) [noise=true , address=77.90.31.12:4602 , piece_id=OH27WBAU3Z5RZA423JF2DWPZ5CIFRZZDW2CQFA3UB27YMKHKAMHA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf): protocol: expected piece hash; context canceled; EOF
Aug 16 22:49:31.628056687 (197h23m53.587153927s) [noise=true , address=104.36.82.23:4469 , piece_id=JH44FO3YNQALB6M5PRITANN5HRMNVM4RY5BOXM5OFYI35FV3LOWA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection; write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection
Aug 16 22:49:31.628079091 (197h23m53.587176328s) [noise=true , address=104.36.82.47:4540 , piece_id=IBPRQX4YHFT3RTB72A5KAWQLSCBHVA6BDN7POOQSZTADZSKX6XAQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection; write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection
Aug 16 22:49:31.628099133 (197h23m53.587196369s) [seg_pos={0 0}, upload=205427]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 22:49:31.628179292 (197h23m53.587276537s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 22:49:31.628195384 (197h23m53.58729263s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 22:49:31.871260215 (197h23m53.830357485s) [upload=205427]: Done uploading segments...
Aug 16 22:49:31.871286118 (197h23m53.830383351s) [upload=205427]: Upload finished. err: <nil>
Duration: 3.037156474s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.......X.....................X.....................X.....X..] duration:
919.885158ms
FAIL (2025-08-16 22:49:37 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 22:48:41.883559329 (197h23m3.842656575s) [upload=205414]: Starting upload Aug 16 22:48:41.883616147 (197h23m3.842713394s) [upload=205414]: Done starting upload Aug 16 22:48:41.883698102 (197h23m3.842795348s) [upload=205414]: Uploading segments... Aug 16 22:48:41.883755229 (197h23m3.842853797s) [upload=205414]: Got next segment. Inline: true Aug 16 22:48:41.883763436 (197h23m3.842860682s) [upload=205414]: Waiting for error group managing segments... Aug 16 22:48:41.883813582 (197h23m3.842910831s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 22:48:41.883820508 (197h23m3.842917756s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 22:48:41.883824499 (197h23m3.842921747s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 22:48:41.975827358 (197h23m3.934924614s) [upload=205414]: Done uploading segments... Aug 16 22:48:41.975867347 (197h23m3.934964606s) [upload=205414]: Upload finished. err: metaclient: Too Many Requests
Duration: 919.914337ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [X..........................................................X] duration:
3.093587722s
FAIL (2025-08-16 22:49:33 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 791528b4431efbda984ff105020a1fa3d2f607da7e832f9772a2edd3a26490b0 != before 620c0ab2bcf8776c74e0f2a9a3fd8e53be0a8b505a80ecd7e638870652f42aca
======LOGS======
Aug 16 22:49:30.196418476 (197h23m52.155515707s) [upload=205427]: Starting upload
Aug 16 22:49:30.196474919 (197h23m52.155572164s) [upload=205427]: Done starting upload
Aug 16 22:49:30.196565257 (197h23m52.155662507s) [upload=205427]: Uploading segments...
Aug 16 22:49:30.196743883 (197h23m52.155841115s) [upload=205427]: Got next segment. Inline: false
Aug 16 22:49:30.196780331 (197h23m52.155877577s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 22:49:30.196785188 (197h23m52.155882433s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 22:49:30.483512934 (197h23m52.4426102s) [seg_pos={0 0}, upload=205427]: Begin upload segment...
Aug 16 22:49:30.483571578 (197h23m52.442668816s) [seg_pos={0 0}, upload=205427]: Done begin upload segment.
Aug 16 22:49:30.483607605 (197h23m52.44270485s) [noise=true , address=77.90.31.10:4525 , piece_id=EBOKK6AGP3TNV7DP4L3PIJTUDC4M74EOKLH6IBDBMN7IPR5Q3DOQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.484090730 (197h23m52.443187982s) [noise=true , address=104.36.82.18:4392 , piece_id=DUJGW7SOHIZ6SL36R24TZXK3WWT7FJ5U2IYR6U4LT4BYOCLHSDYA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.484459664 (197h23m52.443556918s) [noise=true , address=104.36.82.47:4540 , piece_id=IBPRQX4YHFT3RTB72A5KAWQLSCBHVA6BDN7POOQSZTADZSKX6XAQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485065081 (197h23m52.444162336s) [noise=true , address=104.36.82.38:4692 , piece_id=LXH2ORVEJ5Q24P3YY5VE4EFWLAYQS7LVCSJ6UWOV2TEEDYLOEXXQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485525349 (197h23m52.4446226s) [noise=true , address=104.36.82.16:4308 , piece_id=YUKJ2DOGYXBLFSRUJGDBT6CXTOOETTPNDBFPZUW5E6SEAXQMBAIA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.485891474 (197h23m52.444988729s) [noise=true , address=104.36.82.10:4097 , piece_id=GUUN4DD7JPUSO6UVSTQ2QKB2DOES63VXMTI4BLNBJAEQ35AFA47Q, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486268568 (197h23m52.445365815s) [noise=true , address=104.36.82.20:4463 , piece_id=RYRSSCTL3N4GJYTB7MNMI4PKWR7RXLDZ2YVIXY3ERLCXLKEEP4TQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486639528 (197h23m52.445736776s) [noise=true , address=104.36.82.56:4248 , piece_id=TOBE3EZABNRXOGLO3BJ3O4QCWJK4JHS2KYUWYZW6FPFY4TZHPYFA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.486976423 (197h23m52.446073669s) [noise=true , address=104.36.82.60:4353 , piece_id=PKRQ3UTWWSP6K4D6VBTXMKOJWRMRLX27PVE7MXOC7YIJFHDU5OBA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487317315 (197h23m52.446414561s) [noise=true , address=104.36.82.14:4241 , piece_id=YZWFVMVW4RIJL5JUUXOG25ZYQUZZZ3P6FZQ6AFBTRZFI74OBJ2FQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487612071 (197h23m52.446709316s) [noise=true , address=77.90.31.12:4602 , piece_id=OH27WBAU3Z5RZA423JF2DWPZ5CIFRZZDW2CQFA3UB27YMKHKAMHA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.487947801 (197h23m52.447045053s) [noise=true , address=77.90.31.18:4829 , piece_id=SVYXJGIM6K5KO74OELO7YINLHRXUTPHS6RUUGGYJT7PN2IVWUV7A, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.488287344 (197h23m52.4473846s) [noise=true , address=104.36.82.2:4756 , piece_id=XHJLCWAJJ7BMONKDD5O55EJZSOJY4SE2JIXEMW7BMF5VKLIY4ZMA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.488683382 (197h23m52.447780635s) [noise=true , address=45.91.116.12:4253 , piece_id=I5KOLUJN6IOTYWPAVCYXZCXABR36WIQDVG35TDEFMWPSCYS2FNAA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489152324 (197h23m52.448249578s) [noise=true , address=104.36.82.23:4469 , piece_id=JH44FO3YNQALB6M5PRITANN5HRMNVM4RY5BOXM5OFYI35FV3LOWA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489533496 (197h23m52.448630753s) [noise=true , address=104.36.82.9:4016 , piece_id=HTRAGHQC26JUSNWBAE4MUGJ7GGD7NDR7H5S6KQ2OVC63GZLYUVYQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.489992155 (197h23m52.449089406s) [noise=true , address=77.90.31.15:4728 , piece_id=RNCMK7HNBHWDD7OUQHGLPXDA4AL5IKUIFS7JBMMUJ3MNBKRJXWFA, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:30.490332655 (197h23m52.44942991s) [noise=true , address=45.91.116.13:4161 , piece_id=5SE7HKY7PG2AXVK2PSICMLP3ZNQWUDCNTISZKL7A7MGEIZFICMGQ, seg_pos={0 0}, upload=205427]: Uploading piece...
Aug 16 22:49:31.070138080 (197h23m53.029235317s) [upload=205427]: Next returned nil segment
Aug 16 22:49:31.070156240 (197h23m53.029253485s) [upload=205427]: Waiting for error group managing segments...
Aug 16 22:49:31.244750684 (197h23m53.203847918s) [noise=true , address=104.36.82.20:4463 , piece_id=RYRSSCTL3N4GJYTB7MNMI4PKWR7RXLDZ2YVIXY3ERLCXLKEEP4TQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.273373250 (197h23m53.232470481s) [noise=true , address=104.36.82.2:4756 , piece_id=XHJLCWAJJ7BMONKDD5O55EJZSOJY4SE2JIXEMW7BMF5VKLIY4ZMA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.293132979 (197h23m53.252230244s) [noise=true , address=104.36.82.18:4392 , piece_id=DUJGW7SOHIZ6SL36R24TZXK3WWT7FJ5U2IYR6U4LT4BYOCLHSDYA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.318430962 (197h23m53.277528202s) [noise=true , address=104.36.82.60:4353 , piece_id=PKRQ3UTWWSP6K4D6VBTXMKOJWRMRLX27PVE7MXOC7YIJFHDU5OBA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.327035473 (197h23m53.286132717s) [noise=true , address=104.36.82.38:4692 , piece_id=LXH2ORVEJ5Q24P3YY5VE4EFWLAYQS7LVCSJ6UWOV2TEEDYLOEXXQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.338269683 (197h23m53.297366924s) [noise=true , address=45.91.116.13:4161 , piece_id=5SE7HKY7PG2AXVK2PSICMLP3ZNQWUDCNTISZKL7A7MGEIZFICMGQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.352408856 (197h23m53.311506088s) [noise=true , address=45.91.116.12:4253 , piece_id=I5KOLUJN6IOTYWPAVCYXZCXABR36WIQDVG35TDEFMWPSCYS2FNAA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.355334738 (197h23m53.314431976s) [noise=true , address=104.36.82.9:4016 , piece_id=HTRAGHQC26JUSNWBAE4MUGJ7GGD7NDR7H5S6KQ2OVC63GZLYUVYQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.408794808 (197h23m53.367892046s) [noise=true , address=77.90.31.18:4829 , piece_id=SVYXJGIM6K5KO74OELO7YINLHRXUTPHS6RUUGGYJT7PN2IVWUV7A, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.417776712 (197h23m53.376873947s) [noise=true , address=104.36.82.10:4097 , piece_id=GUUN4DD7JPUSO6UVSTQ2QKB2DOES63VXMTI4BLNBJAEQ35AFA47Q, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.430486727 (197h23m53.389583966s) [noise=true , address=77.90.31.15:4728 , piece_id=RNCMK7HNBHWDD7OUQHGLPXDA4AL5IKUIFS7JBMMUJ3MNBKRJXWFA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.489232668 (197h23m53.448329901s) [noise=true , address=104.36.82.16:4308 , piece_id=YUKJ2DOGYXBLFSRUJGDBT6CXTOOETTPNDBFPZUW5E6SEAXQMBAIA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.517002522 (197h23m53.476099767s) [noise=true , address=77.90.31.10:4525 , piece_id=EBOKK6AGP3TNV7DP4L3PIJTUDC4M74EOKLH6IBDBMN7IPR5Q3DOQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.627435127 (197h23m53.586532366s) [noise=true , address=104.36.82.56:4248 , piece_id=TOBE3EZABNRXOGLO3BJ3O4QCWJK4JHS2KYUWYZW6FPFY4TZHPYFA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: <nil>
Aug 16 22:49:31.627456570 (197h23m53.586553809s) [seg_pos={0 0}, upload=205427]: Segment reached optimal threshold of 14 pieces.
Aug 16 22:49:31.627776426 (197h23m53.586873662s) [noise=true , address=104.36.82.14:4241 , piece_id=YZWFVMVW4RIJL5JUUXOG25ZYQUZZZ3P6FZQ6AFBTRZFI74OBJ2FQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aBy6nQScbjzmBSScfEZwTX8NCcP9c71FRQkUH54WvZhhhtXLR): protocol: expected piece hash; context canceled; EOF
Aug 16 22:49:31.627888126 (197h23m53.586985372s) [noise=true , address=77.90.31.12:4602 , piece_id=OH27WBAU3Z5RZA423JF2DWPZ5CIFRZZDW2CQFA3UB27YMKHKAMHA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1GtnQbBbyjZQHrAXhG5r4Kt4MYyiUtEgRnj8VsSjA2q4bGkyjf): protocol: expected piece hash; context canceled; EOF
Aug 16 22:49:31.628056687 (197h23m53.587153927s) [noise=true , address=104.36.82.23:4469 , piece_id=JH44FO3YNQALB6M5PRITANN5HRMNVM4RY5BOXM5OFYI35FV3LOWA, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RWjSXyXqhgufuBewhCBgvBfkerSFeHxJZj88UzusCgiXvibQv): protocol: write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection; write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:35580->104.36.82.23:4469: use of closed network connection
Aug 16 22:49:31.628079091 (197h23m53.587176328s) [noise=true , address=104.36.82.47:4540 , piece_id=IBPRQX4YHFT3RTB72A5KAWQLSCBHVA6BDN7POOQSZTADZSKX6XAQ, seg_pos={0 0}, upload=205427]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P92CRZqnx1avdDo18tMY2X7FujkZugb4gU98AaErD13gX4cLA): protocol: write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection; write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:47152->104.36.82.47:4540: use of closed network connection
Aug 16 22:49:31.628099133 (197h23m53.587196369s) [seg_pos={0 0}, upload=205427]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 22:49:31.628179292 (197h23m53.587276537s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 22:49:31.628195384 (197h23m53.58729263s) [upload=205427]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 22:49:31.871260215 (197h23m53.830357485s) [upload=205427]: Done uploading segments...
Aug 16 22:49:31.871286118 (197h23m53.830383351s) [upload=205427]: Upload finished. err: <nil>
Duration: 3.093671467s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [X.......X.....................X.....................X.....X.] duration:
886.715459ms
FAIL (2025-08-16 22:49:15 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 16 22:48:41.883559329 (197h23m3.842656575s) [upload=205414]: Starting upload Aug 16 22:48:41.883616147 (197h23m3.842713394s) [upload=205414]: Done starting upload Aug 16 22:48:41.883698102 (197h23m3.842795348s) [upload=205414]: Uploading segments... Aug 16 22:48:41.883755229 (197h23m3.842853797s) [upload=205414]: Got next segment. Inline: true Aug 16 22:48:41.883763436 (197h23m3.842860682s) [upload=205414]: Waiting for error group managing segments... Aug 16 22:48:41.883813582 (197h23m3.842910831s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 16 22:48:41.883820508 (197h23m3.842917756s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 16 22:48:41.883824499 (197h23m3.842921747s) [upload=205414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 16 22:48:41.975827358 (197h23m3.934924614s) [upload=205414]: Done uploading segments... Aug 16 22:48:41.975867347 (197h23m3.934964606s) [upload=205414]: Upload finished. err: metaclient: Too Many Requests
Duration: 886.748651ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
3.457027981s
FAIL (2025-08-16 22:49:06 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 32c462c3aea155cb8843295840355c7c6a2f69c2f4e9e03691157b7eee26a96d != before 00b57c30c5b7f14c01aeb08f23f27c57caa545c44180e064bb5227d3da9ef649
======LOGS======
Aug 16 22:06:53.356568886 (196h41m15.315666137s) [upload=204696]: Starting upload
Aug 16 22:06:53.356619088 (196h41m15.315716342s) [upload=204696]: Done starting upload
Aug 16 22:06:53.357029675 (196h41m15.316126916s) [upload=204696]: Uploading segments...
Aug 16 22:06:53.357098590 (196h41m15.316195842s) [upload=204696]: Got next segment. Inline: false
Aug 16 22:06:53.357144945 (196h41m15.316242177s) [upload=204696]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 22:06:53.357149369 (196h41m15.316246614s) [upload=204696]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 22:06:53.556570218 (196h41m15.515667494s) [seg_pos={0 0}, upload=204696]: Begin upload segment...
Aug 16 22:06:53.556642665 (196h41m15.515739919s) [seg_pos={0 0}, upload=204696]: Done begin upload segment.
Aug 16 22:06:53.556699002 (196h41m15.515796259s) [noise=true , address=104.36.82.16:4317 , piece_id=XED3ULLOGC6UT4BU5ZMJNKQ3WJAXJ44OU67X2LCDPOC7CX5TSVDQ, seg_pos={0 0}, upload=204696]: Uploading piece...
Aug 16 22:06:53.557345977 (196h41m15.516443237s) [noise=true , address=104.36.82.7:4916 , piece_id=CVY6JX4FMESXGO7LL7S2ZE7E23F5O5KONMCQRYUJXAFSFYW3VG3A, seg_pos={0 0}, upload=204696]: Uploading piece...
Aug 16 22:06:53.557831759 (196h41m15.516929014s) [noise=true , address=104.36.82.44:4889 , piece_id=JOHX6KDYXOBVWDOZHPPNJIHGBDQAPYBS5ZHDTISFCBKHD4WL2K7Q, seg_pos={0 0}, upload=204696]: Uploading piece...
Aug 16 22:06:53.558052014 (196h41m15.517149266s) [noise=true , address=45.91.116.7:4035 , piece_id=MB3Q45LDYHKRHQXFL667JQJHFIDNXS2UDLOEYHG43LPNFBIZDFNQ, seg_pos={0 0}, upload=204696]: Uploading piece...
Aug 16 22:06:53.558346983 (196h41m15.517444238s) [noise=true , address=104.36.82.13:4189 , piece_id=ZUT4IZCKGFMEFEM6VTD2FGO4E6QUQT6PHOZHQUF7B6IDKRZYMNYQ, seg_pos={0 0}, upload=204696]: Uploading piece...
Aug 16 22:06:53.558419611 (196h41m15.517516858s) [noise=true , address=45.91.116.6:4000 , piece_id=ZF6BA47NMB3MZ6G7FGHIFJYIKTPO5KNBF3V3WPPUWVH7A4CVEK3A, seg_pos={0 0}, upload=204696]: Uploading piece...
Aug 16 22:06:53.558750814 (196h41m15.517848059s) [noise=true , address=104.36.82.37:4687 , piece_id=7PK5HOLILW3XDOET2ULFUEQD7GT7F3PDUTRJ4V4FKSUPP22YRTSQ, seg_pos={0 0}, upload=204696]: Uploading piece...
Aug 16 22:06:53.558836132 (196h41m15.517933386s) [noise=true , address=104.36.82.42:4829 , piece_id=FA7SQEAG6TQL7BYS4QJ4WQDX636FQZNY6P2CQ4NQVWOJCUFK6GSA, seg_pos={0 0}, upload=204696]: Uploading piece...
Aug 16 22:06:53.559076266 (196h41m15.518173514s) [noise=true , address=104.36.82.58:4290 , piece_id=P2GCAOSIJQ7YQS3LFMXY5PO7EDFLYCVE5AA35ZIJWYKQ74LBMKTA, seg_pos={0 0}, upload=204696]: Uploading piece...
Aug 16 22:06:53.559408371 (196h41m15.518505622s) [noise=true , address=45.91.116.9:4292 , piece_id=6PKCUP3SHD6ONJDSURZTIQ72P5SRNH745K57WX46V6L75CRFXA3Q, seg_pos={0 0}, upload=204696]: Uploading piece...
Aug 16 22:06:53.559746702 (196h41m15.518843956s) [noise=true , address=104.36.82.60:4357 , piece_id=3WBHW6MFKXHTGT2OVJJD4FEJDJBUXC22XFN4BONKLUK47AN5S53A, seg_pos={0 0}, upload=204696]: Uploading piece...
Aug 16 22:06:53.560140801 (196h41m15.519238052s) [noise=true , address=77.90.31.15:4700 , piece_id=AN32HAPI4MGJ4MMI7XZC6TQJYQUEU4QJUXEZAQ3XAWGLLPSOYG6A, seg_pos={0 0}, upload=204696]: Uploading piece...
Aug 16 22:06:53.560464955 (196h41m15.519562203s) [noise=true , address=104.36.82.49:4008 , piece_id=MA6IYNTTK3LZEIKV5FJDBP5VEC3I474VDJI5ADIJ6AN5K3YFURYQ, seg_pos={0 0}, upload=204696]: Uploading piece...
Aug 16 22:06:53.560752586 (196h41m15.519849905s) [noise=true , address=104.36.82.38:4701 , piece_id=YDBUV4K2NFUWXXUEYPANACZV6BKX4LBJNTWAGEBNCRZ2UZNMWFVQ, seg_pos={0 0}, upload=204696]: Uploading piece...
Aug 16 22:06:53.561221737 (196h41m15.520318989s) [noise=true , address=104.36.82.35:4599 , piece_id=2VC7S66M7NHJGZ3QWK3BIQWO3M2WIFKMHIDNAYC7ZRHISJ5IEXIA, seg_pos={0 0}, upload=204696]: Uploading piece...
Aug 16 22:06:53.561499810 (196h41m15.520597062s) [noise=true , address=66.23.193.175:4564 , piece_id=KDQTKFWPHQMRSGEFXPGJTXXKTAPFT2D5M2UX3NYYHAIBTPCPNQAA, seg_pos={0 0}, upload=204696]: Uploading piece...
Aug 16 22:06:53.561729920 (196h41m15.52082717s) [noise=true , address=104.36.82.23:4464 , piece_id=ZU65L2WG6TJL5RQR7SG6ZC3EIRS3BRPFIAITEY4SUH4AP3N3K7FA, seg_pos={0 0}, upload=204696]: Uploading piece...
Aug 16 22:06:53.561981402 (196h41m15.521078654s) [noise=true , address=77.90.31.11:4565 , piece_id=IIUDOPJJBS5TGN2FXWAWEZUONDQGBHL2TPYS7EMU5M2KQASP5YWQ, seg_pos={0 0}, upload=204696]: Uploading piece...
Aug 16 22:06:54.101109279 (196h41m16.060206512s) [upload=204696]: Next returned nil segment
Aug 16 22:06:54.101127787 (196h41m16.060225033s) [upload=204696]: Waiting for error group managing segments...
Aug 16 22:06:54.283136150 (196h41m16.242233397s) [noise=true , address=104.36.82.7:4916 , piece_id=CVY6JX4FMESXGO7LL7S2ZE7E23F5O5KONMCQRYUJXAFSFYW3VG3A, seg_pos={0 0}, upload=204696]: Done uploading piece. err: <nil>
Aug 16 22:06:54.325498722 (196h41m16.284595962s) [noise=true , address=104.36.82.23:4464 , piece_id=ZU65L2WG6TJL5RQR7SG6ZC3EIRS3BRPFIAITEY4SUH4AP3N3K7FA, seg_pos={0 0}, upload=204696]: Done uploading piece. err: <nil>
Aug 16 22:06:54.352355445 (196h41m16.311452694s) [noise=true , address=104.36.82.44:4889 , piece_id=JOHX6KDYXOBVWDOZHPPNJIHGBDQAPYBS5ZHDTISFCBKHD4WL2K7Q, seg_pos={0 0}, upload=204696]: Done uploading piece. err: <nil>
Aug 16 22:06:54.363512083 (196h41m16.322609339s) [noise=true , address=104.36.82.58:4290 , piece_id=P2GCAOSIJQ7YQS3LFMXY5PO7EDFLYCVE5AA35ZIJWYKQ74LBMKTA, seg_pos={0 0}, upload=204696]: Done uploading piece. err: <nil>
Aug 16 22:06:54.402351275 (196h41m16.361448521s) [noise=true , address=77.90.31.15:4700 , piece_id=AN32HAPI4MGJ4MMI7XZC6TQJYQUEU4QJUXEZAQ3XAWGLLPSOYG6A, seg_pos={0 0}, upload=204696]: Done uploading piece. err: <nil>
Aug 16 22:06:54.404416895 (196h41m16.363514135s) [noise=true , address=77.90.31.11:4565 , piece_id=IIUDOPJJBS5TGN2FXWAWEZUONDQGBHL2TPYS7EMU5M2KQASP5YWQ, seg_pos={0 0}, upload=204696]: Done uploading piece. err: <nil>
Aug 16 22:06:54.412017786 (196h41m16.371115019s) [noise=true , address=104.36.82.42:4829 , piece_id=FA7SQEAG6TQL7BYS4QJ4WQDX636FQZNY6P2CQ4NQVWOJCUFK6GSA, seg_pos={0 0}, upload=204696]: Done uploading piece. err: <nil>
Aug 16 22:06:54.421522634 (196h41m16.380619866s) [noise=true , address=45.91.116.6:4000 , piece_id=ZF6BA47NMB3MZ6G7FGHIFJYIKTPO5KNBF3V3WPPUWVH7A4CVEK3A, seg_pos={0 0}, upload=204696]: Done uploading piece. err: <nil>
Aug 16 22:06:54.432616556 (196h41m16.391713812s) [noise=true , address=104.36.82.16:4317 , piece_id=XED3ULLOGC6UT4BU5ZMJNKQ3WJAXJ44OU67X2LCDPOC7CX5TSVDQ, seg_pos={0 0}, upload=204696]: Done uploading piece. err: <nil>
Aug 16 22:06:54.469106950 (196h41m16.428204186s) [noise=true , address=104.36.82.49:4008 , piece_id=MA6IYNTTK3LZEIKV5FJDBP5VEC3I474VDJI5ADIJ6AN5K3YFURYQ, seg_pos={0 0}, upload=204696]: Done uploading piece. err: <nil>
Aug 16 22:06:54.473546283 (196h41m16.432643543s) [noise=true , address=104.36.82.60:4357 , piece_id=3WBHW6MFKXHTGT2OVJJD4FEJDJBUXC22XFN4BONKLUK47AN5S53A, seg_pos={0 0}, upload=204696]: Done uploading piece. err: <nil>
Aug 16 22:06:54.487556926 (196h41m16.446654165s) [noise=true , address=104.36.82.38:4701 , piece_id=YDBUV4K2NFUWXXUEYPANACZV6BKX4LBJNTWAGEBNCRZ2UZNMWFVQ, seg_pos={0 0}, upload=204696]: Done uploading piece. err: <nil>
Aug 16 22:06:54.525895982 (196h41m16.484993227s) [noise=true , address=104.36.82.35:4599 , piece_id=2VC7S66M7NHJGZ3QWK3BIQWO3M2WIFKMHIDNAYC7ZRHISJ5IEXIA, seg_pos={0 0}, upload=204696]: Done uploading piece. err: <nil>
Aug 16 22:06:54.642598058 (196h41m16.601695296s) [noise=true , address=45.91.116.9:4292 , piece_id=6PKCUP3SHD6ONJDSURZTIQ72P5SRNH745K57WX46V6L75CRFXA3Q, seg_pos={0 0}, upload=204696]: Done uploading piece. err: <nil>
Aug 16 22:06:54.642634189 (196h41m16.601731435s) [seg_pos={0 0}, upload=204696]: Segment reached optimal threshold of 14 pieces.
Aug 16 22:06:54.642817193 (196h41m16.601914424s) [noise=true , address=104.36.82.37:4687 , piece_id=7PK5HOLILW3XDOET2ULFUEQD7GT7F3PDUTRJ4V4FKSUPP22YRTSQ, seg_pos={0 0}, upload=204696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JZW19SfSwU95frntTgqDhiam1Rva1U8V7yfQkqtKYWntJ24Qf): protocol: expected piece hash; context canceled; EOF
Aug 16 22:06:54.642944879 (196h41m16.602042124s) [noise=true , address=104.36.82.13:4189 , piece_id=ZUT4IZCKGFMEFEM6VTD2FGO4E6QUQT6PHOZHQUF7B6IDKRZYMNYQ, seg_pos={0 0}, upload=204696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jH3757i2F3q18XSpoXznsysZPaXmEnqynpLPDupgRfxJrTgKv): protocol: expected piece hash; context canceled; EOF
Aug 16 22:06:54.643004550 (196h41m16.602101795s) [noise=true , address=66.23.193.175:4564 , piece_id=KDQTKFWPHQMRSGEFXPGJTXXKTAPFT2D5M2UX3NYYHAIBTPCPNQAA, seg_pos={0 0}, upload=204696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: expected piece hash; context canceled; EOF
Aug 16 22:06:54.643067295 (196h41m16.602164535s) [noise=true , address=45.91.116.7:4035 , piece_id=MB3Q45LDYHKRHQXFL667JQJHFIDNXS2UDLOEYHG43LPNFBIZDFNQ, seg_pos={0 0}, upload=204696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UtzGEdmMaJAFkfprwLpTuxP2XDFtiN3Tgcqpnf9UtHVQzdhEg): protocol: write tcp 139.59.144.22:38108->45.91.116.7:4035: use of closed network connection; write tcp 139.59.144.22:38108->45.91.116.7:4035: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38108->45.91.116.7:4035: use of closed network connection
Aug 16 22:06:54.643110319 (196h41m16.602207553s) [seg_pos={0 0}, upload=204696]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 22:06:54.643203051 (196h41m16.602300286s) [upload=204696]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 22:06:54.643208518 (196h41m16.602305763s) [upload=204696]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 22:06:55.807808240 (196h41m17.766905476s) [upload=204696]: Done uploading segments...
Aug 16 22:06:55.807840165 (196h41m17.766937401s) [upload=204696]: Upload finished. err: <nil>
Duration: 3.457129476s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
2.798144587s
FAIL (2025-08-16 22:48:41 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 32c462c3aea155cb8843295840355c7c6a2f69c2f4e9e03691157b7eee26a96d != before 00b57c30c5b7f14c01aeb08f23f27c57caa545c44180e064bb5227d3da9ef649
======LOGS======
Aug 16 22:06:53.356568886 (196h41m15.315666137s) [upload=204696]: Starting upload
Aug 16 22:06:53.356619088 (196h41m15.315716342s) [upload=204696]: Done starting upload
Aug 16 22:06:53.357029675 (196h41m15.316126916s) [upload=204696]: Uploading segments...
Aug 16 22:06:53.357098590 (196h41m15.316195842s) [upload=204696]: Got next segment. Inline: false
Aug 16 22:06:53.357144945 (196h41m15.316242177s) [upload=204696]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 16 22:06:53.357149369 (196h41m15.316246614s) [upload=204696]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 16 22:06:53.556570218 (196h41m15.515667494s) [seg_pos={0 0}, upload=204696]: Begin upload segment...
Aug 16 22:06:53.556642665 (196h41m15.515739919s) [seg_pos={0 0}, upload=204696]: Done begin upload segment.
Aug 16 22:06:53.556699002 (196h41m15.515796259s) [noise=true , address=104.36.82.16:4317 , piece_id=XED3ULLOGC6UT4BU5ZMJNKQ3WJAXJ44OU67X2LCDPOC7CX5TSVDQ, seg_pos={0 0}, upload=204696]: Uploading piece...
Aug 16 22:06:53.557345977 (196h41m15.516443237s) [noise=true , address=104.36.82.7:4916 , piece_id=CVY6JX4FMESXGO7LL7S2ZE7E23F5O5KONMCQRYUJXAFSFYW3VG3A, seg_pos={0 0}, upload=204696]: Uploading piece...
Aug 16 22:06:53.557831759 (196h41m15.516929014s) [noise=true , address=104.36.82.44:4889 , piece_id=JOHX6KDYXOBVWDOZHPPNJIHGBDQAPYBS5ZHDTISFCBKHD4WL2K7Q, seg_pos={0 0}, upload=204696]: Uploading piece...
Aug 16 22:06:53.558052014 (196h41m15.517149266s) [noise=true , address=45.91.116.7:4035 , piece_id=MB3Q45LDYHKRHQXFL667JQJHFIDNXS2UDLOEYHG43LPNFBIZDFNQ, seg_pos={0 0}, upload=204696]: Uploading piece...
Aug 16 22:06:53.558346983 (196h41m15.517444238s) [noise=true , address=104.36.82.13:4189 , piece_id=ZUT4IZCKGFMEFEM6VTD2FGO4E6QUQT6PHOZHQUF7B6IDKRZYMNYQ, seg_pos={0 0}, upload=204696]: Uploading piece...
Aug 16 22:06:53.558419611 (196h41m15.517516858s) [noise=true , address=45.91.116.6:4000 , piece_id=ZF6BA47NMB3MZ6G7FGHIFJYIKTPO5KNBF3V3WPPUWVH7A4CVEK3A, seg_pos={0 0}, upload=204696]: Uploading piece...
Aug 16 22:06:53.558750814 (196h41m15.517848059s) [noise=true , address=104.36.82.37:4687 , piece_id=7PK5HOLILW3XDOET2ULFUEQD7GT7F3PDUTRJ4V4FKSUPP22YRTSQ, seg_pos={0 0}, upload=204696]: Uploading piece...
Aug 16 22:06:53.558836132 (196h41m15.517933386s) [noise=true , address=104.36.82.42:4829 , piece_id=FA7SQEAG6TQL7BYS4QJ4WQDX636FQZNY6P2CQ4NQVWOJCUFK6GSA, seg_pos={0 0}, upload=204696]: Uploading piece...
Aug 16 22:06:53.559076266 (196h41m15.518173514s) [noise=true , address=104.36.82.58:4290 , piece_id=P2GCAOSIJQ7YQS3LFMXY5PO7EDFLYCVE5AA35ZIJWYKQ74LBMKTA, seg_pos={0 0}, upload=204696]: Uploading piece...
Aug 16 22:06:53.559408371 (196h41m15.518505622s) [noise=true , address=45.91.116.9:4292 , piece_id=6PKCUP3SHD6ONJDSURZTIQ72P5SRNH745K57WX46V6L75CRFXA3Q, seg_pos={0 0}, upload=204696]: Uploading piece...
Aug 16 22:06:53.559746702 (196h41m15.518843956s) [noise=true , address=104.36.82.60:4357 , piece_id=3WBHW6MFKXHTGT2OVJJD4FEJDJBUXC22XFN4BONKLUK47AN5S53A, seg_pos={0 0}, upload=204696]: Uploading piece...
Aug 16 22:06:53.560140801 (196h41m15.519238052s) [noise=true , address=77.90.31.15:4700 , piece_id=AN32HAPI4MGJ4MMI7XZC6TQJYQUEU4QJUXEZAQ3XAWGLLPSOYG6A, seg_pos={0 0}, upload=204696]: Uploading piece...
Aug 16 22:06:53.560464955 (196h41m15.519562203s) [noise=true , address=104.36.82.49:4008 , piece_id=MA6IYNTTK3LZEIKV5FJDBP5VEC3I474VDJI5ADIJ6AN5K3YFURYQ, seg_pos={0 0}, upload=204696]: Uploading piece...
Aug 16 22:06:53.560752586 (196h41m15.519849905s) [noise=true , address=104.36.82.38:4701 , piece_id=YDBUV4K2NFUWXXUEYPANACZV6BKX4LBJNTWAGEBNCRZ2UZNMWFVQ, seg_pos={0 0}, upload=204696]: Uploading piece...
Aug 16 22:06:53.561221737 (196h41m15.520318989s) [noise=true , address=104.36.82.35:4599 , piece_id=2VC7S66M7NHJGZ3QWK3BIQWO3M2WIFKMHIDNAYC7ZRHISJ5IEXIA, seg_pos={0 0}, upload=204696]: Uploading piece...
Aug 16 22:06:53.561499810 (196h41m15.520597062s) [noise=true , address=66.23.193.175:4564 , piece_id=KDQTKFWPHQMRSGEFXPGJTXXKTAPFT2D5M2UX3NYYHAIBTPCPNQAA, seg_pos={0 0}, upload=204696]: Uploading piece...
Aug 16 22:06:53.561729920 (196h41m15.52082717s) [noise=true , address=104.36.82.23:4464 , piece_id=ZU65L2WG6TJL5RQR7SG6ZC3EIRS3BRPFIAITEY4SUH4AP3N3K7FA, seg_pos={0 0}, upload=204696]: Uploading piece...
Aug 16 22:06:53.561981402 (196h41m15.521078654s) [noise=true , address=77.90.31.11:4565 , piece_id=IIUDOPJJBS5TGN2FXWAWEZUONDQGBHL2TPYS7EMU5M2KQASP5YWQ, seg_pos={0 0}, upload=204696]: Uploading piece...
Aug 16 22:06:54.101109279 (196h41m16.060206512s) [upload=204696]: Next returned nil segment
Aug 16 22:06:54.101127787 (196h41m16.060225033s) [upload=204696]: Waiting for error group managing segments...
Aug 16 22:06:54.283136150 (196h41m16.242233397s) [noise=true , address=104.36.82.7:4916 , piece_id=CVY6JX4FMESXGO7LL7S2ZE7E23F5O5KONMCQRYUJXAFSFYW3VG3A, seg_pos={0 0}, upload=204696]: Done uploading piece. err: <nil>
Aug 16 22:06:54.325498722 (196h41m16.284595962s) [noise=true , address=104.36.82.23:4464 , piece_id=ZU65L2WG6TJL5RQR7SG6ZC3EIRS3BRPFIAITEY4SUH4AP3N3K7FA, seg_pos={0 0}, upload=204696]: Done uploading piece. err: <nil>
Aug 16 22:06:54.352355445 (196h41m16.311452694s) [noise=true , address=104.36.82.44:4889 , piece_id=JOHX6KDYXOBVWDOZHPPNJIHGBDQAPYBS5ZHDTISFCBKHD4WL2K7Q, seg_pos={0 0}, upload=204696]: Done uploading piece. err: <nil>
Aug 16 22:06:54.363512083 (196h41m16.322609339s) [noise=true , address=104.36.82.58:4290 , piece_id=P2GCAOSIJQ7YQS3LFMXY5PO7EDFLYCVE5AA35ZIJWYKQ74LBMKTA, seg_pos={0 0}, upload=204696]: Done uploading piece. err: <nil>
Aug 16 22:06:54.402351275 (196h41m16.361448521s) [noise=true , address=77.90.31.15:4700 , piece_id=AN32HAPI4MGJ4MMI7XZC6TQJYQUEU4QJUXEZAQ3XAWGLLPSOYG6A, seg_pos={0 0}, upload=204696]: Done uploading piece. err: <nil>
Aug 16 22:06:54.404416895 (196h41m16.363514135s) [noise=true , address=77.90.31.11:4565 , piece_id=IIUDOPJJBS5TGN2FXWAWEZUONDQGBHL2TPYS7EMU5M2KQASP5YWQ, seg_pos={0 0}, upload=204696]: Done uploading piece. err: <nil>
Aug 16 22:06:54.412017786 (196h41m16.371115019s) [noise=true , address=104.36.82.42:4829 , piece_id=FA7SQEAG6TQL7BYS4QJ4WQDX636FQZNY6P2CQ4NQVWOJCUFK6GSA, seg_pos={0 0}, upload=204696]: Done uploading piece. err: <nil>
Aug 16 22:06:54.421522634 (196h41m16.380619866s) [noise=true , address=45.91.116.6:4000 , piece_id=ZF6BA47NMB3MZ6G7FGHIFJYIKTPO5KNBF3V3WPPUWVH7A4CVEK3A, seg_pos={0 0}, upload=204696]: Done uploading piece. err: <nil>
Aug 16 22:06:54.432616556 (196h41m16.391713812s) [noise=true , address=104.36.82.16:4317 , piece_id=XED3ULLOGC6UT4BU5ZMJNKQ3WJAXJ44OU67X2LCDPOC7CX5TSVDQ, seg_pos={0 0}, upload=204696]: Done uploading piece. err: <nil>
Aug 16 22:06:54.469106950 (196h41m16.428204186s) [noise=true , address=104.36.82.49:4008 , piece_id=MA6IYNTTK3LZEIKV5FJDBP5VEC3I474VDJI5ADIJ6AN5K3YFURYQ, seg_pos={0 0}, upload=204696]: Done uploading piece. err: <nil>
Aug 16 22:06:54.473546283 (196h41m16.432643543s) [noise=true , address=104.36.82.60:4357 , piece_id=3WBHW6MFKXHTGT2OVJJD4FEJDJBUXC22XFN4BONKLUK47AN5S53A, seg_pos={0 0}, upload=204696]: Done uploading piece. err: <nil>
Aug 16 22:06:54.487556926 (196h41m16.446654165s) [noise=true , address=104.36.82.38:4701 , piece_id=YDBUV4K2NFUWXXUEYPANACZV6BKX4LBJNTWAGEBNCRZ2UZNMWFVQ, seg_pos={0 0}, upload=204696]: Done uploading piece. err: <nil>
Aug 16 22:06:54.525895982 (196h41m16.484993227s) [noise=true , address=104.36.82.35:4599 , piece_id=2VC7S66M7NHJGZ3QWK3BIQWO3M2WIFKMHIDNAYC7ZRHISJ5IEXIA, seg_pos={0 0}, upload=204696]: Done uploading piece. err: <nil>
Aug 16 22:06:54.642598058 (196h41m16.601695296s) [noise=true , address=45.91.116.9:4292 , piece_id=6PKCUP3SHD6ONJDSURZTIQ72P5SRNH745K57WX46V6L75CRFXA3Q, seg_pos={0 0}, upload=204696]: Done uploading piece. err: <nil>
Aug 16 22:06:54.642634189 (196h41m16.601731435s) [seg_pos={0 0}, upload=204696]: Segment reached optimal threshold of 14 pieces.
Aug 16 22:06:54.642817193 (196h41m16.601914424s) [noise=true , address=104.36.82.37:4687 , piece_id=7PK5HOLILW3XDOET2ULFUEQD7GT7F3PDUTRJ4V4FKSUPP22YRTSQ, seg_pos={0 0}, upload=204696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12JZW19SfSwU95frntTgqDhiam1Rva1U8V7yfQkqtKYWntJ24Qf): protocol: expected piece hash; context canceled; EOF
Aug 16 22:06:54.642944879 (196h41m16.602042124s) [noise=true , address=104.36.82.13:4189 , piece_id=ZUT4IZCKGFMEFEM6VTD2FGO4E6QUQT6PHOZHQUF7B6IDKRZYMNYQ, seg_pos={0 0}, upload=204696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1jH3757i2F3q18XSpoXznsysZPaXmEnqynpLPDupgRfxJrTgKv): protocol: expected piece hash; context canceled; EOF
Aug 16 22:06:54.643004550 (196h41m16.602101795s) [noise=true , address=66.23.193.175:4564 , piece_id=KDQTKFWPHQMRSGEFXPGJTXXKTAPFT2D5M2UX3NYYHAIBTPCPNQAA, seg_pos={0 0}, upload=204696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mHRT84eY5SYdo2c5LCZ4KsmXGsr6ErTqDCkehAYxqFJa58rfj): protocol: expected piece hash; context canceled; EOF
Aug 16 22:06:54.643067295 (196h41m16.602164535s) [noise=true , address=45.91.116.7:4035 , piece_id=MB3Q45LDYHKRHQXFL667JQJHFIDNXS2UDLOEYHG43LPNFBIZDFNQ, seg_pos={0 0}, upload=204696]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12UtzGEdmMaJAFkfprwLpTuxP2XDFtiN3Tgcqpnf9UtHVQzdhEg): protocol: write tcp 139.59.144.22:38108->45.91.116.7:4035: use of closed network connection; write tcp 139.59.144.22:38108->45.91.116.7:4035: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:38108->45.91.116.7:4035: use of closed network connection
Aug 16 22:06:54.643110319 (196h41m16.602207553s) [seg_pos={0 0}, upload=204696]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 16 22:06:54.643203051 (196h41m16.602300286s) [upload=204696]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 16 22:06:54.643208518 (196h41m16.602305763s) [upload=204696]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 16 22:06:55.807808240 (196h41m17.766905476s) [upload=204696]: Done uploading segments...
Aug 16 22:06:55.807840165 (196h41m17.766937401s) [upload=204696]: Upload finished. err: <nil>
Duration: 2.798193824s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|