Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [........XX..................................................] duration:
2.767846696s
FAIL (2025-08-17 04:10:27 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.767929876s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................X.........................................] duration:
2.91911508s
FAIL (2025-08-17 04:10:20 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0fe20535773fb327f0e1285fd8d60c2bacd0f393282f9562a7724de9fba7434c != before d861b10cb2a70d29d52a521a7de003da28a3c1fb9f6ac2aa0f41e49f8d58fc1d
======LOGS======
Aug 17 03:40:21.175138804 (202h14m43.134236052s) [upload=210504]: Starting upload
Aug 17 03:40:21.175208980 (202h14m43.134306217s) [upload=210504]: Done starting upload
Aug 17 03:40:21.175379812 (202h14m43.134477046s) [upload=210504]: Uploading segments...
Aug 17 03:40:21.175510502 (202h14m43.134607736s) [upload=210504]: Got next segment. Inline: false
Aug 17 03:40:21.175587606 (202h14m43.134684852s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:40:21.175594399 (202h14m43.134691635s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:40:21.373030471 (202h14m43.332127716s) [seg_pos={0 0}, upload=210504]: Begin upload segment...
Aug 17 03:40:21.373095598 (202h14m43.332192844s) [seg_pos={0 0}, upload=210504]: Done begin upload segment.
Aug 17 03:40:21.373132912 (202h14m43.332230173s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.373186791 (202h14m43.332284067s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.374685881 (202h14m43.333783136s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376635904 (202h14m43.335733152s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376973502 (202h14m43.336070751s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377215392 (202h14m43.336312647s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377509865 (202h14m43.336607118s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377978724 (202h14m43.337075975s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378693200 (202h14m43.337790452s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378774753 (202h14m43.337872008s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.379242861 (202h14m43.338340116s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.380069773 (202h14m43.339167024s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.381076965 (202h14m43.34017422s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.382172018 (202h14m43.341269276s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.383215225 (202h14m43.34231248s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.385585359 (202h14m43.344682614s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.388118409 (202h14m43.347215666s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.390509177 (202h14m43.349606432s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.938694025 (202h14m43.89779127s) [upload=210504]: Next returned nil segment
Aug 17 03:40:21.938740605 (202h14m43.897837861s) [upload=210504]: Waiting for error group managing segments...
Aug 17 03:40:22.087061299 (202h14m44.046158551s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.093286222 (202h14m44.052383462s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.100022851 (202h14m44.059120106s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.110175808 (202h14m44.069273065s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.112690417 (202h14m44.071787669s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.113235068 (202h14m44.072332326s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.116860571 (202h14m44.075957818s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.125847240 (202h14m44.084944476s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.136788037 (202h14m44.095885284s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.141259899 (202h14m44.100357152s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.157600317 (202h14m44.116697563s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.169517275 (202h14m44.128614514s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.170723689 (202h14m44.129820924s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174287593 (202h14m44.133384838s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174338363 (202h14m44.133435608s) [seg_pos={0 0}, upload=210504]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:40:22.174565125 (202h14m44.133662363s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vV1hGhZqeEoh5ei7yRu49oyAvTZ2T7S1x3ooufJPtFH2TGBkQ): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175117521 (202h14m44.134214757s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1B7uLDPBrYvc1N81dKm8bcYnhYwjA5mRdRfeQpWqKqrJjmQJgC): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175174465 (202h14m44.13427171s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERtrzMuh8rZPsgebtyScmYvNVwz3UKJr5Nu2hLdu6sn8X3qLa): protocol: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection
Aug 17 03:40:22.175189814 (202h14m44.134287051s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p6mcvX3TBdnYy5Eaugk1t5KPfoeJT1sxcg5TX8aSRGVhHGSsy): protocol: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection
Aug 17 03:40:22.175205651 (202h14m44.134302897s) [seg_pos={0 0}, upload=210504]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:40:22.175290900 (202h14m44.134388146s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:40:22.175296636 (202h14m44.134393881s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:40:22.330950759 (202h14m44.290047995s) [upload=210504]: Done uploading segments...
Aug 17 03:40:22.330970889 (202h14m44.290068125s) [upload=210504]: Upload finished. err: <nil>
Duration: 2.91914642s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........XX.................................................] duration:
2.792391623s
FAIL (2025-08-17 04:09:38 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.792464097s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................X........................................] duration:
2.475451228s
FAIL (2025-08-17 04:09:33 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0fe20535773fb327f0e1285fd8d60c2bacd0f393282f9562a7724de9fba7434c != before d861b10cb2a70d29d52a521a7de003da28a3c1fb9f6ac2aa0f41e49f8d58fc1d
======LOGS======
Aug 17 03:40:21.175138804 (202h14m43.134236052s) [upload=210504]: Starting upload
Aug 17 03:40:21.175208980 (202h14m43.134306217s) [upload=210504]: Done starting upload
Aug 17 03:40:21.175379812 (202h14m43.134477046s) [upload=210504]: Uploading segments...
Aug 17 03:40:21.175510502 (202h14m43.134607736s) [upload=210504]: Got next segment. Inline: false
Aug 17 03:40:21.175587606 (202h14m43.134684852s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:40:21.175594399 (202h14m43.134691635s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:40:21.373030471 (202h14m43.332127716s) [seg_pos={0 0}, upload=210504]: Begin upload segment...
Aug 17 03:40:21.373095598 (202h14m43.332192844s) [seg_pos={0 0}, upload=210504]: Done begin upload segment.
Aug 17 03:40:21.373132912 (202h14m43.332230173s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.373186791 (202h14m43.332284067s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.374685881 (202h14m43.333783136s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376635904 (202h14m43.335733152s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376973502 (202h14m43.336070751s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377215392 (202h14m43.336312647s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377509865 (202h14m43.336607118s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377978724 (202h14m43.337075975s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378693200 (202h14m43.337790452s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378774753 (202h14m43.337872008s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.379242861 (202h14m43.338340116s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.380069773 (202h14m43.339167024s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.381076965 (202h14m43.34017422s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.382172018 (202h14m43.341269276s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.383215225 (202h14m43.34231248s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.385585359 (202h14m43.344682614s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.388118409 (202h14m43.347215666s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.390509177 (202h14m43.349606432s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.938694025 (202h14m43.89779127s) [upload=210504]: Next returned nil segment
Aug 17 03:40:21.938740605 (202h14m43.897837861s) [upload=210504]: Waiting for error group managing segments...
Aug 17 03:40:22.087061299 (202h14m44.046158551s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.093286222 (202h14m44.052383462s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.100022851 (202h14m44.059120106s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.110175808 (202h14m44.069273065s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.112690417 (202h14m44.071787669s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.113235068 (202h14m44.072332326s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.116860571 (202h14m44.075957818s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.125847240 (202h14m44.084944476s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.136788037 (202h14m44.095885284s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.141259899 (202h14m44.100357152s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.157600317 (202h14m44.116697563s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.169517275 (202h14m44.128614514s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.170723689 (202h14m44.129820924s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174287593 (202h14m44.133384838s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174338363 (202h14m44.133435608s) [seg_pos={0 0}, upload=210504]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:40:22.174565125 (202h14m44.133662363s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vV1hGhZqeEoh5ei7yRu49oyAvTZ2T7S1x3ooufJPtFH2TGBkQ): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175117521 (202h14m44.134214757s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1B7uLDPBrYvc1N81dKm8bcYnhYwjA5mRdRfeQpWqKqrJjmQJgC): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175174465 (202h14m44.13427171s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERtrzMuh8rZPsgebtyScmYvNVwz3UKJr5Nu2hLdu6sn8X3qLa): protocol: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection
Aug 17 03:40:22.175189814 (202h14m44.134287051s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p6mcvX3TBdnYy5Eaugk1t5KPfoeJT1sxcg5TX8aSRGVhHGSsy): protocol: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection
Aug 17 03:40:22.175205651 (202h14m44.134302897s) [seg_pos={0 0}, upload=210504]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:40:22.175290900 (202h14m44.134388146s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:40:22.175296636 (202h14m44.134393881s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:40:22.330950759 (202h14m44.290047995s) [upload=210504]: Done uploading segments...
Aug 17 03:40:22.330970889 (202h14m44.290068125s) [upload=210504]: Upload finished. err: <nil>
Duration: 2.475487158s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........XX................................................] duration:
3.130133106s
FAIL (2025-08-17 04:09:06 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.130231337s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................X.......................................] duration:
2.580980927s
FAIL (2025-08-17 04:08:41 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0fe20535773fb327f0e1285fd8d60c2bacd0f393282f9562a7724de9fba7434c != before d861b10cb2a70d29d52a521a7de003da28a3c1fb9f6ac2aa0f41e49f8d58fc1d
======LOGS======
Aug 17 03:40:21.175138804 (202h14m43.134236052s) [upload=210504]: Starting upload
Aug 17 03:40:21.175208980 (202h14m43.134306217s) [upload=210504]: Done starting upload
Aug 17 03:40:21.175379812 (202h14m43.134477046s) [upload=210504]: Uploading segments...
Aug 17 03:40:21.175510502 (202h14m43.134607736s) [upload=210504]: Got next segment. Inline: false
Aug 17 03:40:21.175587606 (202h14m43.134684852s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:40:21.175594399 (202h14m43.134691635s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:40:21.373030471 (202h14m43.332127716s) [seg_pos={0 0}, upload=210504]: Begin upload segment...
Aug 17 03:40:21.373095598 (202h14m43.332192844s) [seg_pos={0 0}, upload=210504]: Done begin upload segment.
Aug 17 03:40:21.373132912 (202h14m43.332230173s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.373186791 (202h14m43.332284067s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.374685881 (202h14m43.333783136s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376635904 (202h14m43.335733152s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376973502 (202h14m43.336070751s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377215392 (202h14m43.336312647s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377509865 (202h14m43.336607118s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377978724 (202h14m43.337075975s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378693200 (202h14m43.337790452s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378774753 (202h14m43.337872008s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.379242861 (202h14m43.338340116s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.380069773 (202h14m43.339167024s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.381076965 (202h14m43.34017422s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.382172018 (202h14m43.341269276s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.383215225 (202h14m43.34231248s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.385585359 (202h14m43.344682614s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.388118409 (202h14m43.347215666s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.390509177 (202h14m43.349606432s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.938694025 (202h14m43.89779127s) [upload=210504]: Next returned nil segment
Aug 17 03:40:21.938740605 (202h14m43.897837861s) [upload=210504]: Waiting for error group managing segments...
Aug 17 03:40:22.087061299 (202h14m44.046158551s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.093286222 (202h14m44.052383462s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.100022851 (202h14m44.059120106s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.110175808 (202h14m44.069273065s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.112690417 (202h14m44.071787669s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.113235068 (202h14m44.072332326s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.116860571 (202h14m44.075957818s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.125847240 (202h14m44.084944476s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.136788037 (202h14m44.095885284s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.141259899 (202h14m44.100357152s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.157600317 (202h14m44.116697563s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.169517275 (202h14m44.128614514s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.170723689 (202h14m44.129820924s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174287593 (202h14m44.133384838s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174338363 (202h14m44.133435608s) [seg_pos={0 0}, upload=210504]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:40:22.174565125 (202h14m44.133662363s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vV1hGhZqeEoh5ei7yRu49oyAvTZ2T7S1x3ooufJPtFH2TGBkQ): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175117521 (202h14m44.134214757s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1B7uLDPBrYvc1N81dKm8bcYnhYwjA5mRdRfeQpWqKqrJjmQJgC): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175174465 (202h14m44.13427171s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERtrzMuh8rZPsgebtyScmYvNVwz3UKJr5Nu2hLdu6sn8X3qLa): protocol: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection
Aug 17 03:40:22.175189814 (202h14m44.134287051s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p6mcvX3TBdnYy5Eaugk1t5KPfoeJT1sxcg5TX8aSRGVhHGSsy): protocol: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection
Aug 17 03:40:22.175205651 (202h14m44.134302897s) [seg_pos={0 0}, upload=210504]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:40:22.175290900 (202h14m44.134388146s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:40:22.175296636 (202h14m44.134393881s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:40:22.330950759 (202h14m44.290047995s) [upload=210504]: Done uploading segments...
Aug 17 03:40:22.330970889 (202h14m44.290068125s) [upload=210504]: Upload finished. err: <nil>
Duration: 2.581087103s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........XX...............................................] duration:
2.715472256s
FAIL (2025-08-17 04:08:34 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.715542339s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................X......................................] duration:
2.540447652s
FAIL (2025-08-17 04:08:07 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0fe20535773fb327f0e1285fd8d60c2bacd0f393282f9562a7724de9fba7434c != before d861b10cb2a70d29d52a521a7de003da28a3c1fb9f6ac2aa0f41e49f8d58fc1d
======LOGS======
Aug 17 03:40:21.175138804 (202h14m43.134236052s) [upload=210504]: Starting upload
Aug 17 03:40:21.175208980 (202h14m43.134306217s) [upload=210504]: Done starting upload
Aug 17 03:40:21.175379812 (202h14m43.134477046s) [upload=210504]: Uploading segments...
Aug 17 03:40:21.175510502 (202h14m43.134607736s) [upload=210504]: Got next segment. Inline: false
Aug 17 03:40:21.175587606 (202h14m43.134684852s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:40:21.175594399 (202h14m43.134691635s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:40:21.373030471 (202h14m43.332127716s) [seg_pos={0 0}, upload=210504]: Begin upload segment...
Aug 17 03:40:21.373095598 (202h14m43.332192844s) [seg_pos={0 0}, upload=210504]: Done begin upload segment.
Aug 17 03:40:21.373132912 (202h14m43.332230173s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.373186791 (202h14m43.332284067s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.374685881 (202h14m43.333783136s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376635904 (202h14m43.335733152s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376973502 (202h14m43.336070751s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377215392 (202h14m43.336312647s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377509865 (202h14m43.336607118s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377978724 (202h14m43.337075975s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378693200 (202h14m43.337790452s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378774753 (202h14m43.337872008s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.379242861 (202h14m43.338340116s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.380069773 (202h14m43.339167024s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.381076965 (202h14m43.34017422s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.382172018 (202h14m43.341269276s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.383215225 (202h14m43.34231248s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.385585359 (202h14m43.344682614s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.388118409 (202h14m43.347215666s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.390509177 (202h14m43.349606432s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.938694025 (202h14m43.89779127s) [upload=210504]: Next returned nil segment
Aug 17 03:40:21.938740605 (202h14m43.897837861s) [upload=210504]: Waiting for error group managing segments...
Aug 17 03:40:22.087061299 (202h14m44.046158551s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.093286222 (202h14m44.052383462s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.100022851 (202h14m44.059120106s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.110175808 (202h14m44.069273065s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.112690417 (202h14m44.071787669s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.113235068 (202h14m44.072332326s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.116860571 (202h14m44.075957818s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.125847240 (202h14m44.084944476s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.136788037 (202h14m44.095885284s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.141259899 (202h14m44.100357152s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.157600317 (202h14m44.116697563s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.169517275 (202h14m44.128614514s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.170723689 (202h14m44.129820924s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174287593 (202h14m44.133384838s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174338363 (202h14m44.133435608s) [seg_pos={0 0}, upload=210504]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:40:22.174565125 (202h14m44.133662363s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vV1hGhZqeEoh5ei7yRu49oyAvTZ2T7S1x3ooufJPtFH2TGBkQ): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175117521 (202h14m44.134214757s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1B7uLDPBrYvc1N81dKm8bcYnhYwjA5mRdRfeQpWqKqrJjmQJgC): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175174465 (202h14m44.13427171s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERtrzMuh8rZPsgebtyScmYvNVwz3UKJr5Nu2hLdu6sn8X3qLa): protocol: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection
Aug 17 03:40:22.175189814 (202h14m44.134287051s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p6mcvX3TBdnYy5Eaugk1t5KPfoeJT1sxcg5TX8aSRGVhHGSsy): protocol: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection
Aug 17 03:40:22.175205651 (202h14m44.134302897s) [seg_pos={0 0}, upload=210504]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:40:22.175290900 (202h14m44.134388146s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:40:22.175296636 (202h14m44.134393881s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:40:22.330950759 (202h14m44.290047995s) [upload=210504]: Done uploading segments...
Aug 17 03:40:22.330970889 (202h14m44.290068125s) [upload=210504]: Upload finished. err: <nil>
Duration: 2.5404871s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [............XX..............................................] duration:
2.812092518s
FAIL (2025-08-17 04:07:52 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.812119724s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
2.677851323s
FAIL (2025-08-17 04:07:48 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0fe20535773fb327f0e1285fd8d60c2bacd0f393282f9562a7724de9fba7434c != before d861b10cb2a70d29d52a521a7de003da28a3c1fb9f6ac2aa0f41e49f8d58fc1d
======LOGS======
Aug 17 03:40:21.175138804 (202h14m43.134236052s) [upload=210504]: Starting upload
Aug 17 03:40:21.175208980 (202h14m43.134306217s) [upload=210504]: Done starting upload
Aug 17 03:40:21.175379812 (202h14m43.134477046s) [upload=210504]: Uploading segments...
Aug 17 03:40:21.175510502 (202h14m43.134607736s) [upload=210504]: Got next segment. Inline: false
Aug 17 03:40:21.175587606 (202h14m43.134684852s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:40:21.175594399 (202h14m43.134691635s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:40:21.373030471 (202h14m43.332127716s) [seg_pos={0 0}, upload=210504]: Begin upload segment...
Aug 17 03:40:21.373095598 (202h14m43.332192844s) [seg_pos={0 0}, upload=210504]: Done begin upload segment.
Aug 17 03:40:21.373132912 (202h14m43.332230173s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.373186791 (202h14m43.332284067s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.374685881 (202h14m43.333783136s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376635904 (202h14m43.335733152s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376973502 (202h14m43.336070751s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377215392 (202h14m43.336312647s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377509865 (202h14m43.336607118s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377978724 (202h14m43.337075975s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378693200 (202h14m43.337790452s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378774753 (202h14m43.337872008s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.379242861 (202h14m43.338340116s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.380069773 (202h14m43.339167024s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.381076965 (202h14m43.34017422s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.382172018 (202h14m43.341269276s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.383215225 (202h14m43.34231248s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.385585359 (202h14m43.344682614s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.388118409 (202h14m43.347215666s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.390509177 (202h14m43.349606432s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.938694025 (202h14m43.89779127s) [upload=210504]: Next returned nil segment
Aug 17 03:40:21.938740605 (202h14m43.897837861s) [upload=210504]: Waiting for error group managing segments...
Aug 17 03:40:22.087061299 (202h14m44.046158551s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.093286222 (202h14m44.052383462s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.100022851 (202h14m44.059120106s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.110175808 (202h14m44.069273065s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.112690417 (202h14m44.071787669s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.113235068 (202h14m44.072332326s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.116860571 (202h14m44.075957818s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.125847240 (202h14m44.084944476s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.136788037 (202h14m44.095885284s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.141259899 (202h14m44.100357152s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.157600317 (202h14m44.116697563s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.169517275 (202h14m44.128614514s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.170723689 (202h14m44.129820924s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174287593 (202h14m44.133384838s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174338363 (202h14m44.133435608s) [seg_pos={0 0}, upload=210504]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:40:22.174565125 (202h14m44.133662363s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vV1hGhZqeEoh5ei7yRu49oyAvTZ2T7S1x3ooufJPtFH2TGBkQ): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175117521 (202h14m44.134214757s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1B7uLDPBrYvc1N81dKm8bcYnhYwjA5mRdRfeQpWqKqrJjmQJgC): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175174465 (202h14m44.13427171s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERtrzMuh8rZPsgebtyScmYvNVwz3UKJr5Nu2hLdu6sn8X3qLa): protocol: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection
Aug 17 03:40:22.175189814 (202h14m44.134287051s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p6mcvX3TBdnYy5Eaugk1t5KPfoeJT1sxcg5TX8aSRGVhHGSsy): protocol: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection
Aug 17 03:40:22.175205651 (202h14m44.134302897s) [seg_pos={0 0}, upload=210504]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:40:22.175290900 (202h14m44.134388146s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:40:22.175296636 (202h14m44.134393881s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:40:22.330950759 (202h14m44.290047995s) [upload=210504]: Done uploading segments...
Aug 17 03:40:22.330970889 (202h14m44.290068125s) [upload=210504]: Upload finished. err: <nil>
Duration: 2.677887686s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............XX.............................................] duration:
2.750900692s
FAIL (2025-08-17 04:07:30 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.750993764s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
2.430745106s
FAIL (2025-08-17 04:07:03 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0fe20535773fb327f0e1285fd8d60c2bacd0f393282f9562a7724de9fba7434c != before d861b10cb2a70d29d52a521a7de003da28a3c1fb9f6ac2aa0f41e49f8d58fc1d
======LOGS======
Aug 17 03:40:21.175138804 (202h14m43.134236052s) [upload=210504]: Starting upload
Aug 17 03:40:21.175208980 (202h14m43.134306217s) [upload=210504]: Done starting upload
Aug 17 03:40:21.175379812 (202h14m43.134477046s) [upload=210504]: Uploading segments...
Aug 17 03:40:21.175510502 (202h14m43.134607736s) [upload=210504]: Got next segment. Inline: false
Aug 17 03:40:21.175587606 (202h14m43.134684852s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:40:21.175594399 (202h14m43.134691635s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:40:21.373030471 (202h14m43.332127716s) [seg_pos={0 0}, upload=210504]: Begin upload segment...
Aug 17 03:40:21.373095598 (202h14m43.332192844s) [seg_pos={0 0}, upload=210504]: Done begin upload segment.
Aug 17 03:40:21.373132912 (202h14m43.332230173s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.373186791 (202h14m43.332284067s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.374685881 (202h14m43.333783136s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376635904 (202h14m43.335733152s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376973502 (202h14m43.336070751s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377215392 (202h14m43.336312647s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377509865 (202h14m43.336607118s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377978724 (202h14m43.337075975s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378693200 (202h14m43.337790452s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378774753 (202h14m43.337872008s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.379242861 (202h14m43.338340116s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.380069773 (202h14m43.339167024s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.381076965 (202h14m43.34017422s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.382172018 (202h14m43.341269276s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.383215225 (202h14m43.34231248s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.385585359 (202h14m43.344682614s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.388118409 (202h14m43.347215666s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.390509177 (202h14m43.349606432s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.938694025 (202h14m43.89779127s) [upload=210504]: Next returned nil segment
Aug 17 03:40:21.938740605 (202h14m43.897837861s) [upload=210504]: Waiting for error group managing segments...
Aug 17 03:40:22.087061299 (202h14m44.046158551s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.093286222 (202h14m44.052383462s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.100022851 (202h14m44.059120106s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.110175808 (202h14m44.069273065s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.112690417 (202h14m44.071787669s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.113235068 (202h14m44.072332326s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.116860571 (202h14m44.075957818s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.125847240 (202h14m44.084944476s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.136788037 (202h14m44.095885284s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.141259899 (202h14m44.100357152s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.157600317 (202h14m44.116697563s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.169517275 (202h14m44.128614514s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.170723689 (202h14m44.129820924s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174287593 (202h14m44.133384838s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174338363 (202h14m44.133435608s) [seg_pos={0 0}, upload=210504]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:40:22.174565125 (202h14m44.133662363s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vV1hGhZqeEoh5ei7yRu49oyAvTZ2T7S1x3ooufJPtFH2TGBkQ): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175117521 (202h14m44.134214757s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1B7uLDPBrYvc1N81dKm8bcYnhYwjA5mRdRfeQpWqKqrJjmQJgC): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175174465 (202h14m44.13427171s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERtrzMuh8rZPsgebtyScmYvNVwz3UKJr5Nu2hLdu6sn8X3qLa): protocol: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection
Aug 17 03:40:22.175189814 (202h14m44.134287051s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p6mcvX3TBdnYy5Eaugk1t5KPfoeJT1sxcg5TX8aSRGVhHGSsy): protocol: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection
Aug 17 03:40:22.175205651 (202h14m44.134302897s) [seg_pos={0 0}, upload=210504]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:40:22.175290900 (202h14m44.134388146s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:40:22.175296636 (202h14m44.134393881s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:40:22.330950759 (202h14m44.290047995s) [upload=210504]: Done uploading segments...
Aug 17 03:40:22.330970889 (202h14m44.290068125s) [upload=210504]: Upload finished. err: <nil>
Duration: 2.430787092s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............XX............................................] duration:
2.999631521s
FAIL (2025-08-17 04:07:02 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.999792668s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............XX...........................................] duration:
2.768400149s
FAIL (2025-08-17 04:06:33 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.768426655s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
2.603572281s
FAIL (2025-08-17 04:06:28 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0fe20535773fb327f0e1285fd8d60c2bacd0f393282f9562a7724de9fba7434c != before d861b10cb2a70d29d52a521a7de003da28a3c1fb9f6ac2aa0f41e49f8d58fc1d
======LOGS======
Aug 17 03:40:21.175138804 (202h14m43.134236052s) [upload=210504]: Starting upload
Aug 17 03:40:21.175208980 (202h14m43.134306217s) [upload=210504]: Done starting upload
Aug 17 03:40:21.175379812 (202h14m43.134477046s) [upload=210504]: Uploading segments...
Aug 17 03:40:21.175510502 (202h14m43.134607736s) [upload=210504]: Got next segment. Inline: false
Aug 17 03:40:21.175587606 (202h14m43.134684852s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:40:21.175594399 (202h14m43.134691635s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:40:21.373030471 (202h14m43.332127716s) [seg_pos={0 0}, upload=210504]: Begin upload segment...
Aug 17 03:40:21.373095598 (202h14m43.332192844s) [seg_pos={0 0}, upload=210504]: Done begin upload segment.
Aug 17 03:40:21.373132912 (202h14m43.332230173s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.373186791 (202h14m43.332284067s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.374685881 (202h14m43.333783136s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376635904 (202h14m43.335733152s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376973502 (202h14m43.336070751s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377215392 (202h14m43.336312647s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377509865 (202h14m43.336607118s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377978724 (202h14m43.337075975s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378693200 (202h14m43.337790452s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378774753 (202h14m43.337872008s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.379242861 (202h14m43.338340116s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.380069773 (202h14m43.339167024s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.381076965 (202h14m43.34017422s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.382172018 (202h14m43.341269276s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.383215225 (202h14m43.34231248s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.385585359 (202h14m43.344682614s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.388118409 (202h14m43.347215666s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.390509177 (202h14m43.349606432s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.938694025 (202h14m43.89779127s) [upload=210504]: Next returned nil segment
Aug 17 03:40:21.938740605 (202h14m43.897837861s) [upload=210504]: Waiting for error group managing segments...
Aug 17 03:40:22.087061299 (202h14m44.046158551s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.093286222 (202h14m44.052383462s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.100022851 (202h14m44.059120106s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.110175808 (202h14m44.069273065s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.112690417 (202h14m44.071787669s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.113235068 (202h14m44.072332326s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.116860571 (202h14m44.075957818s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.125847240 (202h14m44.084944476s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.136788037 (202h14m44.095885284s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.141259899 (202h14m44.100357152s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.157600317 (202h14m44.116697563s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.169517275 (202h14m44.128614514s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.170723689 (202h14m44.129820924s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174287593 (202h14m44.133384838s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174338363 (202h14m44.133435608s) [seg_pos={0 0}, upload=210504]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:40:22.174565125 (202h14m44.133662363s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vV1hGhZqeEoh5ei7yRu49oyAvTZ2T7S1x3ooufJPtFH2TGBkQ): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175117521 (202h14m44.134214757s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1B7uLDPBrYvc1N81dKm8bcYnhYwjA5mRdRfeQpWqKqrJjmQJgC): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175174465 (202h14m44.13427171s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERtrzMuh8rZPsgebtyScmYvNVwz3UKJr5Nu2hLdu6sn8X3qLa): protocol: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection
Aug 17 03:40:22.175189814 (202h14m44.134287051s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p6mcvX3TBdnYy5Eaugk1t5KPfoeJT1sxcg5TX8aSRGVhHGSsy): protocol: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection
Aug 17 03:40:22.175205651 (202h14m44.134302897s) [seg_pos={0 0}, upload=210504]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:40:22.175290900 (202h14m44.134388146s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:40:22.175296636 (202h14m44.134393881s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:40:22.330950759 (202h14m44.290047995s) [upload=210504]: Done uploading segments...
Aug 17 03:40:22.330970889 (202h14m44.290068125s) [upload=210504]: Upload finished. err: <nil>
Duration: 2.6036048s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [X........................X..................................] duration:
2.428876438s
FAIL (2025-08-17 04:05:49 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0fe20535773fb327f0e1285fd8d60c2bacd0f393282f9562a7724de9fba7434c != before d861b10cb2a70d29d52a521a7de003da28a3c1fb9f6ac2aa0f41e49f8d58fc1d
======LOGS======
Aug 17 03:40:21.175138804 (202h14m43.134236052s) [upload=210504]: Starting upload
Aug 17 03:40:21.175208980 (202h14m43.134306217s) [upload=210504]: Done starting upload
Aug 17 03:40:21.175379812 (202h14m43.134477046s) [upload=210504]: Uploading segments...
Aug 17 03:40:21.175510502 (202h14m43.134607736s) [upload=210504]: Got next segment. Inline: false
Aug 17 03:40:21.175587606 (202h14m43.134684852s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:40:21.175594399 (202h14m43.134691635s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:40:21.373030471 (202h14m43.332127716s) [seg_pos={0 0}, upload=210504]: Begin upload segment...
Aug 17 03:40:21.373095598 (202h14m43.332192844s) [seg_pos={0 0}, upload=210504]: Done begin upload segment.
Aug 17 03:40:21.373132912 (202h14m43.332230173s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.373186791 (202h14m43.332284067s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.374685881 (202h14m43.333783136s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376635904 (202h14m43.335733152s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376973502 (202h14m43.336070751s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377215392 (202h14m43.336312647s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377509865 (202h14m43.336607118s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377978724 (202h14m43.337075975s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378693200 (202h14m43.337790452s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378774753 (202h14m43.337872008s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.379242861 (202h14m43.338340116s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.380069773 (202h14m43.339167024s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.381076965 (202h14m43.34017422s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.382172018 (202h14m43.341269276s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.383215225 (202h14m43.34231248s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.385585359 (202h14m43.344682614s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.388118409 (202h14m43.347215666s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.390509177 (202h14m43.349606432s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.938694025 (202h14m43.89779127s) [upload=210504]: Next returned nil segment
Aug 17 03:40:21.938740605 (202h14m43.897837861s) [upload=210504]: Waiting for error group managing segments...
Aug 17 03:40:22.087061299 (202h14m44.046158551s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.093286222 (202h14m44.052383462s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.100022851 (202h14m44.059120106s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.110175808 (202h14m44.069273065s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.112690417 (202h14m44.071787669s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.113235068 (202h14m44.072332326s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.116860571 (202h14m44.075957818s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.125847240 (202h14m44.084944476s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.136788037 (202h14m44.095885284s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.141259899 (202h14m44.100357152s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.157600317 (202h14m44.116697563s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.169517275 (202h14m44.128614514s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.170723689 (202h14m44.129820924s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174287593 (202h14m44.133384838s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174338363 (202h14m44.133435608s) [seg_pos={0 0}, upload=210504]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:40:22.174565125 (202h14m44.133662363s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vV1hGhZqeEoh5ei7yRu49oyAvTZ2T7S1x3ooufJPtFH2TGBkQ): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175117521 (202h14m44.134214757s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1B7uLDPBrYvc1N81dKm8bcYnhYwjA5mRdRfeQpWqKqrJjmQJgC): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175174465 (202h14m44.13427171s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERtrzMuh8rZPsgebtyScmYvNVwz3UKJr5Nu2hLdu6sn8X3qLa): protocol: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection
Aug 17 03:40:22.175189814 (202h14m44.134287051s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p6mcvX3TBdnYy5Eaugk1t5KPfoeJT1sxcg5TX8aSRGVhHGSsy): protocol: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection
Aug 17 03:40:22.175205651 (202h14m44.134302897s) [seg_pos={0 0}, upload=210504]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:40:22.175290900 (202h14m44.134388146s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:40:22.175296636 (202h14m44.134393881s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:40:22.330950759 (202h14m44.290047995s) [upload=210504]: Done uploading segments...
Aug 17 03:40:22.330970889 (202h14m44.290068125s) [upload=210504]: Upload finished. err: <nil>
Duration: 2.428910803s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [................XX..........................................] duration:
3.100783488s
FAIL (2025-08-17 04:05:41 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 3.100818241s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.X........................X.................................] duration:
2.407842765s
FAIL (2025-08-17 04:05:29 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0fe20535773fb327f0e1285fd8d60c2bacd0f393282f9562a7724de9fba7434c != before d861b10cb2a70d29d52a521a7de003da28a3c1fb9f6ac2aa0f41e49f8d58fc1d
======LOGS======
Aug 17 03:40:21.175138804 (202h14m43.134236052s) [upload=210504]: Starting upload
Aug 17 03:40:21.175208980 (202h14m43.134306217s) [upload=210504]: Done starting upload
Aug 17 03:40:21.175379812 (202h14m43.134477046s) [upload=210504]: Uploading segments...
Aug 17 03:40:21.175510502 (202h14m43.134607736s) [upload=210504]: Got next segment. Inline: false
Aug 17 03:40:21.175587606 (202h14m43.134684852s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:40:21.175594399 (202h14m43.134691635s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:40:21.373030471 (202h14m43.332127716s) [seg_pos={0 0}, upload=210504]: Begin upload segment...
Aug 17 03:40:21.373095598 (202h14m43.332192844s) [seg_pos={0 0}, upload=210504]: Done begin upload segment.
Aug 17 03:40:21.373132912 (202h14m43.332230173s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.373186791 (202h14m43.332284067s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.374685881 (202h14m43.333783136s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376635904 (202h14m43.335733152s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376973502 (202h14m43.336070751s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377215392 (202h14m43.336312647s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377509865 (202h14m43.336607118s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377978724 (202h14m43.337075975s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378693200 (202h14m43.337790452s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378774753 (202h14m43.337872008s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.379242861 (202h14m43.338340116s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.380069773 (202h14m43.339167024s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.381076965 (202h14m43.34017422s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.382172018 (202h14m43.341269276s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.383215225 (202h14m43.34231248s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.385585359 (202h14m43.344682614s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.388118409 (202h14m43.347215666s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.390509177 (202h14m43.349606432s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.938694025 (202h14m43.89779127s) [upload=210504]: Next returned nil segment
Aug 17 03:40:21.938740605 (202h14m43.897837861s) [upload=210504]: Waiting for error group managing segments...
Aug 17 03:40:22.087061299 (202h14m44.046158551s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.093286222 (202h14m44.052383462s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.100022851 (202h14m44.059120106s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.110175808 (202h14m44.069273065s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.112690417 (202h14m44.071787669s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.113235068 (202h14m44.072332326s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.116860571 (202h14m44.075957818s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.125847240 (202h14m44.084944476s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.136788037 (202h14m44.095885284s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.141259899 (202h14m44.100357152s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.157600317 (202h14m44.116697563s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.169517275 (202h14m44.128614514s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.170723689 (202h14m44.129820924s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174287593 (202h14m44.133384838s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174338363 (202h14m44.133435608s) [seg_pos={0 0}, upload=210504]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:40:22.174565125 (202h14m44.133662363s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vV1hGhZqeEoh5ei7yRu49oyAvTZ2T7S1x3ooufJPtFH2TGBkQ): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175117521 (202h14m44.134214757s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1B7uLDPBrYvc1N81dKm8bcYnhYwjA5mRdRfeQpWqKqrJjmQJgC): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175174465 (202h14m44.13427171s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERtrzMuh8rZPsgebtyScmYvNVwz3UKJr5Nu2hLdu6sn8X3qLa): protocol: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection
Aug 17 03:40:22.175189814 (202h14m44.134287051s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p6mcvX3TBdnYy5Eaugk1t5KPfoeJT1sxcg5TX8aSRGVhHGSsy): protocol: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection
Aug 17 03:40:22.175205651 (202h14m44.134302897s) [seg_pos={0 0}, upload=210504]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:40:22.175290900 (202h14m44.134388146s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:40:22.175296636 (202h14m44.134393881s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:40:22.330950759 (202h14m44.290047995s) [upload=210504]: Done uploading segments...
Aug 17 03:40:22.330970889 (202h14m44.290068125s) [upload=210504]: Upload finished. err: <nil>
Duration: 2.407873685s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................XX.........................................] duration:
2.778168927s
FAIL (2025-08-17 04:05:08 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.778209309s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..X........................X................................] duration:
2.747358501s
FAIL (2025-08-17 04:04:23 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0fe20535773fb327f0e1285fd8d60c2bacd0f393282f9562a7724de9fba7434c != before d861b10cb2a70d29d52a521a7de003da28a3c1fb9f6ac2aa0f41e49f8d58fc1d
======LOGS======
Aug 17 03:40:21.175138804 (202h14m43.134236052s) [upload=210504]: Starting upload
Aug 17 03:40:21.175208980 (202h14m43.134306217s) [upload=210504]: Done starting upload
Aug 17 03:40:21.175379812 (202h14m43.134477046s) [upload=210504]: Uploading segments...
Aug 17 03:40:21.175510502 (202h14m43.134607736s) [upload=210504]: Got next segment. Inline: false
Aug 17 03:40:21.175587606 (202h14m43.134684852s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:40:21.175594399 (202h14m43.134691635s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:40:21.373030471 (202h14m43.332127716s) [seg_pos={0 0}, upload=210504]: Begin upload segment...
Aug 17 03:40:21.373095598 (202h14m43.332192844s) [seg_pos={0 0}, upload=210504]: Done begin upload segment.
Aug 17 03:40:21.373132912 (202h14m43.332230173s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.373186791 (202h14m43.332284067s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.374685881 (202h14m43.333783136s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376635904 (202h14m43.335733152s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376973502 (202h14m43.336070751s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377215392 (202h14m43.336312647s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377509865 (202h14m43.336607118s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377978724 (202h14m43.337075975s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378693200 (202h14m43.337790452s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378774753 (202h14m43.337872008s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.379242861 (202h14m43.338340116s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.380069773 (202h14m43.339167024s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.381076965 (202h14m43.34017422s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.382172018 (202h14m43.341269276s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.383215225 (202h14m43.34231248s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.385585359 (202h14m43.344682614s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.388118409 (202h14m43.347215666s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.390509177 (202h14m43.349606432s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.938694025 (202h14m43.89779127s) [upload=210504]: Next returned nil segment
Aug 17 03:40:21.938740605 (202h14m43.897837861s) [upload=210504]: Waiting for error group managing segments...
Aug 17 03:40:22.087061299 (202h14m44.046158551s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.093286222 (202h14m44.052383462s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.100022851 (202h14m44.059120106s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.110175808 (202h14m44.069273065s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.112690417 (202h14m44.071787669s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.113235068 (202h14m44.072332326s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.116860571 (202h14m44.075957818s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.125847240 (202h14m44.084944476s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.136788037 (202h14m44.095885284s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.141259899 (202h14m44.100357152s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.157600317 (202h14m44.116697563s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.169517275 (202h14m44.128614514s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.170723689 (202h14m44.129820924s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174287593 (202h14m44.133384838s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174338363 (202h14m44.133435608s) [seg_pos={0 0}, upload=210504]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:40:22.174565125 (202h14m44.133662363s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vV1hGhZqeEoh5ei7yRu49oyAvTZ2T7S1x3ooufJPtFH2TGBkQ): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175117521 (202h14m44.134214757s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1B7uLDPBrYvc1N81dKm8bcYnhYwjA5mRdRfeQpWqKqrJjmQJgC): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175174465 (202h14m44.13427171s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERtrzMuh8rZPsgebtyScmYvNVwz3UKJr5Nu2hLdu6sn8X3qLa): protocol: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection
Aug 17 03:40:22.175189814 (202h14m44.134287051s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p6mcvX3TBdnYy5Eaugk1t5KPfoeJT1sxcg5TX8aSRGVhHGSsy): protocol: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection
Aug 17 03:40:22.175205651 (202h14m44.134302897s) [seg_pos={0 0}, upload=210504]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:40:22.175290900 (202h14m44.134388146s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:40:22.175296636 (202h14m44.134393881s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:40:22.330950759 (202h14m44.290047995s) [upload=210504]: Done uploading segments...
Aug 17 03:40:22.330970889 (202h14m44.290068125s) [upload=210504]: Upload finished. err: <nil>
Duration: 2.747392726s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................XX........................................] duration:
2.932893704s
FAIL (2025-08-17 04:04:02 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.932932518s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...X........................X...............................] duration:
2.30500953s
FAIL (2025-08-17 04:03:43 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0fe20535773fb327f0e1285fd8d60c2bacd0f393282f9562a7724de9fba7434c != before d861b10cb2a70d29d52a521a7de003da28a3c1fb9f6ac2aa0f41e49f8d58fc1d
======LOGS======
Aug 17 03:40:21.175138804 (202h14m43.134236052s) [upload=210504]: Starting upload
Aug 17 03:40:21.175208980 (202h14m43.134306217s) [upload=210504]: Done starting upload
Aug 17 03:40:21.175379812 (202h14m43.134477046s) [upload=210504]: Uploading segments...
Aug 17 03:40:21.175510502 (202h14m43.134607736s) [upload=210504]: Got next segment. Inline: false
Aug 17 03:40:21.175587606 (202h14m43.134684852s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:40:21.175594399 (202h14m43.134691635s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:40:21.373030471 (202h14m43.332127716s) [seg_pos={0 0}, upload=210504]: Begin upload segment...
Aug 17 03:40:21.373095598 (202h14m43.332192844s) [seg_pos={0 0}, upload=210504]: Done begin upload segment.
Aug 17 03:40:21.373132912 (202h14m43.332230173s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.373186791 (202h14m43.332284067s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.374685881 (202h14m43.333783136s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376635904 (202h14m43.335733152s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376973502 (202h14m43.336070751s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377215392 (202h14m43.336312647s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377509865 (202h14m43.336607118s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377978724 (202h14m43.337075975s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378693200 (202h14m43.337790452s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378774753 (202h14m43.337872008s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.379242861 (202h14m43.338340116s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.380069773 (202h14m43.339167024s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.381076965 (202h14m43.34017422s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.382172018 (202h14m43.341269276s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.383215225 (202h14m43.34231248s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.385585359 (202h14m43.344682614s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.388118409 (202h14m43.347215666s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.390509177 (202h14m43.349606432s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.938694025 (202h14m43.89779127s) [upload=210504]: Next returned nil segment
Aug 17 03:40:21.938740605 (202h14m43.897837861s) [upload=210504]: Waiting for error group managing segments...
Aug 17 03:40:22.087061299 (202h14m44.046158551s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.093286222 (202h14m44.052383462s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.100022851 (202h14m44.059120106s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.110175808 (202h14m44.069273065s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.112690417 (202h14m44.071787669s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.113235068 (202h14m44.072332326s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.116860571 (202h14m44.075957818s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.125847240 (202h14m44.084944476s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.136788037 (202h14m44.095885284s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.141259899 (202h14m44.100357152s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.157600317 (202h14m44.116697563s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.169517275 (202h14m44.128614514s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.170723689 (202h14m44.129820924s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174287593 (202h14m44.133384838s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174338363 (202h14m44.133435608s) [seg_pos={0 0}, upload=210504]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:40:22.174565125 (202h14m44.133662363s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vV1hGhZqeEoh5ei7yRu49oyAvTZ2T7S1x3ooufJPtFH2TGBkQ): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175117521 (202h14m44.134214757s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1B7uLDPBrYvc1N81dKm8bcYnhYwjA5mRdRfeQpWqKqrJjmQJgC): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175174465 (202h14m44.13427171s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERtrzMuh8rZPsgebtyScmYvNVwz3UKJr5Nu2hLdu6sn8X3qLa): protocol: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection
Aug 17 03:40:22.175189814 (202h14m44.134287051s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p6mcvX3TBdnYy5Eaugk1t5KPfoeJT1sxcg5TX8aSRGVhHGSsy): protocol: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection
Aug 17 03:40:22.175205651 (202h14m44.134302897s) [seg_pos={0 0}, upload=210504]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:40:22.175290900 (202h14m44.134388146s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:40:22.175296636 (202h14m44.134393881s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:40:22.330950759 (202h14m44.290047995s) [upload=210504]: Done uploading segments...
Aug 17 03:40:22.330970889 (202h14m44.290068125s) [upload=210504]: Upload finished. err: <nil>
Duration: 2.305043382s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [....X........................X..............................] duration:
3.073070702s
FAIL (2025-08-17 04:03:11 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0fe20535773fb327f0e1285fd8d60c2bacd0f393282f9562a7724de9fba7434c != before d861b10cb2a70d29d52a521a7de003da28a3c1fb9f6ac2aa0f41e49f8d58fc1d
======LOGS======
Aug 17 03:40:21.175138804 (202h14m43.134236052s) [upload=210504]: Starting upload
Aug 17 03:40:21.175208980 (202h14m43.134306217s) [upload=210504]: Done starting upload
Aug 17 03:40:21.175379812 (202h14m43.134477046s) [upload=210504]: Uploading segments...
Aug 17 03:40:21.175510502 (202h14m43.134607736s) [upload=210504]: Got next segment. Inline: false
Aug 17 03:40:21.175587606 (202h14m43.134684852s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:40:21.175594399 (202h14m43.134691635s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:40:21.373030471 (202h14m43.332127716s) [seg_pos={0 0}, upload=210504]: Begin upload segment...
Aug 17 03:40:21.373095598 (202h14m43.332192844s) [seg_pos={0 0}, upload=210504]: Done begin upload segment.
Aug 17 03:40:21.373132912 (202h14m43.332230173s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.373186791 (202h14m43.332284067s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.374685881 (202h14m43.333783136s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376635904 (202h14m43.335733152s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376973502 (202h14m43.336070751s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377215392 (202h14m43.336312647s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377509865 (202h14m43.336607118s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377978724 (202h14m43.337075975s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378693200 (202h14m43.337790452s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378774753 (202h14m43.337872008s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.379242861 (202h14m43.338340116s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.380069773 (202h14m43.339167024s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.381076965 (202h14m43.34017422s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.382172018 (202h14m43.341269276s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.383215225 (202h14m43.34231248s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.385585359 (202h14m43.344682614s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.388118409 (202h14m43.347215666s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.390509177 (202h14m43.349606432s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.938694025 (202h14m43.89779127s) [upload=210504]: Next returned nil segment
Aug 17 03:40:21.938740605 (202h14m43.897837861s) [upload=210504]: Waiting for error group managing segments...
Aug 17 03:40:22.087061299 (202h14m44.046158551s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.093286222 (202h14m44.052383462s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.100022851 (202h14m44.059120106s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.110175808 (202h14m44.069273065s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.112690417 (202h14m44.071787669s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.113235068 (202h14m44.072332326s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.116860571 (202h14m44.075957818s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.125847240 (202h14m44.084944476s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.136788037 (202h14m44.095885284s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.141259899 (202h14m44.100357152s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.157600317 (202h14m44.116697563s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.169517275 (202h14m44.128614514s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.170723689 (202h14m44.129820924s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174287593 (202h14m44.133384838s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174338363 (202h14m44.133435608s) [seg_pos={0 0}, upload=210504]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:40:22.174565125 (202h14m44.133662363s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vV1hGhZqeEoh5ei7yRu49oyAvTZ2T7S1x3ooufJPtFH2TGBkQ): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175117521 (202h14m44.134214757s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1B7uLDPBrYvc1N81dKm8bcYnhYwjA5mRdRfeQpWqKqrJjmQJgC): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175174465 (202h14m44.13427171s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERtrzMuh8rZPsgebtyScmYvNVwz3UKJr5Nu2hLdu6sn8X3qLa): protocol: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection
Aug 17 03:40:22.175189814 (202h14m44.134287051s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p6mcvX3TBdnYy5Eaugk1t5KPfoeJT1sxcg5TX8aSRGVhHGSsy): protocol: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection
Aug 17 03:40:22.175205651 (202h14m44.134302897s) [seg_pos={0 0}, upload=210504]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:40:22.175290900 (202h14m44.134388146s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:40:22.175296636 (202h14m44.134393881s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:40:22.330950759 (202h14m44.290047995s) [upload=210504]: Done uploading segments...
Aug 17 03:40:22.330970889 (202h14m44.290068125s) [upload=210504]: Upload finished. err: <nil>
Duration: 3.073101702s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................XX.......................................] duration:
2.614151241s
FAIL (2025-08-17 04:03:07 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.614163747s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [....................XX......................................] duration:
2.92116342s
FAIL (2025-08-17 04:02:23 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.921243371s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....X........................X.............................] duration:
2.53406509s
FAIL (2025-08-17 04:02:17 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0fe20535773fb327f0e1285fd8d60c2bacd0f393282f9562a7724de9fba7434c != before d861b10cb2a70d29d52a521a7de003da28a3c1fb9f6ac2aa0f41e49f8d58fc1d
======LOGS======
Aug 17 03:40:21.175138804 (202h14m43.134236052s) [upload=210504]: Starting upload
Aug 17 03:40:21.175208980 (202h14m43.134306217s) [upload=210504]: Done starting upload
Aug 17 03:40:21.175379812 (202h14m43.134477046s) [upload=210504]: Uploading segments...
Aug 17 03:40:21.175510502 (202h14m43.134607736s) [upload=210504]: Got next segment. Inline: false
Aug 17 03:40:21.175587606 (202h14m43.134684852s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:40:21.175594399 (202h14m43.134691635s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:40:21.373030471 (202h14m43.332127716s) [seg_pos={0 0}, upload=210504]: Begin upload segment...
Aug 17 03:40:21.373095598 (202h14m43.332192844s) [seg_pos={0 0}, upload=210504]: Done begin upload segment.
Aug 17 03:40:21.373132912 (202h14m43.332230173s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.373186791 (202h14m43.332284067s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.374685881 (202h14m43.333783136s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376635904 (202h14m43.335733152s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376973502 (202h14m43.336070751s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377215392 (202h14m43.336312647s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377509865 (202h14m43.336607118s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377978724 (202h14m43.337075975s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378693200 (202h14m43.337790452s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378774753 (202h14m43.337872008s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.379242861 (202h14m43.338340116s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.380069773 (202h14m43.339167024s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.381076965 (202h14m43.34017422s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.382172018 (202h14m43.341269276s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.383215225 (202h14m43.34231248s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.385585359 (202h14m43.344682614s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.388118409 (202h14m43.347215666s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.390509177 (202h14m43.349606432s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.938694025 (202h14m43.89779127s) [upload=210504]: Next returned nil segment
Aug 17 03:40:21.938740605 (202h14m43.897837861s) [upload=210504]: Waiting for error group managing segments...
Aug 17 03:40:22.087061299 (202h14m44.046158551s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.093286222 (202h14m44.052383462s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.100022851 (202h14m44.059120106s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.110175808 (202h14m44.069273065s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.112690417 (202h14m44.071787669s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.113235068 (202h14m44.072332326s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.116860571 (202h14m44.075957818s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.125847240 (202h14m44.084944476s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.136788037 (202h14m44.095885284s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.141259899 (202h14m44.100357152s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.157600317 (202h14m44.116697563s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.169517275 (202h14m44.128614514s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.170723689 (202h14m44.129820924s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174287593 (202h14m44.133384838s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174338363 (202h14m44.133435608s) [seg_pos={0 0}, upload=210504]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:40:22.174565125 (202h14m44.133662363s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vV1hGhZqeEoh5ei7yRu49oyAvTZ2T7S1x3ooufJPtFH2TGBkQ): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175117521 (202h14m44.134214757s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1B7uLDPBrYvc1N81dKm8bcYnhYwjA5mRdRfeQpWqKqrJjmQJgC): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175174465 (202h14m44.13427171s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERtrzMuh8rZPsgebtyScmYvNVwz3UKJr5Nu2hLdu6sn8X3qLa): protocol: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection
Aug 17 03:40:22.175189814 (202h14m44.134287051s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p6mcvX3TBdnYy5Eaugk1t5KPfoeJT1sxcg5TX8aSRGVhHGSsy): protocol: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection
Aug 17 03:40:22.175205651 (202h14m44.134302897s) [seg_pos={0 0}, upload=210504]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:40:22.175290900 (202h14m44.134388146s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:40:22.175296636 (202h14m44.134393881s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:40:22.330950759 (202h14m44.290047995s) [upload=210504]: Done uploading segments...
Aug 17 03:40:22.330970889 (202h14m44.290068125s) [upload=210504]: Upload finished. err: <nil>
Duration: 2.534089911s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [......X........................X............................] duration:
2.982685981s
FAIL (2025-08-17 04:01:31 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0fe20535773fb327f0e1285fd8d60c2bacd0f393282f9562a7724de9fba7434c != before d861b10cb2a70d29d52a521a7de003da28a3c1fb9f6ac2aa0f41e49f8d58fc1d
======LOGS======
Aug 17 03:40:21.175138804 (202h14m43.134236052s) [upload=210504]: Starting upload
Aug 17 03:40:21.175208980 (202h14m43.134306217s) [upload=210504]: Done starting upload
Aug 17 03:40:21.175379812 (202h14m43.134477046s) [upload=210504]: Uploading segments...
Aug 17 03:40:21.175510502 (202h14m43.134607736s) [upload=210504]: Got next segment. Inline: false
Aug 17 03:40:21.175587606 (202h14m43.134684852s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:40:21.175594399 (202h14m43.134691635s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:40:21.373030471 (202h14m43.332127716s) [seg_pos={0 0}, upload=210504]: Begin upload segment...
Aug 17 03:40:21.373095598 (202h14m43.332192844s) [seg_pos={0 0}, upload=210504]: Done begin upload segment.
Aug 17 03:40:21.373132912 (202h14m43.332230173s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.373186791 (202h14m43.332284067s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.374685881 (202h14m43.333783136s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376635904 (202h14m43.335733152s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376973502 (202h14m43.336070751s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377215392 (202h14m43.336312647s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377509865 (202h14m43.336607118s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377978724 (202h14m43.337075975s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378693200 (202h14m43.337790452s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378774753 (202h14m43.337872008s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.379242861 (202h14m43.338340116s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.380069773 (202h14m43.339167024s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.381076965 (202h14m43.34017422s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.382172018 (202h14m43.341269276s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.383215225 (202h14m43.34231248s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.385585359 (202h14m43.344682614s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.388118409 (202h14m43.347215666s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.390509177 (202h14m43.349606432s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.938694025 (202h14m43.89779127s) [upload=210504]: Next returned nil segment
Aug 17 03:40:21.938740605 (202h14m43.897837861s) [upload=210504]: Waiting for error group managing segments...
Aug 17 03:40:22.087061299 (202h14m44.046158551s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.093286222 (202h14m44.052383462s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.100022851 (202h14m44.059120106s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.110175808 (202h14m44.069273065s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.112690417 (202h14m44.071787669s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.113235068 (202h14m44.072332326s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.116860571 (202h14m44.075957818s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.125847240 (202h14m44.084944476s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.136788037 (202h14m44.095885284s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.141259899 (202h14m44.100357152s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.157600317 (202h14m44.116697563s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.169517275 (202h14m44.128614514s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.170723689 (202h14m44.129820924s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174287593 (202h14m44.133384838s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174338363 (202h14m44.133435608s) [seg_pos={0 0}, upload=210504]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:40:22.174565125 (202h14m44.133662363s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vV1hGhZqeEoh5ei7yRu49oyAvTZ2T7S1x3ooufJPtFH2TGBkQ): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175117521 (202h14m44.134214757s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1B7uLDPBrYvc1N81dKm8bcYnhYwjA5mRdRfeQpWqKqrJjmQJgC): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175174465 (202h14m44.13427171s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERtrzMuh8rZPsgebtyScmYvNVwz3UKJr5Nu2hLdu6sn8X3qLa): protocol: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection
Aug 17 03:40:22.175189814 (202h14m44.134287051s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p6mcvX3TBdnYy5Eaugk1t5KPfoeJT1sxcg5TX8aSRGVhHGSsy): protocol: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection
Aug 17 03:40:22.175205651 (202h14m44.134302897s) [seg_pos={0 0}, upload=210504]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:40:22.175290900 (202h14m44.134388146s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:40:22.175296636 (202h14m44.134393881s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:40:22.330950759 (202h14m44.290047995s) [upload=210504]: Done uploading segments...
Aug 17 03:40:22.330970889 (202h14m44.290068125s) [upload=210504]: Upload finished. err: <nil>
Duration: 2.982729436s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.....................XX.....................................] duration:
2.621262352s
FAIL (2025-08-17 04:01:09 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.621291006s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......X........................X...........................] duration:
2.491123583s
FAIL (2025-08-17 04:01:00 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0fe20535773fb327f0e1285fd8d60c2bacd0f393282f9562a7724de9fba7434c != before d861b10cb2a70d29d52a521a7de003da28a3c1fb9f6ac2aa0f41e49f8d58fc1d
======LOGS======
Aug 17 03:40:21.175138804 (202h14m43.134236052s) [upload=210504]: Starting upload
Aug 17 03:40:21.175208980 (202h14m43.134306217s) [upload=210504]: Done starting upload
Aug 17 03:40:21.175379812 (202h14m43.134477046s) [upload=210504]: Uploading segments...
Aug 17 03:40:21.175510502 (202h14m43.134607736s) [upload=210504]: Got next segment. Inline: false
Aug 17 03:40:21.175587606 (202h14m43.134684852s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:40:21.175594399 (202h14m43.134691635s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:40:21.373030471 (202h14m43.332127716s) [seg_pos={0 0}, upload=210504]: Begin upload segment...
Aug 17 03:40:21.373095598 (202h14m43.332192844s) [seg_pos={0 0}, upload=210504]: Done begin upload segment.
Aug 17 03:40:21.373132912 (202h14m43.332230173s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.373186791 (202h14m43.332284067s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.374685881 (202h14m43.333783136s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376635904 (202h14m43.335733152s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376973502 (202h14m43.336070751s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377215392 (202h14m43.336312647s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377509865 (202h14m43.336607118s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377978724 (202h14m43.337075975s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378693200 (202h14m43.337790452s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378774753 (202h14m43.337872008s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.379242861 (202h14m43.338340116s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.380069773 (202h14m43.339167024s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.381076965 (202h14m43.34017422s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.382172018 (202h14m43.341269276s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.383215225 (202h14m43.34231248s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.385585359 (202h14m43.344682614s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.388118409 (202h14m43.347215666s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.390509177 (202h14m43.349606432s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.938694025 (202h14m43.89779127s) [upload=210504]: Next returned nil segment
Aug 17 03:40:21.938740605 (202h14m43.897837861s) [upload=210504]: Waiting for error group managing segments...
Aug 17 03:40:22.087061299 (202h14m44.046158551s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.093286222 (202h14m44.052383462s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.100022851 (202h14m44.059120106s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.110175808 (202h14m44.069273065s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.112690417 (202h14m44.071787669s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.113235068 (202h14m44.072332326s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.116860571 (202h14m44.075957818s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.125847240 (202h14m44.084944476s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.136788037 (202h14m44.095885284s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.141259899 (202h14m44.100357152s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.157600317 (202h14m44.116697563s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.169517275 (202h14m44.128614514s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.170723689 (202h14m44.129820924s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174287593 (202h14m44.133384838s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174338363 (202h14m44.133435608s) [seg_pos={0 0}, upload=210504]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:40:22.174565125 (202h14m44.133662363s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vV1hGhZqeEoh5ei7yRu49oyAvTZ2T7S1x3ooufJPtFH2TGBkQ): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175117521 (202h14m44.134214757s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1B7uLDPBrYvc1N81dKm8bcYnhYwjA5mRdRfeQpWqKqrJjmQJgC): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175174465 (202h14m44.13427171s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERtrzMuh8rZPsgebtyScmYvNVwz3UKJr5Nu2hLdu6sn8X3qLa): protocol: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection
Aug 17 03:40:22.175189814 (202h14m44.134287051s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p6mcvX3TBdnYy5Eaugk1t5KPfoeJT1sxcg5TX8aSRGVhHGSsy): protocol: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection
Aug 17 03:40:22.175205651 (202h14m44.134302897s) [seg_pos={0 0}, upload=210504]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:40:22.175290900 (202h14m44.134388146s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:40:22.175296636 (202h14m44.134393881s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:40:22.330950759 (202h14m44.290047995s) [upload=210504]: Done uploading segments...
Aug 17 03:40:22.330970889 (202h14m44.290068125s) [upload=210504]: Upload finished. err: <nil>
Duration: 2.491152001s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [........X........................X..........................] duration:
2.493483115s
FAIL (2025-08-17 04:00:24 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0fe20535773fb327f0e1285fd8d60c2bacd0f393282f9562a7724de9fba7434c != before d861b10cb2a70d29d52a521a7de003da28a3c1fb9f6ac2aa0f41e49f8d58fc1d
======LOGS======
Aug 17 03:40:21.175138804 (202h14m43.134236052s) [upload=210504]: Starting upload
Aug 17 03:40:21.175208980 (202h14m43.134306217s) [upload=210504]: Done starting upload
Aug 17 03:40:21.175379812 (202h14m43.134477046s) [upload=210504]: Uploading segments...
Aug 17 03:40:21.175510502 (202h14m43.134607736s) [upload=210504]: Got next segment. Inline: false
Aug 17 03:40:21.175587606 (202h14m43.134684852s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:40:21.175594399 (202h14m43.134691635s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:40:21.373030471 (202h14m43.332127716s) [seg_pos={0 0}, upload=210504]: Begin upload segment...
Aug 17 03:40:21.373095598 (202h14m43.332192844s) [seg_pos={0 0}, upload=210504]: Done begin upload segment.
Aug 17 03:40:21.373132912 (202h14m43.332230173s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.373186791 (202h14m43.332284067s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.374685881 (202h14m43.333783136s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376635904 (202h14m43.335733152s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376973502 (202h14m43.336070751s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377215392 (202h14m43.336312647s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377509865 (202h14m43.336607118s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377978724 (202h14m43.337075975s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378693200 (202h14m43.337790452s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378774753 (202h14m43.337872008s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.379242861 (202h14m43.338340116s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.380069773 (202h14m43.339167024s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.381076965 (202h14m43.34017422s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.382172018 (202h14m43.341269276s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.383215225 (202h14m43.34231248s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.385585359 (202h14m43.344682614s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.388118409 (202h14m43.347215666s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.390509177 (202h14m43.349606432s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.938694025 (202h14m43.89779127s) [upload=210504]: Next returned nil segment
Aug 17 03:40:21.938740605 (202h14m43.897837861s) [upload=210504]: Waiting for error group managing segments...
Aug 17 03:40:22.087061299 (202h14m44.046158551s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.093286222 (202h14m44.052383462s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.100022851 (202h14m44.059120106s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.110175808 (202h14m44.069273065s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.112690417 (202h14m44.071787669s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.113235068 (202h14m44.072332326s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.116860571 (202h14m44.075957818s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.125847240 (202h14m44.084944476s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.136788037 (202h14m44.095885284s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.141259899 (202h14m44.100357152s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.157600317 (202h14m44.116697563s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.169517275 (202h14m44.128614514s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.170723689 (202h14m44.129820924s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174287593 (202h14m44.133384838s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174338363 (202h14m44.133435608s) [seg_pos={0 0}, upload=210504]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:40:22.174565125 (202h14m44.133662363s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vV1hGhZqeEoh5ei7yRu49oyAvTZ2T7S1x3ooufJPtFH2TGBkQ): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175117521 (202h14m44.134214757s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1B7uLDPBrYvc1N81dKm8bcYnhYwjA5mRdRfeQpWqKqrJjmQJgC): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175174465 (202h14m44.13427171s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERtrzMuh8rZPsgebtyScmYvNVwz3UKJr5Nu2hLdu6sn8X3qLa): protocol: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection
Aug 17 03:40:22.175189814 (202h14m44.134287051s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p6mcvX3TBdnYy5Eaugk1t5KPfoeJT1sxcg5TX8aSRGVhHGSsy): protocol: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection
Aug 17 03:40:22.175205651 (202h14m44.134302897s) [seg_pos={0 0}, upload=210504]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:40:22.175290900 (202h14m44.134388146s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:40:22.175296636 (202h14m44.134393881s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:40:22.330950759 (202h14m44.290047995s) [upload=210504]: Done uploading segments...
Aug 17 03:40:22.330970889 (202h14m44.290068125s) [upload=210504]: Upload finished. err: <nil>
Duration: 2.493519863s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........X........................X.........................] duration:
2.450539307s
FAIL (2025-08-17 03:59:56 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0fe20535773fb327f0e1285fd8d60c2bacd0f393282f9562a7724de9fba7434c != before d861b10cb2a70d29d52a521a7de003da28a3c1fb9f6ac2aa0f41e49f8d58fc1d
======LOGS======
Aug 17 03:40:21.175138804 (202h14m43.134236052s) [upload=210504]: Starting upload
Aug 17 03:40:21.175208980 (202h14m43.134306217s) [upload=210504]: Done starting upload
Aug 17 03:40:21.175379812 (202h14m43.134477046s) [upload=210504]: Uploading segments...
Aug 17 03:40:21.175510502 (202h14m43.134607736s) [upload=210504]: Got next segment. Inline: false
Aug 17 03:40:21.175587606 (202h14m43.134684852s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:40:21.175594399 (202h14m43.134691635s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:40:21.373030471 (202h14m43.332127716s) [seg_pos={0 0}, upload=210504]: Begin upload segment...
Aug 17 03:40:21.373095598 (202h14m43.332192844s) [seg_pos={0 0}, upload=210504]: Done begin upload segment.
Aug 17 03:40:21.373132912 (202h14m43.332230173s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.373186791 (202h14m43.332284067s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.374685881 (202h14m43.333783136s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376635904 (202h14m43.335733152s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376973502 (202h14m43.336070751s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377215392 (202h14m43.336312647s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377509865 (202h14m43.336607118s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377978724 (202h14m43.337075975s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378693200 (202h14m43.337790452s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378774753 (202h14m43.337872008s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.379242861 (202h14m43.338340116s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.380069773 (202h14m43.339167024s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.381076965 (202h14m43.34017422s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.382172018 (202h14m43.341269276s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.383215225 (202h14m43.34231248s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.385585359 (202h14m43.344682614s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.388118409 (202h14m43.347215666s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.390509177 (202h14m43.349606432s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.938694025 (202h14m43.89779127s) [upload=210504]: Next returned nil segment
Aug 17 03:40:21.938740605 (202h14m43.897837861s) [upload=210504]: Waiting for error group managing segments...
Aug 17 03:40:22.087061299 (202h14m44.046158551s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.093286222 (202h14m44.052383462s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.100022851 (202h14m44.059120106s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.110175808 (202h14m44.069273065s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.112690417 (202h14m44.071787669s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.113235068 (202h14m44.072332326s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.116860571 (202h14m44.075957818s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.125847240 (202h14m44.084944476s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.136788037 (202h14m44.095885284s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.141259899 (202h14m44.100357152s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.157600317 (202h14m44.116697563s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.169517275 (202h14m44.128614514s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.170723689 (202h14m44.129820924s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174287593 (202h14m44.133384838s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174338363 (202h14m44.133435608s) [seg_pos={0 0}, upload=210504]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:40:22.174565125 (202h14m44.133662363s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vV1hGhZqeEoh5ei7yRu49oyAvTZ2T7S1x3ooufJPtFH2TGBkQ): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175117521 (202h14m44.134214757s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1B7uLDPBrYvc1N81dKm8bcYnhYwjA5mRdRfeQpWqKqrJjmQJgC): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175174465 (202h14m44.13427171s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERtrzMuh8rZPsgebtyScmYvNVwz3UKJr5Nu2hLdu6sn8X3qLa): protocol: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection
Aug 17 03:40:22.175189814 (202h14m44.134287051s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p6mcvX3TBdnYy5Eaugk1t5KPfoeJT1sxcg5TX8aSRGVhHGSsy): protocol: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection
Aug 17 03:40:22.175205651 (202h14m44.134302897s) [seg_pos={0 0}, upload=210504]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:40:22.175290900 (202h14m44.134388146s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:40:22.175296636 (202h14m44.134393881s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:40:22.330950759 (202h14m44.290047995s) [upload=210504]: Done uploading segments...
Aug 17 03:40:22.330970889 (202h14m44.290068125s) [upload=210504]: Upload finished. err: <nil>
Duration: 2.450569204s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [......................XX....................................] duration:
2.862623931s
FAIL (2025-08-17 03:59:55 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.862773516s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.......................XX...................................] duration:
2.904403527s
FAIL (2025-08-17 03:59:38 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.904429384s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........X........................X........................] duration:
2.365263638s
FAIL (2025-08-17 03:58:53 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0fe20535773fb327f0e1285fd8d60c2bacd0f393282f9562a7724de9fba7434c != before d861b10cb2a70d29d52a521a7de003da28a3c1fb9f6ac2aa0f41e49f8d58fc1d
======LOGS======
Aug 17 03:40:21.175138804 (202h14m43.134236052s) [upload=210504]: Starting upload
Aug 17 03:40:21.175208980 (202h14m43.134306217s) [upload=210504]: Done starting upload
Aug 17 03:40:21.175379812 (202h14m43.134477046s) [upload=210504]: Uploading segments...
Aug 17 03:40:21.175510502 (202h14m43.134607736s) [upload=210504]: Got next segment. Inline: false
Aug 17 03:40:21.175587606 (202h14m43.134684852s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:40:21.175594399 (202h14m43.134691635s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:40:21.373030471 (202h14m43.332127716s) [seg_pos={0 0}, upload=210504]: Begin upload segment...
Aug 17 03:40:21.373095598 (202h14m43.332192844s) [seg_pos={0 0}, upload=210504]: Done begin upload segment.
Aug 17 03:40:21.373132912 (202h14m43.332230173s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.373186791 (202h14m43.332284067s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.374685881 (202h14m43.333783136s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376635904 (202h14m43.335733152s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376973502 (202h14m43.336070751s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377215392 (202h14m43.336312647s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377509865 (202h14m43.336607118s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377978724 (202h14m43.337075975s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378693200 (202h14m43.337790452s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378774753 (202h14m43.337872008s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.379242861 (202h14m43.338340116s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.380069773 (202h14m43.339167024s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.381076965 (202h14m43.34017422s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.382172018 (202h14m43.341269276s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.383215225 (202h14m43.34231248s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.385585359 (202h14m43.344682614s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.388118409 (202h14m43.347215666s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.390509177 (202h14m43.349606432s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.938694025 (202h14m43.89779127s) [upload=210504]: Next returned nil segment
Aug 17 03:40:21.938740605 (202h14m43.897837861s) [upload=210504]: Waiting for error group managing segments...
Aug 17 03:40:22.087061299 (202h14m44.046158551s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.093286222 (202h14m44.052383462s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.100022851 (202h14m44.059120106s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.110175808 (202h14m44.069273065s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.112690417 (202h14m44.071787669s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.113235068 (202h14m44.072332326s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.116860571 (202h14m44.075957818s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.125847240 (202h14m44.084944476s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.136788037 (202h14m44.095885284s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.141259899 (202h14m44.100357152s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.157600317 (202h14m44.116697563s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.169517275 (202h14m44.128614514s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.170723689 (202h14m44.129820924s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174287593 (202h14m44.133384838s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174338363 (202h14m44.133435608s) [seg_pos={0 0}, upload=210504]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:40:22.174565125 (202h14m44.133662363s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vV1hGhZqeEoh5ei7yRu49oyAvTZ2T7S1x3ooufJPtFH2TGBkQ): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175117521 (202h14m44.134214757s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1B7uLDPBrYvc1N81dKm8bcYnhYwjA5mRdRfeQpWqKqrJjmQJgC): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175174465 (202h14m44.13427171s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERtrzMuh8rZPsgebtyScmYvNVwz3UKJr5Nu2hLdu6sn8X3qLa): protocol: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection
Aug 17 03:40:22.175189814 (202h14m44.134287051s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p6mcvX3TBdnYy5Eaugk1t5KPfoeJT1sxcg5TX8aSRGVhHGSsy): protocol: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection
Aug 17 03:40:22.175205651 (202h14m44.134302897s) [seg_pos={0 0}, upload=210504]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:40:22.175290900 (202h14m44.134388146s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:40:22.175296636 (202h14m44.134393881s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:40:22.330950759 (202h14m44.290047995s) [upload=210504]: Done uploading segments...
Aug 17 03:40:22.330970889 (202h14m44.290068125s) [upload=210504]: Upload finished. err: <nil>
Duration: 2.365294284s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [........................XX..................................] duration:
2.715549448s
FAIL (2025-08-17 03:58:28 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.715572467s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........X........................X.......................] duration:
2.309328945s
FAIL (2025-08-17 03:57:41 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0fe20535773fb327f0e1285fd8d60c2bacd0f393282f9562a7724de9fba7434c != before d861b10cb2a70d29d52a521a7de003da28a3c1fb9f6ac2aa0f41e49f8d58fc1d
======LOGS======
Aug 17 03:40:21.175138804 (202h14m43.134236052s) [upload=210504]: Starting upload
Aug 17 03:40:21.175208980 (202h14m43.134306217s) [upload=210504]: Done starting upload
Aug 17 03:40:21.175379812 (202h14m43.134477046s) [upload=210504]: Uploading segments...
Aug 17 03:40:21.175510502 (202h14m43.134607736s) [upload=210504]: Got next segment. Inline: false
Aug 17 03:40:21.175587606 (202h14m43.134684852s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:40:21.175594399 (202h14m43.134691635s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:40:21.373030471 (202h14m43.332127716s) [seg_pos={0 0}, upload=210504]: Begin upload segment...
Aug 17 03:40:21.373095598 (202h14m43.332192844s) [seg_pos={0 0}, upload=210504]: Done begin upload segment.
Aug 17 03:40:21.373132912 (202h14m43.332230173s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.373186791 (202h14m43.332284067s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.374685881 (202h14m43.333783136s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376635904 (202h14m43.335733152s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376973502 (202h14m43.336070751s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377215392 (202h14m43.336312647s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377509865 (202h14m43.336607118s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377978724 (202h14m43.337075975s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378693200 (202h14m43.337790452s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378774753 (202h14m43.337872008s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.379242861 (202h14m43.338340116s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.380069773 (202h14m43.339167024s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.381076965 (202h14m43.34017422s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.382172018 (202h14m43.341269276s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.383215225 (202h14m43.34231248s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.385585359 (202h14m43.344682614s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.388118409 (202h14m43.347215666s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.390509177 (202h14m43.349606432s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.938694025 (202h14m43.89779127s) [upload=210504]: Next returned nil segment
Aug 17 03:40:21.938740605 (202h14m43.897837861s) [upload=210504]: Waiting for error group managing segments...
Aug 17 03:40:22.087061299 (202h14m44.046158551s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.093286222 (202h14m44.052383462s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.100022851 (202h14m44.059120106s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.110175808 (202h14m44.069273065s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.112690417 (202h14m44.071787669s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.113235068 (202h14m44.072332326s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.116860571 (202h14m44.075957818s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.125847240 (202h14m44.084944476s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.136788037 (202h14m44.095885284s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.141259899 (202h14m44.100357152s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.157600317 (202h14m44.116697563s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.169517275 (202h14m44.128614514s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.170723689 (202h14m44.129820924s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174287593 (202h14m44.133384838s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174338363 (202h14m44.133435608s) [seg_pos={0 0}, upload=210504]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:40:22.174565125 (202h14m44.133662363s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vV1hGhZqeEoh5ei7yRu49oyAvTZ2T7S1x3ooufJPtFH2TGBkQ): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175117521 (202h14m44.134214757s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1B7uLDPBrYvc1N81dKm8bcYnhYwjA5mRdRfeQpWqKqrJjmQJgC): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175174465 (202h14m44.13427171s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERtrzMuh8rZPsgebtyScmYvNVwz3UKJr5Nu2hLdu6sn8X3qLa): protocol: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection
Aug 17 03:40:22.175189814 (202h14m44.134287051s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p6mcvX3TBdnYy5Eaugk1t5KPfoeJT1sxcg5TX8aSRGVhHGSsy): protocol: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection
Aug 17 03:40:22.175205651 (202h14m44.134302897s) [seg_pos={0 0}, upload=210504]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:40:22.175290900 (202h14m44.134388146s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:40:22.175296636 (202h14m44.134393881s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:40:22.330950759 (202h14m44.290047995s) [upload=210504]: Done uploading segments...
Aug 17 03:40:22.330970889 (202h14m44.290068125s) [upload=210504]: Upload finished. err: <nil>
Duration: 2.309363823s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.........................XX.................................] duration:
2.686256461s
FAIL (2025-08-17 03:57:22 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.686286832s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [............X........................X......................] duration:
2.381103664s
FAIL (2025-08-17 03:57:01 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0fe20535773fb327f0e1285fd8d60c2bacd0f393282f9562a7724de9fba7434c != before d861b10cb2a70d29d52a521a7de003da28a3c1fb9f6ac2aa0f41e49f8d58fc1d
======LOGS======
Aug 17 03:40:21.175138804 (202h14m43.134236052s) [upload=210504]: Starting upload
Aug 17 03:40:21.175208980 (202h14m43.134306217s) [upload=210504]: Done starting upload
Aug 17 03:40:21.175379812 (202h14m43.134477046s) [upload=210504]: Uploading segments...
Aug 17 03:40:21.175510502 (202h14m43.134607736s) [upload=210504]: Got next segment. Inline: false
Aug 17 03:40:21.175587606 (202h14m43.134684852s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:40:21.175594399 (202h14m43.134691635s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:40:21.373030471 (202h14m43.332127716s) [seg_pos={0 0}, upload=210504]: Begin upload segment...
Aug 17 03:40:21.373095598 (202h14m43.332192844s) [seg_pos={0 0}, upload=210504]: Done begin upload segment.
Aug 17 03:40:21.373132912 (202h14m43.332230173s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.373186791 (202h14m43.332284067s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.374685881 (202h14m43.333783136s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376635904 (202h14m43.335733152s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376973502 (202h14m43.336070751s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377215392 (202h14m43.336312647s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377509865 (202h14m43.336607118s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377978724 (202h14m43.337075975s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378693200 (202h14m43.337790452s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378774753 (202h14m43.337872008s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.379242861 (202h14m43.338340116s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.380069773 (202h14m43.339167024s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.381076965 (202h14m43.34017422s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.382172018 (202h14m43.341269276s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.383215225 (202h14m43.34231248s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.385585359 (202h14m43.344682614s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.388118409 (202h14m43.347215666s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.390509177 (202h14m43.349606432s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.938694025 (202h14m43.89779127s) [upload=210504]: Next returned nil segment
Aug 17 03:40:21.938740605 (202h14m43.897837861s) [upload=210504]: Waiting for error group managing segments...
Aug 17 03:40:22.087061299 (202h14m44.046158551s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.093286222 (202h14m44.052383462s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.100022851 (202h14m44.059120106s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.110175808 (202h14m44.069273065s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.112690417 (202h14m44.071787669s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.113235068 (202h14m44.072332326s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.116860571 (202h14m44.075957818s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.125847240 (202h14m44.084944476s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.136788037 (202h14m44.095885284s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.141259899 (202h14m44.100357152s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.157600317 (202h14m44.116697563s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.169517275 (202h14m44.128614514s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.170723689 (202h14m44.129820924s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174287593 (202h14m44.133384838s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174338363 (202h14m44.133435608s) [seg_pos={0 0}, upload=210504]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:40:22.174565125 (202h14m44.133662363s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vV1hGhZqeEoh5ei7yRu49oyAvTZ2T7S1x3ooufJPtFH2TGBkQ): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175117521 (202h14m44.134214757s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1B7uLDPBrYvc1N81dKm8bcYnhYwjA5mRdRfeQpWqKqrJjmQJgC): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175174465 (202h14m44.13427171s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERtrzMuh8rZPsgebtyScmYvNVwz3UKJr5Nu2hLdu6sn8X3qLa): protocol: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection
Aug 17 03:40:22.175189814 (202h14m44.134287051s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p6mcvX3TBdnYy5Eaugk1t5KPfoeJT1sxcg5TX8aSRGVhHGSsy): protocol: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection
Aug 17 03:40:22.175205651 (202h14m44.134302897s) [seg_pos={0 0}, upload=210504]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:40:22.175290900 (202h14m44.134388146s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:40:22.175296636 (202h14m44.134393881s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:40:22.330950759 (202h14m44.290047995s) [upload=210504]: Done uploading segments...
Aug 17 03:40:22.330970889 (202h14m44.290068125s) [upload=210504]: Upload finished. err: <nil>
Duration: 2.381138577s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..........................XX................................] duration:
2.609899963s
FAIL (2025-08-17 03:56:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.609928814s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............X........................X.....................] duration:
2.332889333s
FAIL (2025-08-17 03:56:41 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0fe20535773fb327f0e1285fd8d60c2bacd0f393282f9562a7724de9fba7434c != before d861b10cb2a70d29d52a521a7de003da28a3c1fb9f6ac2aa0f41e49f8d58fc1d
======LOGS======
Aug 17 03:40:21.175138804 (202h14m43.134236052s) [upload=210504]: Starting upload
Aug 17 03:40:21.175208980 (202h14m43.134306217s) [upload=210504]: Done starting upload
Aug 17 03:40:21.175379812 (202h14m43.134477046s) [upload=210504]: Uploading segments...
Aug 17 03:40:21.175510502 (202h14m43.134607736s) [upload=210504]: Got next segment. Inline: false
Aug 17 03:40:21.175587606 (202h14m43.134684852s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:40:21.175594399 (202h14m43.134691635s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:40:21.373030471 (202h14m43.332127716s) [seg_pos={0 0}, upload=210504]: Begin upload segment...
Aug 17 03:40:21.373095598 (202h14m43.332192844s) [seg_pos={0 0}, upload=210504]: Done begin upload segment.
Aug 17 03:40:21.373132912 (202h14m43.332230173s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.373186791 (202h14m43.332284067s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.374685881 (202h14m43.333783136s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376635904 (202h14m43.335733152s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376973502 (202h14m43.336070751s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377215392 (202h14m43.336312647s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377509865 (202h14m43.336607118s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377978724 (202h14m43.337075975s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378693200 (202h14m43.337790452s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378774753 (202h14m43.337872008s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.379242861 (202h14m43.338340116s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.380069773 (202h14m43.339167024s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.381076965 (202h14m43.34017422s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.382172018 (202h14m43.341269276s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.383215225 (202h14m43.34231248s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.385585359 (202h14m43.344682614s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.388118409 (202h14m43.347215666s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.390509177 (202h14m43.349606432s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.938694025 (202h14m43.89779127s) [upload=210504]: Next returned nil segment
Aug 17 03:40:21.938740605 (202h14m43.897837861s) [upload=210504]: Waiting for error group managing segments...
Aug 17 03:40:22.087061299 (202h14m44.046158551s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.093286222 (202h14m44.052383462s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.100022851 (202h14m44.059120106s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.110175808 (202h14m44.069273065s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.112690417 (202h14m44.071787669s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.113235068 (202h14m44.072332326s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.116860571 (202h14m44.075957818s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.125847240 (202h14m44.084944476s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.136788037 (202h14m44.095885284s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.141259899 (202h14m44.100357152s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.157600317 (202h14m44.116697563s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.169517275 (202h14m44.128614514s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.170723689 (202h14m44.129820924s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174287593 (202h14m44.133384838s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174338363 (202h14m44.133435608s) [seg_pos={0 0}, upload=210504]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:40:22.174565125 (202h14m44.133662363s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vV1hGhZqeEoh5ei7yRu49oyAvTZ2T7S1x3ooufJPtFH2TGBkQ): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175117521 (202h14m44.134214757s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1B7uLDPBrYvc1N81dKm8bcYnhYwjA5mRdRfeQpWqKqrJjmQJgC): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175174465 (202h14m44.13427171s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERtrzMuh8rZPsgebtyScmYvNVwz3UKJr5Nu2hLdu6sn8X3qLa): protocol: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection
Aug 17 03:40:22.175189814 (202h14m44.134287051s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p6mcvX3TBdnYy5Eaugk1t5KPfoeJT1sxcg5TX8aSRGVhHGSsy): protocol: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection
Aug 17 03:40:22.175205651 (202h14m44.134302897s) [seg_pos={0 0}, upload=210504]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:40:22.175290900 (202h14m44.134388146s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:40:22.175296636 (202h14m44.134393881s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:40:22.330950759 (202h14m44.290047995s) [upload=210504]: Done uploading segments...
Aug 17 03:40:22.330970889 (202h14m44.290068125s) [upload=210504]: Upload finished. err: <nil>
Duration: 2.332921652s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............X........................X....................] duration:
2.399685344s
FAIL (2025-08-17 03:56:26 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0fe20535773fb327f0e1285fd8d60c2bacd0f393282f9562a7724de9fba7434c != before d861b10cb2a70d29d52a521a7de003da28a3c1fb9f6ac2aa0f41e49f8d58fc1d
======LOGS======
Aug 17 03:40:21.175138804 (202h14m43.134236052s) [upload=210504]: Starting upload
Aug 17 03:40:21.175208980 (202h14m43.134306217s) [upload=210504]: Done starting upload
Aug 17 03:40:21.175379812 (202h14m43.134477046s) [upload=210504]: Uploading segments...
Aug 17 03:40:21.175510502 (202h14m43.134607736s) [upload=210504]: Got next segment. Inline: false
Aug 17 03:40:21.175587606 (202h14m43.134684852s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:40:21.175594399 (202h14m43.134691635s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:40:21.373030471 (202h14m43.332127716s) [seg_pos={0 0}, upload=210504]: Begin upload segment...
Aug 17 03:40:21.373095598 (202h14m43.332192844s) [seg_pos={0 0}, upload=210504]: Done begin upload segment.
Aug 17 03:40:21.373132912 (202h14m43.332230173s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.373186791 (202h14m43.332284067s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.374685881 (202h14m43.333783136s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376635904 (202h14m43.335733152s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376973502 (202h14m43.336070751s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377215392 (202h14m43.336312647s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377509865 (202h14m43.336607118s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377978724 (202h14m43.337075975s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378693200 (202h14m43.337790452s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378774753 (202h14m43.337872008s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.379242861 (202h14m43.338340116s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.380069773 (202h14m43.339167024s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.381076965 (202h14m43.34017422s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.382172018 (202h14m43.341269276s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.383215225 (202h14m43.34231248s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.385585359 (202h14m43.344682614s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.388118409 (202h14m43.347215666s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.390509177 (202h14m43.349606432s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.938694025 (202h14m43.89779127s) [upload=210504]: Next returned nil segment
Aug 17 03:40:21.938740605 (202h14m43.897837861s) [upload=210504]: Waiting for error group managing segments...
Aug 17 03:40:22.087061299 (202h14m44.046158551s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.093286222 (202h14m44.052383462s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.100022851 (202h14m44.059120106s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.110175808 (202h14m44.069273065s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.112690417 (202h14m44.071787669s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.113235068 (202h14m44.072332326s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.116860571 (202h14m44.075957818s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.125847240 (202h14m44.084944476s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.136788037 (202h14m44.095885284s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.141259899 (202h14m44.100357152s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.157600317 (202h14m44.116697563s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.169517275 (202h14m44.128614514s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.170723689 (202h14m44.129820924s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174287593 (202h14m44.133384838s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174338363 (202h14m44.133435608s) [seg_pos={0 0}, upload=210504]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:40:22.174565125 (202h14m44.133662363s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vV1hGhZqeEoh5ei7yRu49oyAvTZ2T7S1x3ooufJPtFH2TGBkQ): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175117521 (202h14m44.134214757s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1B7uLDPBrYvc1N81dKm8bcYnhYwjA5mRdRfeQpWqKqrJjmQJgC): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175174465 (202h14m44.13427171s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERtrzMuh8rZPsgebtyScmYvNVwz3UKJr5Nu2hLdu6sn8X3qLa): protocol: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection
Aug 17 03:40:22.175189814 (202h14m44.134287051s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p6mcvX3TBdnYy5Eaugk1t5KPfoeJT1sxcg5TX8aSRGVhHGSsy): protocol: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection
Aug 17 03:40:22.175205651 (202h14m44.134302897s) [seg_pos={0 0}, upload=210504]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:40:22.175290900 (202h14m44.134388146s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:40:22.175296636 (202h14m44.134393881s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:40:22.330950759 (202h14m44.290047995s) [upload=210504]: Done uploading segments...
Aug 17 03:40:22.330970889 (202h14m44.290068125s) [upload=210504]: Upload finished. err: <nil>
Duration: 2.399716611s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [...........................XX...............................] duration:
2.61164208s
FAIL (2025-08-17 03:56:09 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.611670791s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...............X........................X...................] duration:
2.419604099s
FAIL (2025-08-17 03:55:28 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0fe20535773fb327f0e1285fd8d60c2bacd0f393282f9562a7724de9fba7434c != before d861b10cb2a70d29d52a521a7de003da28a3c1fb9f6ac2aa0f41e49f8d58fc1d
======LOGS======
Aug 17 03:40:21.175138804 (202h14m43.134236052s) [upload=210504]: Starting upload
Aug 17 03:40:21.175208980 (202h14m43.134306217s) [upload=210504]: Done starting upload
Aug 17 03:40:21.175379812 (202h14m43.134477046s) [upload=210504]: Uploading segments...
Aug 17 03:40:21.175510502 (202h14m43.134607736s) [upload=210504]: Got next segment. Inline: false
Aug 17 03:40:21.175587606 (202h14m43.134684852s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:40:21.175594399 (202h14m43.134691635s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:40:21.373030471 (202h14m43.332127716s) [seg_pos={0 0}, upload=210504]: Begin upload segment...
Aug 17 03:40:21.373095598 (202h14m43.332192844s) [seg_pos={0 0}, upload=210504]: Done begin upload segment.
Aug 17 03:40:21.373132912 (202h14m43.332230173s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.373186791 (202h14m43.332284067s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.374685881 (202h14m43.333783136s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376635904 (202h14m43.335733152s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376973502 (202h14m43.336070751s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377215392 (202h14m43.336312647s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377509865 (202h14m43.336607118s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377978724 (202h14m43.337075975s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378693200 (202h14m43.337790452s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378774753 (202h14m43.337872008s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.379242861 (202h14m43.338340116s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.380069773 (202h14m43.339167024s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.381076965 (202h14m43.34017422s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.382172018 (202h14m43.341269276s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.383215225 (202h14m43.34231248s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.385585359 (202h14m43.344682614s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.388118409 (202h14m43.347215666s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.390509177 (202h14m43.349606432s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.938694025 (202h14m43.89779127s) [upload=210504]: Next returned nil segment
Aug 17 03:40:21.938740605 (202h14m43.897837861s) [upload=210504]: Waiting for error group managing segments...
Aug 17 03:40:22.087061299 (202h14m44.046158551s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.093286222 (202h14m44.052383462s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.100022851 (202h14m44.059120106s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.110175808 (202h14m44.069273065s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.112690417 (202h14m44.071787669s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.113235068 (202h14m44.072332326s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.116860571 (202h14m44.075957818s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.125847240 (202h14m44.084944476s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.136788037 (202h14m44.095885284s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.141259899 (202h14m44.100357152s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.157600317 (202h14m44.116697563s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.169517275 (202h14m44.128614514s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.170723689 (202h14m44.129820924s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174287593 (202h14m44.133384838s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174338363 (202h14m44.133435608s) [seg_pos={0 0}, upload=210504]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:40:22.174565125 (202h14m44.133662363s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vV1hGhZqeEoh5ei7yRu49oyAvTZ2T7S1x3ooufJPtFH2TGBkQ): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175117521 (202h14m44.134214757s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1B7uLDPBrYvc1N81dKm8bcYnhYwjA5mRdRfeQpWqKqrJjmQJgC): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175174465 (202h14m44.13427171s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERtrzMuh8rZPsgebtyScmYvNVwz3UKJr5Nu2hLdu6sn8X3qLa): protocol: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection
Aug 17 03:40:22.175189814 (202h14m44.134287051s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p6mcvX3TBdnYy5Eaugk1t5KPfoeJT1sxcg5TX8aSRGVhHGSsy): protocol: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection
Aug 17 03:40:22.175205651 (202h14m44.134302897s) [seg_pos={0 0}, upload=210504]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:40:22.175290900 (202h14m44.134388146s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:40:22.175296636 (202h14m44.134393881s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:40:22.330950759 (202h14m44.290047995s) [upload=210504]: Done uploading segments...
Aug 17 03:40:22.330970889 (202h14m44.290068125s) [upload=210504]: Upload finished. err: <nil>
Duration: 2.41964458s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [................X........................X..................] duration:
2.405672591s
FAIL (2025-08-17 03:55:06 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0fe20535773fb327f0e1285fd8d60c2bacd0f393282f9562a7724de9fba7434c != before d861b10cb2a70d29d52a521a7de003da28a3c1fb9f6ac2aa0f41e49f8d58fc1d
======LOGS======
Aug 17 03:40:21.175138804 (202h14m43.134236052s) [upload=210504]: Starting upload
Aug 17 03:40:21.175208980 (202h14m43.134306217s) [upload=210504]: Done starting upload
Aug 17 03:40:21.175379812 (202h14m43.134477046s) [upload=210504]: Uploading segments...
Aug 17 03:40:21.175510502 (202h14m43.134607736s) [upload=210504]: Got next segment. Inline: false
Aug 17 03:40:21.175587606 (202h14m43.134684852s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:40:21.175594399 (202h14m43.134691635s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:40:21.373030471 (202h14m43.332127716s) [seg_pos={0 0}, upload=210504]: Begin upload segment...
Aug 17 03:40:21.373095598 (202h14m43.332192844s) [seg_pos={0 0}, upload=210504]: Done begin upload segment.
Aug 17 03:40:21.373132912 (202h14m43.332230173s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.373186791 (202h14m43.332284067s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.374685881 (202h14m43.333783136s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376635904 (202h14m43.335733152s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376973502 (202h14m43.336070751s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377215392 (202h14m43.336312647s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377509865 (202h14m43.336607118s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377978724 (202h14m43.337075975s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378693200 (202h14m43.337790452s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378774753 (202h14m43.337872008s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.379242861 (202h14m43.338340116s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.380069773 (202h14m43.339167024s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.381076965 (202h14m43.34017422s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.382172018 (202h14m43.341269276s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.383215225 (202h14m43.34231248s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.385585359 (202h14m43.344682614s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.388118409 (202h14m43.347215666s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.390509177 (202h14m43.349606432s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.938694025 (202h14m43.89779127s) [upload=210504]: Next returned nil segment
Aug 17 03:40:21.938740605 (202h14m43.897837861s) [upload=210504]: Waiting for error group managing segments...
Aug 17 03:40:22.087061299 (202h14m44.046158551s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.093286222 (202h14m44.052383462s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.100022851 (202h14m44.059120106s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.110175808 (202h14m44.069273065s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.112690417 (202h14m44.071787669s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.113235068 (202h14m44.072332326s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.116860571 (202h14m44.075957818s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.125847240 (202h14m44.084944476s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.136788037 (202h14m44.095885284s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.141259899 (202h14m44.100357152s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.157600317 (202h14m44.116697563s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.169517275 (202h14m44.128614514s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.170723689 (202h14m44.129820924s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174287593 (202h14m44.133384838s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174338363 (202h14m44.133435608s) [seg_pos={0 0}, upload=210504]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:40:22.174565125 (202h14m44.133662363s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vV1hGhZqeEoh5ei7yRu49oyAvTZ2T7S1x3ooufJPtFH2TGBkQ): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175117521 (202h14m44.134214757s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1B7uLDPBrYvc1N81dKm8bcYnhYwjA5mRdRfeQpWqKqrJjmQJgC): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175174465 (202h14m44.13427171s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERtrzMuh8rZPsgebtyScmYvNVwz3UKJr5Nu2hLdu6sn8X3qLa): protocol: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection
Aug 17 03:40:22.175189814 (202h14m44.134287051s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p6mcvX3TBdnYy5Eaugk1t5KPfoeJT1sxcg5TX8aSRGVhHGSsy): protocol: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection
Aug 17 03:40:22.175205651 (202h14m44.134302897s) [seg_pos={0 0}, upload=210504]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:40:22.175290900 (202h14m44.134388146s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:40:22.175296636 (202h14m44.134393881s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:40:22.330950759 (202h14m44.290047995s) [upload=210504]: Done uploading segments...
Aug 17 03:40:22.330970889 (202h14m44.290068125s) [upload=210504]: Upload finished. err: <nil>
Duration: 2.405731159s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [............................XX..............................] duration:
2.850432566s
FAIL (2025-08-17 03:55:02 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.850470561s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [.................X........................X.................] duration:
2.376067743s
FAIL (2025-08-17 03:54:36 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0fe20535773fb327f0e1285fd8d60c2bacd0f393282f9562a7724de9fba7434c != before d861b10cb2a70d29d52a521a7de003da28a3c1fb9f6ac2aa0f41e49f8d58fc1d
======LOGS======
Aug 17 03:40:21.175138804 (202h14m43.134236052s) [upload=210504]: Starting upload
Aug 17 03:40:21.175208980 (202h14m43.134306217s) [upload=210504]: Done starting upload
Aug 17 03:40:21.175379812 (202h14m43.134477046s) [upload=210504]: Uploading segments...
Aug 17 03:40:21.175510502 (202h14m43.134607736s) [upload=210504]: Got next segment. Inline: false
Aug 17 03:40:21.175587606 (202h14m43.134684852s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:40:21.175594399 (202h14m43.134691635s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:40:21.373030471 (202h14m43.332127716s) [seg_pos={0 0}, upload=210504]: Begin upload segment...
Aug 17 03:40:21.373095598 (202h14m43.332192844s) [seg_pos={0 0}, upload=210504]: Done begin upload segment.
Aug 17 03:40:21.373132912 (202h14m43.332230173s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.373186791 (202h14m43.332284067s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.374685881 (202h14m43.333783136s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376635904 (202h14m43.335733152s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376973502 (202h14m43.336070751s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377215392 (202h14m43.336312647s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377509865 (202h14m43.336607118s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377978724 (202h14m43.337075975s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378693200 (202h14m43.337790452s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378774753 (202h14m43.337872008s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.379242861 (202h14m43.338340116s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.380069773 (202h14m43.339167024s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.381076965 (202h14m43.34017422s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.382172018 (202h14m43.341269276s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.383215225 (202h14m43.34231248s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.385585359 (202h14m43.344682614s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.388118409 (202h14m43.347215666s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.390509177 (202h14m43.349606432s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.938694025 (202h14m43.89779127s) [upload=210504]: Next returned nil segment
Aug 17 03:40:21.938740605 (202h14m43.897837861s) [upload=210504]: Waiting for error group managing segments...
Aug 17 03:40:22.087061299 (202h14m44.046158551s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.093286222 (202h14m44.052383462s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.100022851 (202h14m44.059120106s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.110175808 (202h14m44.069273065s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.112690417 (202h14m44.071787669s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.113235068 (202h14m44.072332326s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.116860571 (202h14m44.075957818s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.125847240 (202h14m44.084944476s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.136788037 (202h14m44.095885284s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.141259899 (202h14m44.100357152s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.157600317 (202h14m44.116697563s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.169517275 (202h14m44.128614514s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.170723689 (202h14m44.129820924s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174287593 (202h14m44.133384838s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174338363 (202h14m44.133435608s) [seg_pos={0 0}, upload=210504]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:40:22.174565125 (202h14m44.133662363s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vV1hGhZqeEoh5ei7yRu49oyAvTZ2T7S1x3ooufJPtFH2TGBkQ): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175117521 (202h14m44.134214757s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1B7uLDPBrYvc1N81dKm8bcYnhYwjA5mRdRfeQpWqKqrJjmQJgC): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175174465 (202h14m44.13427171s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERtrzMuh8rZPsgebtyScmYvNVwz3UKJr5Nu2hLdu6sn8X3qLa): protocol: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection
Aug 17 03:40:22.175189814 (202h14m44.134287051s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p6mcvX3TBdnYy5Eaugk1t5KPfoeJT1sxcg5TX8aSRGVhHGSsy): protocol: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection
Aug 17 03:40:22.175205651 (202h14m44.134302897s) [seg_pos={0 0}, upload=210504]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:40:22.175290900 (202h14m44.134388146s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:40:22.175296636 (202h14m44.134393881s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:40:22.330950759 (202h14m44.290047995s) [upload=210504]: Done uploading segments...
Aug 17 03:40:22.330970889 (202h14m44.290068125s) [upload=210504]: Upload finished. err: <nil>
Duration: 2.376172113s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [.............................XX.............................] duration:
2.869466603s
FAIL (2025-08-17 03:53:54 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.869500468s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [..................X........................X................] duration:
2.41130489s
FAIL (2025-08-17 03:53:44 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0fe20535773fb327f0e1285fd8d60c2bacd0f393282f9562a7724de9fba7434c != before d861b10cb2a70d29d52a521a7de003da28a3c1fb9f6ac2aa0f41e49f8d58fc1d
======LOGS======
Aug 17 03:40:21.175138804 (202h14m43.134236052s) [upload=210504]: Starting upload
Aug 17 03:40:21.175208980 (202h14m43.134306217s) [upload=210504]: Done starting upload
Aug 17 03:40:21.175379812 (202h14m43.134477046s) [upload=210504]: Uploading segments...
Aug 17 03:40:21.175510502 (202h14m43.134607736s) [upload=210504]: Got next segment. Inline: false
Aug 17 03:40:21.175587606 (202h14m43.134684852s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:40:21.175594399 (202h14m43.134691635s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:40:21.373030471 (202h14m43.332127716s) [seg_pos={0 0}, upload=210504]: Begin upload segment...
Aug 17 03:40:21.373095598 (202h14m43.332192844s) [seg_pos={0 0}, upload=210504]: Done begin upload segment.
Aug 17 03:40:21.373132912 (202h14m43.332230173s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.373186791 (202h14m43.332284067s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.374685881 (202h14m43.333783136s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376635904 (202h14m43.335733152s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376973502 (202h14m43.336070751s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377215392 (202h14m43.336312647s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377509865 (202h14m43.336607118s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377978724 (202h14m43.337075975s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378693200 (202h14m43.337790452s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378774753 (202h14m43.337872008s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.379242861 (202h14m43.338340116s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.380069773 (202h14m43.339167024s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.381076965 (202h14m43.34017422s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.382172018 (202h14m43.341269276s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.383215225 (202h14m43.34231248s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.385585359 (202h14m43.344682614s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.388118409 (202h14m43.347215666s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.390509177 (202h14m43.349606432s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.938694025 (202h14m43.89779127s) [upload=210504]: Next returned nil segment
Aug 17 03:40:21.938740605 (202h14m43.897837861s) [upload=210504]: Waiting for error group managing segments...
Aug 17 03:40:22.087061299 (202h14m44.046158551s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.093286222 (202h14m44.052383462s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.100022851 (202h14m44.059120106s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.110175808 (202h14m44.069273065s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.112690417 (202h14m44.071787669s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.113235068 (202h14m44.072332326s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.116860571 (202h14m44.075957818s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.125847240 (202h14m44.084944476s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.136788037 (202h14m44.095885284s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.141259899 (202h14m44.100357152s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.157600317 (202h14m44.116697563s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.169517275 (202h14m44.128614514s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.170723689 (202h14m44.129820924s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174287593 (202h14m44.133384838s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174338363 (202h14m44.133435608s) [seg_pos={0 0}, upload=210504]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:40:22.174565125 (202h14m44.133662363s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vV1hGhZqeEoh5ei7yRu49oyAvTZ2T7S1x3ooufJPtFH2TGBkQ): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175117521 (202h14m44.134214757s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1B7uLDPBrYvc1N81dKm8bcYnhYwjA5mRdRfeQpWqKqrJjmQJgC): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175174465 (202h14m44.13427171s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERtrzMuh8rZPsgebtyScmYvNVwz3UKJr5Nu2hLdu6sn8X3qLa): protocol: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection
Aug 17 03:40:22.175189814 (202h14m44.134287051s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p6mcvX3TBdnYy5Eaugk1t5KPfoeJT1sxcg5TX8aSRGVhHGSsy): protocol: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection
Aug 17 03:40:22.175205651 (202h14m44.134302897s) [seg_pos={0 0}, upload=210504]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:40:22.175290900 (202h14m44.134388146s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:40:22.175296636 (202h14m44.134393881s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:40:22.330950759 (202h14m44.290047995s) [upload=210504]: Done uploading segments...
Aug 17 03:40:22.330970889 (202h14m44.290068125s) [upload=210504]: Upload finished. err: <nil>
Duration: 2.41134039s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_eu_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
2 out of 60 is failed (threshold=3) [..............................XX............................] duration:
2.783089767s
FAIL (2025-08-17 03:53:16 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 2.783114349s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
2 out of 60 is failed (threshold=3) [...................X........................X...............] duration:
2.523072268s
FAIL (2025-08-17 03:53:01 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 0fe20535773fb327f0e1285fd8d60c2bacd0f393282f9562a7724de9fba7434c != before d861b10cb2a70d29d52a521a7de003da28a3c1fb9f6ac2aa0f41e49f8d58fc1d
======LOGS======
Aug 17 03:40:21.175138804 (202h14m43.134236052s) [upload=210504]: Starting upload
Aug 17 03:40:21.175208980 (202h14m43.134306217s) [upload=210504]: Done starting upload
Aug 17 03:40:21.175379812 (202h14m43.134477046s) [upload=210504]: Uploading segments...
Aug 17 03:40:21.175510502 (202h14m43.134607736s) [upload=210504]: Got next segment. Inline: false
Aug 17 03:40:21.175587606 (202h14m43.134684852s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 17 03:40:21.175594399 (202h14m43.134691635s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 17 03:40:21.373030471 (202h14m43.332127716s) [seg_pos={0 0}, upload=210504]: Begin upload segment...
Aug 17 03:40:21.373095598 (202h14m43.332192844s) [seg_pos={0 0}, upload=210504]: Done begin upload segment.
Aug 17 03:40:21.373132912 (202h14m43.332230173s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.373186791 (202h14m43.332284067s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.374685881 (202h14m43.333783136s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376635904 (202h14m43.335733152s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.376973502 (202h14m43.336070751s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377215392 (202h14m43.336312647s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377509865 (202h14m43.336607118s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.377978724 (202h14m43.337075975s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378693200 (202h14m43.337790452s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.378774753 (202h14m43.337872008s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.379242861 (202h14m43.338340116s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.380069773 (202h14m43.339167024s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.381076965 (202h14m43.34017422s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.382172018 (202h14m43.341269276s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.383215225 (202h14m43.34231248s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.385585359 (202h14m43.344682614s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.388118409 (202h14m43.347215666s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.390509177 (202h14m43.349606432s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Uploading piece...
Aug 17 03:40:21.938694025 (202h14m43.89779127s) [upload=210504]: Next returned nil segment
Aug 17 03:40:21.938740605 (202h14m43.897837861s) [upload=210504]: Waiting for error group managing segments...
Aug 17 03:40:22.087061299 (202h14m44.046158551s) [noise=true , address=45.91.116.6:4997 , piece_id=4EUVUHVUW5HA4WY4F6VI663MPI7QVDO5TK5CNJTDX3PLHOR6IO4A, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.093286222 (202h14m44.052383462s) [noise=true , address=104.36.82.35:4614 , piece_id=QII7R4UHJR2UQXNTOZIUI5ZOAHCGAHH2WPQN4K4C7EKRB22EHG6Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.100022851 (202h14m44.059120106s) [noise=true , address=104.36.82.15:4289 , piece_id=TAODVX3RTLAJGVGH43TDPP55VOQYH73WGOWFXGQIXQSQASAVBYIQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.110175808 (202h14m44.069273065s) [noise=true , address=79.127.219.51:4200 , piece_id=S4JTC3QRSAXUQPPZADFJTHRQG42VUM4UE2CGQ54VKBBAFEADYDEA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.112690417 (202h14m44.071787669s) [noise=true , address=104.36.82.58:4298 , piece_id=UQYYHLOCHX4EYWJZMSUV3B6P2RQ7VPHNLUOGYKJ6S2CDOGSE24SA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.113235068 (202h14m44.072332326s) [noise=true , address=104.36.82.39:4759 , piece_id=7SW6MINWCVIHBVZDEK6EVDKWPD7RPV7EGKSBCI7FNSCBCEGIPNNQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.116860571 (202h14m44.075957818s) [noise=true , address=104.36.82.38:4707 , piece_id=CQISVVVL4KOD4TSYBWRN6E4OOMPSVDNCXE6ZT4DQKLR2TGI5XPMA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.125847240 (202h14m44.084944476s) [noise=true , address=104.36.82.5:4850 , piece_id=4IK4323IBKSD6KICFCDNE76S737WOXOM7O47ZZLC4WJ2JHAPZZQA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.136788037 (202h14m44.095885284s) [noise=true , address=104.36.82.44:4899 , piece_id=T5TEY6BX7JFS34M464PX4V6O4GIKXBUNCFTAA2U2J3Q4YFBWB4DQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.141259899 (202h14m44.100357152s) [noise=true , address=104.36.82.6:4890 , piece_id=3KHSDR6M6CVMMXRDDZW6TWJGBY4ZHKTUMKRTG6D4OF76SVYCTYXQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.157600317 (202h14m44.116697563s) [noise=true , address=77.90.31.18:4837 , piece_id=JCU56BT5FUUNYGA7IUWJT5EEJEA2M5FGO56UYOMGQORXVNF2EFRQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.169517275 (202h14m44.128614514s) [noise=true , address=77.90.31.15:4702 , piece_id=H36PWM3PE2LL4E6MJYBFOWGDUVNHCQZTTCL4CJM6JRG6SJD7SJHA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.170723689 (202h14m44.129820924s) [noise=true , address=77.90.31.11:4561 , piece_id=I5H2EH6WVZQLHNWLMPTNU5SNGEMJKA5ZVBJ4J2GGTTVH5HNA34YA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174287593 (202h14m44.133384838s) [noise=true , address=104.36.82.60:4340 , piece_id=CBS66LU2NULGFPXLPBHWGGY5ZW4SLR57Y3YY7Y2CX4LR6N6DOFBQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: <nil>
Aug 17 03:40:22.174338363 (202h14m44.133435608s) [seg_pos={0 0}, upload=210504]: Segment reached optimal threshold of 14 pieces.
Aug 17 03:40:22.174565125 (202h14m44.133662363s) [noise=true , address=104.36.82.13:4215 , piece_id=OB5QPNCE73E3MCX45ZJLTJPIOVLKDCCTFXZ6YEUVMPJ6UIX6ZRJQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vV1hGhZqeEoh5ei7yRu49oyAvTZ2T7S1x3ooufJPtFH2TGBkQ): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175117521 (202h14m44.134214757s) [noise=true , address=104.36.82.36:4632 , piece_id=URBDIZPISXZGMTWTWBZGMK3KZJLW2R7WFUTE24M7D7FEVHKIPR4Q, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1B7uLDPBrYvc1N81dKm8bcYnhYwjA5mRdRfeQpWqKqrJjmQJgC): protocol: expected piece hash; context canceled; EOF
Aug 17 03:40:22.175174465 (202h14m44.13427171s) [noise=true , address=104.36.82.4:4814 , piece_id=B5WCZH5ZZITTPXDQRFFTUIAHYOB4FHUEBFZGNMR6JTPBEBHOIADA, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ERtrzMuh8rZPsgebtyScmYvNVwz3UKJr5Nu2hLdu6sn8X3qLa): protocol: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:52080->104.36.82.4:4814: use of closed network connection
Aug 17 03:40:22.175189814 (202h14m44.134287051s) [noise=true , address=193.149.164.143:4696 , piece_id=5TPJU64J3QUDQQPLKPWEQL22JSQHZOBBOQEWRUV376LZXQBSLJZQ, seg_pos={0 0}, upload=210504]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1p6mcvX3TBdnYy5Eaugk1t5KPfoeJT1sxcg5TX8aSRGVhHGSsy): protocol: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:36722->193.149.164.143:4696: use of closed network connection
Aug 17 03:40:22.175205651 (202h14m44.134302897s) [seg_pos={0 0}, upload=210504]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 17 03:40:22.175290900 (202h14m44.134388146s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 17 03:40:22.175296636 (202h14m44.134393881s) [upload=210504]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 17 03:40:22.330950759 (202h14m44.290047995s) [upload=210504]: Done uploading segments...
Aug 17 03:40:22.330970889 (202h14m44.290068125s) [upload=210504]: Upload finished. err: <nil>
Duration: 2.523108398s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|