Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X...X....................................X...............] duration:
2.49258925s
FAIL (2025-08-09 11:15:37 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 30732f12d1c23351236b52fc46e02ade72cbcc01d371bae982a9652c8f3b11e2 != before 9273f3c49dd081d02a56c33fd79fa76e24e29e38ec5c47c511ef60d0bc1d3a49
======LOGS======
Aug 9 11:03:33.439875370 (17h37m55.398972606s) [upload=18363]: Starting upload
Aug 9 11:03:33.439969368 (17h37m55.399066621s) [upload=18363]: Done starting upload
Aug 9 11:03:33.440161922 (17h37m55.399259165s) [upload=18363]: Uploading segments...
Aug 9 11:03:33.440319250 (17h37m55.399416518s) [upload=18363]: Got next segment. Inline: false
Aug 9 11:03:33.440397655 (17h37m55.399494909s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 11:03:33.440404620 (17h37m55.399501867s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 11:03:33.639038109 (17h37m55.598135354s) [seg_pos={0 0}, upload=18363]: Begin upload segment...
Aug 9 11:03:33.639091904 (17h37m55.598189152s) [seg_pos={0 0}, upload=18363]: Done begin upload segment.
Aug 9 11:03:33.639134621 (17h37m55.598231853s) [noise=true , address=64.49.13.139:4474 , piece_id=RAJARTWAQ6HDQLUEFTKKBRG6LJCEZJU32AJGAZKFGYXDMBWFISRQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639141148 (17h37m55.598238399s) [noise=true , address=104.36.82.10:4093 , piece_id=SKI2RIGZMKQPM55NO23Y7VW7L4J35CWUWREONMLKFV3JEARAW4DQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639530470 (17h37m55.598627723s) [noise=true , address=104.36.82.16:4317 , piece_id=2UHP3NEII7IMQTF5QXEC3RAYWLDGKXLSMTYJJ53GPZVOPSDN3A6Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639607585 (17h37m55.598704833s) [noise=true , address=104.36.82.62:4437 , piece_id=6IHWL5KFKP7BFIOJBK22S54BCWDJLNU53NBL7YKMNJUUACKTBACQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639794168 (17h37m55.598891412s) [noise=true , address=104.36.82.36:4651 , piece_id=DKVNFKDGOV2JI25CG33WWVMYN6SOARCTVENJ4STBYYRCXVDHTWHQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640025622 (17h37m55.599122874s) [noise=true , address=104.36.82.44:4888 , piece_id=S6E6BTCSDGY2O3MPL2TZTU5DQCJ7ZM4G5KISVXZ757IDZBFVCQ4A, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640260031 (17h37m55.599357283s) [noise=true , address=104.36.82.59:4323 , piece_id=AMEOXBJH3FY7QEM4CUX5VVSERBMOFT6TCXC34RRODALRM3DQXGCQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640518584 (17h37m55.599615829s) [noise=true , address=104.36.82.5:4862 , piece_id=VBW5XUEAL34KRE2JRGQ4RDDBNYWFVDUBXBJ3QL2REGAPFXX3EHEA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640713081 (17h37m55.599810332s) [noise=true , address=104.36.82.38:4699 , piece_id=WYQRYJDHI5FVM2KTHLGBCDOBAOTYVWHQ6IDWI5GQ5MQUBHAUIFLA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641018305 (17h37m55.600115559s) [noise=true , address=104.36.82.49:4012 , piece_id=QWX44RJWWUGUI55TLSFF2JVTJJIRXHXDHB65X5WU4NVBPEFSBD5Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641109561 (17h37m55.600206809s) [noise=true , address=104.36.82.39:4759 , piece_id=UL2HMA7BUY7VLIOSHLIPKQM2ATWWDK2M6XXSGSA56HRGRUDWFLTA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641359433 (17h37m55.600456681s) [noise=true , address=104.36.82.46:4481 , piece_id=JGKZX2W3ZEELLRJ7PXRBXKEVDHI3MOUJHUQJWCLY5EXMTHATROWA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641638917 (17h37m55.600736168s) [noise=true , address=104.36.82.61:4398 , piece_id=PV2QIFCEUQAPFXDVGM7M6O6KHXBPCMLFFOTTI56KCN3QHBICTB6Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641656561 (17h37m55.600753806s) [noise=true , address=104.36.82.45:4916 , piece_id=6TY2WAMIDF6JEGXSINF6HJ6UZ4XW5RO2KCHIXUDKWTPNWPHSBGHA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641888735 (17h37m55.60098599s) [noise=true , address=104.36.82.22:4515 , piece_id=KNQOZZWUJOSUKCHQF5HKSOFVZKFVZVLKSBZMI2BZLPT7PMUBBASA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.642145267 (17h37m55.601242513s) [noise=true , address=104.36.82.37:4659 , piece_id=2HYQFY2DQOOVRU73DGQGERDTOCKX5PSCAAEXFIM2DXKO6COVUEEA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.642575454 (17h37m55.601672699s) [noise=true , address=104.36.82.16:4309 , piece_id=4GUOMDCITICDLOYZG32A3XCT42KYMGL3XQAZEQU26WCY32LEOOFQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.643109553 (17h37m55.602206812s) [noise=true , address=104.36.82.23:4449 , piece_id=GYBSPRZMW5DVWMHWOGU5TNS2FQ4O44NZXBM3PNKGMDGCWNIO4WNA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:34.225891854 (17h37m56.184989092s) [upload=18363]: Next returned nil segment
Aug 9 11:03:34.225941492 (17h37m56.185038737s) [upload=18363]: Waiting for error group managing segments...
Aug 9 11:03:34.396000323 (17h37m56.355097556s) [noise=true , address=104.36.82.62:4437 , piece_id=6IHWL5KFKP7BFIOJBK22S54BCWDJLNU53NBL7YKMNJUUACKTBACQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.396691127 (17h37m56.355788358s) [noise=true , address=104.36.82.44:4888 , piece_id=S6E6BTCSDGY2O3MPL2TZTU5DQCJ7ZM4G5KISVXZ757IDZBFVCQ4A, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.402779234 (17h37m56.361876483s) [noise=true , address=104.36.82.49:4012 , piece_id=QWX44RJWWUGUI55TLSFF2JVTJJIRXHXDHB65X5WU4NVBPEFSBD5Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.404422717 (17h37m56.363519973s) [noise=true , address=104.36.82.45:4916 , piece_id=6TY2WAMIDF6JEGXSINF6HJ6UZ4XW5RO2KCHIXUDKWTPNWPHSBGHA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.405872545 (17h37m56.364969793s) [noise=true , address=104.36.82.16:4317 , piece_id=2UHP3NEII7IMQTF5QXEC3RAYWLDGKXLSMTYJJ53GPZVOPSDN3A6Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.406694183 (17h37m56.365791421s) [noise=true , address=104.36.82.37:4659 , piece_id=2HYQFY2DQOOVRU73DGQGERDTOCKX5PSCAAEXFIM2DXKO6COVUEEA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.408468607 (17h37m56.367565845s) [noise=true , address=104.36.82.39:4759 , piece_id=UL2HMA7BUY7VLIOSHLIPKQM2ATWWDK2M6XXSGSA56HRGRUDWFLTA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.408705865 (17h37m56.367803099s) [noise=true , address=104.36.82.16:4309 , piece_id=4GUOMDCITICDLOYZG32A3XCT42KYMGL3XQAZEQU26WCY32LEOOFQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.409792379 (17h37m56.368889625s) [noise=true , address=104.36.82.5:4862 , piece_id=VBW5XUEAL34KRE2JRGQ4RDDBNYWFVDUBXBJ3QL2REGAPFXX3EHEA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.410123205 (17h37m56.369220457s) [noise=true , address=104.36.82.23:4449 , piece_id=GYBSPRZMW5DVWMHWOGU5TNS2FQ4O44NZXBM3PNKGMDGCWNIO4WNA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.410585122 (17h37m56.36968236s) [noise=true , address=104.36.82.38:4699 , piece_id=WYQRYJDHI5FVM2KTHLGBCDOBAOTYVWHQ6IDWI5GQ5MQUBHAUIFLA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.412570982 (17h37m56.371668232s) [noise=true , address=104.36.82.46:4481 , piece_id=JGKZX2W3ZEELLRJ7PXRBXKEVDHI3MOUJHUQJWCLY5EXMTHATROWA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417283695 (17h37m56.376380938s) [noise=true , address=104.36.82.36:4651 , piece_id=DKVNFKDGOV2JI25CG33WWVMYN6SOARCTVENJ4STBYYRCXVDHTWHQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417798285 (17h37m56.376895523s) [noise=true , address=104.36.82.61:4398 , piece_id=PV2QIFCEUQAPFXDVGM7M6O6KHXBPCMLFFOTTI56KCN3QHBICTB6Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417834276 (17h37m56.376931524s) [seg_pos={0 0}, upload=18363]: Segment reached optimal threshold of 14 pieces.
Aug 9 11:03:34.418045510 (17h37m56.377142744s) [noise=true , address=104.36.82.22:4515 , piece_id=KNQOZZWUJOSUKCHQF5HKSOFVZKFVZVLKSBZMI2BZLPT7PMUBBASA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZZmn2sRUkYuNmHY3RY7skQwAYoVYth7rJ8DhmjEpzgE4Rtmxb): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418071259 (17h37m56.377168492s) [noise=true , address=104.36.82.59:4323 , piece_id=AMEOXBJH3FY7QEM4CUX5VVSERBMOFT6TCXC34RRODALRM3DQXGCQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HLr6Ha1ysWYbUJ8He7RofMFCz8qVuJMBFkfJgnTUVw1kmXckz): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418152158 (17h37m56.377249395s) [noise=true , address=104.36.82.10:4093 , piece_id=SKI2RIGZMKQPM55NO23Y7VW7L4J35CWUWREONMLKFV3JEARAW4DQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SsKS8mvgkHszRNtGrt5bktXsJpbdggkeY4tuiAUni6hZ3FnAw): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418262605 (17h37m56.377359853s) [noise=true , address=64.49.13.139:4474 , piece_id=RAJARTWAQ6HDQLUEFTKKBRG6LJCEZJU32AJGAZKFGYXDMBWFISRQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection; write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection
Aug 9 11:03:34.418285940 (17h37m56.377383186s) [seg_pos={0 0}, upload=18363]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 11:03:34.418389194 (17h37m56.377486439s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 11:03:34.418394613 (17h37m56.37749186s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 11:03:34.572765743 (17h37m56.531862993s) [upload=18363]: Done uploading segments...
Aug 9 11:03:34.572825239 (17h37m56.531922475s) [upload=18363]: Upload finished. err: <nil>
Duration: 2.49261827s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
5 out of 60 is failed (threshold=3) [...............X.X.......X..........................X......X] duration:
783.566989ms
FAIL (2025-08-09 11:15:00 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 9 11:14:59.679707459 (17h49m21.638804705s) [upload=18571]: Starting upload
Aug 9 11:14:59.679763670 (17h49m21.638860918s) [upload=18571]: Done starting upload
Aug 9 11:14:59.679831434 (17h49m21.638928679s) [upload=18571]: Uploading segments...
Aug 9 11:14:59.679882460 (17h49m21.638979715s) [upload=18571]: Got next segment. Inline: true
Aug 9 11:14:59.679890019 (17h49m21.638987254s) [upload=18571]: Waiting for error group managing segments...
Aug 9 11:14:59.679935106 (17h49m21.639032352s) [upload=18571]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 11:14:59.679940000 (17h49m21.639037239s) [upload=18571]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 9 11:14:59.679943497 (17h49m21.639040732s) [upload=18571]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 11:14:59.849417093 (17h49m21.808514326s) [upload=18571]: Done uploading segments...
Aug 9 11:14:59.849435467 (17h49m21.808532698s) [upload=18571]: Upload finished. err: <nil>
Duration: 783.598296ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X...X....................................X..............] duration:
2.527889916s
FAIL (2025-08-09 11:14:38 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 30732f12d1c23351236b52fc46e02ade72cbcc01d371bae982a9652c8f3b11e2 != before 9273f3c49dd081d02a56c33fd79fa76e24e29e38ec5c47c511ef60d0bc1d3a49
======LOGS======
Aug 9 11:03:33.439875370 (17h37m55.398972606s) [upload=18363]: Starting upload
Aug 9 11:03:33.439969368 (17h37m55.399066621s) [upload=18363]: Done starting upload
Aug 9 11:03:33.440161922 (17h37m55.399259165s) [upload=18363]: Uploading segments...
Aug 9 11:03:33.440319250 (17h37m55.399416518s) [upload=18363]: Got next segment. Inline: false
Aug 9 11:03:33.440397655 (17h37m55.399494909s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 11:03:33.440404620 (17h37m55.399501867s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 11:03:33.639038109 (17h37m55.598135354s) [seg_pos={0 0}, upload=18363]: Begin upload segment...
Aug 9 11:03:33.639091904 (17h37m55.598189152s) [seg_pos={0 0}, upload=18363]: Done begin upload segment.
Aug 9 11:03:33.639134621 (17h37m55.598231853s) [noise=true , address=64.49.13.139:4474 , piece_id=RAJARTWAQ6HDQLUEFTKKBRG6LJCEZJU32AJGAZKFGYXDMBWFISRQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639141148 (17h37m55.598238399s) [noise=true , address=104.36.82.10:4093 , piece_id=SKI2RIGZMKQPM55NO23Y7VW7L4J35CWUWREONMLKFV3JEARAW4DQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639530470 (17h37m55.598627723s) [noise=true , address=104.36.82.16:4317 , piece_id=2UHP3NEII7IMQTF5QXEC3RAYWLDGKXLSMTYJJ53GPZVOPSDN3A6Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639607585 (17h37m55.598704833s) [noise=true , address=104.36.82.62:4437 , piece_id=6IHWL5KFKP7BFIOJBK22S54BCWDJLNU53NBL7YKMNJUUACKTBACQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639794168 (17h37m55.598891412s) [noise=true , address=104.36.82.36:4651 , piece_id=DKVNFKDGOV2JI25CG33WWVMYN6SOARCTVENJ4STBYYRCXVDHTWHQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640025622 (17h37m55.599122874s) [noise=true , address=104.36.82.44:4888 , piece_id=S6E6BTCSDGY2O3MPL2TZTU5DQCJ7ZM4G5KISVXZ757IDZBFVCQ4A, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640260031 (17h37m55.599357283s) [noise=true , address=104.36.82.59:4323 , piece_id=AMEOXBJH3FY7QEM4CUX5VVSERBMOFT6TCXC34RRODALRM3DQXGCQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640518584 (17h37m55.599615829s) [noise=true , address=104.36.82.5:4862 , piece_id=VBW5XUEAL34KRE2JRGQ4RDDBNYWFVDUBXBJ3QL2REGAPFXX3EHEA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640713081 (17h37m55.599810332s) [noise=true , address=104.36.82.38:4699 , piece_id=WYQRYJDHI5FVM2KTHLGBCDOBAOTYVWHQ6IDWI5GQ5MQUBHAUIFLA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641018305 (17h37m55.600115559s) [noise=true , address=104.36.82.49:4012 , piece_id=QWX44RJWWUGUI55TLSFF2JVTJJIRXHXDHB65X5WU4NVBPEFSBD5Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641109561 (17h37m55.600206809s) [noise=true , address=104.36.82.39:4759 , piece_id=UL2HMA7BUY7VLIOSHLIPKQM2ATWWDK2M6XXSGSA56HRGRUDWFLTA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641359433 (17h37m55.600456681s) [noise=true , address=104.36.82.46:4481 , piece_id=JGKZX2W3ZEELLRJ7PXRBXKEVDHI3MOUJHUQJWCLY5EXMTHATROWA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641638917 (17h37m55.600736168s) [noise=true , address=104.36.82.61:4398 , piece_id=PV2QIFCEUQAPFXDVGM7M6O6KHXBPCMLFFOTTI56KCN3QHBICTB6Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641656561 (17h37m55.600753806s) [noise=true , address=104.36.82.45:4916 , piece_id=6TY2WAMIDF6JEGXSINF6HJ6UZ4XW5RO2KCHIXUDKWTPNWPHSBGHA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641888735 (17h37m55.60098599s) [noise=true , address=104.36.82.22:4515 , piece_id=KNQOZZWUJOSUKCHQF5HKSOFVZKFVZVLKSBZMI2BZLPT7PMUBBASA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.642145267 (17h37m55.601242513s) [noise=true , address=104.36.82.37:4659 , piece_id=2HYQFY2DQOOVRU73DGQGERDTOCKX5PSCAAEXFIM2DXKO6COVUEEA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.642575454 (17h37m55.601672699s) [noise=true , address=104.36.82.16:4309 , piece_id=4GUOMDCITICDLOYZG32A3XCT42KYMGL3XQAZEQU26WCY32LEOOFQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.643109553 (17h37m55.602206812s) [noise=true , address=104.36.82.23:4449 , piece_id=GYBSPRZMW5DVWMHWOGU5TNS2FQ4O44NZXBM3PNKGMDGCWNIO4WNA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:34.225891854 (17h37m56.184989092s) [upload=18363]: Next returned nil segment
Aug 9 11:03:34.225941492 (17h37m56.185038737s) [upload=18363]: Waiting for error group managing segments...
Aug 9 11:03:34.396000323 (17h37m56.355097556s) [noise=true , address=104.36.82.62:4437 , piece_id=6IHWL5KFKP7BFIOJBK22S54BCWDJLNU53NBL7YKMNJUUACKTBACQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.396691127 (17h37m56.355788358s) [noise=true , address=104.36.82.44:4888 , piece_id=S6E6BTCSDGY2O3MPL2TZTU5DQCJ7ZM4G5KISVXZ757IDZBFVCQ4A, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.402779234 (17h37m56.361876483s) [noise=true , address=104.36.82.49:4012 , piece_id=QWX44RJWWUGUI55TLSFF2JVTJJIRXHXDHB65X5WU4NVBPEFSBD5Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.404422717 (17h37m56.363519973s) [noise=true , address=104.36.82.45:4916 , piece_id=6TY2WAMIDF6JEGXSINF6HJ6UZ4XW5RO2KCHIXUDKWTPNWPHSBGHA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.405872545 (17h37m56.364969793s) [noise=true , address=104.36.82.16:4317 , piece_id=2UHP3NEII7IMQTF5QXEC3RAYWLDGKXLSMTYJJ53GPZVOPSDN3A6Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.406694183 (17h37m56.365791421s) [noise=true , address=104.36.82.37:4659 , piece_id=2HYQFY2DQOOVRU73DGQGERDTOCKX5PSCAAEXFIM2DXKO6COVUEEA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.408468607 (17h37m56.367565845s) [noise=true , address=104.36.82.39:4759 , piece_id=UL2HMA7BUY7VLIOSHLIPKQM2ATWWDK2M6XXSGSA56HRGRUDWFLTA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.408705865 (17h37m56.367803099s) [noise=true , address=104.36.82.16:4309 , piece_id=4GUOMDCITICDLOYZG32A3XCT42KYMGL3XQAZEQU26WCY32LEOOFQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.409792379 (17h37m56.368889625s) [noise=true , address=104.36.82.5:4862 , piece_id=VBW5XUEAL34KRE2JRGQ4RDDBNYWFVDUBXBJ3QL2REGAPFXX3EHEA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.410123205 (17h37m56.369220457s) [noise=true , address=104.36.82.23:4449 , piece_id=GYBSPRZMW5DVWMHWOGU5TNS2FQ4O44NZXBM3PNKGMDGCWNIO4WNA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.410585122 (17h37m56.36968236s) [noise=true , address=104.36.82.38:4699 , piece_id=WYQRYJDHI5FVM2KTHLGBCDOBAOTYVWHQ6IDWI5GQ5MQUBHAUIFLA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.412570982 (17h37m56.371668232s) [noise=true , address=104.36.82.46:4481 , piece_id=JGKZX2W3ZEELLRJ7PXRBXKEVDHI3MOUJHUQJWCLY5EXMTHATROWA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417283695 (17h37m56.376380938s) [noise=true , address=104.36.82.36:4651 , piece_id=DKVNFKDGOV2JI25CG33WWVMYN6SOARCTVENJ4STBYYRCXVDHTWHQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417798285 (17h37m56.376895523s) [noise=true , address=104.36.82.61:4398 , piece_id=PV2QIFCEUQAPFXDVGM7M6O6KHXBPCMLFFOTTI56KCN3QHBICTB6Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417834276 (17h37m56.376931524s) [seg_pos={0 0}, upload=18363]: Segment reached optimal threshold of 14 pieces.
Aug 9 11:03:34.418045510 (17h37m56.377142744s) [noise=true , address=104.36.82.22:4515 , piece_id=KNQOZZWUJOSUKCHQF5HKSOFVZKFVZVLKSBZMI2BZLPT7PMUBBASA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZZmn2sRUkYuNmHY3RY7skQwAYoVYth7rJ8DhmjEpzgE4Rtmxb): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418071259 (17h37m56.377168492s) [noise=true , address=104.36.82.59:4323 , piece_id=AMEOXBJH3FY7QEM4CUX5VVSERBMOFT6TCXC34RRODALRM3DQXGCQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HLr6Ha1ysWYbUJ8He7RofMFCz8qVuJMBFkfJgnTUVw1kmXckz): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418152158 (17h37m56.377249395s) [noise=true , address=104.36.82.10:4093 , piece_id=SKI2RIGZMKQPM55NO23Y7VW7L4J35CWUWREONMLKFV3JEARAW4DQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SsKS8mvgkHszRNtGrt5bktXsJpbdggkeY4tuiAUni6hZ3FnAw): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418262605 (17h37m56.377359853s) [noise=true , address=64.49.13.139:4474 , piece_id=RAJARTWAQ6HDQLUEFTKKBRG6LJCEZJU32AJGAZKFGYXDMBWFISRQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection; write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection
Aug 9 11:03:34.418285940 (17h37m56.377383186s) [seg_pos={0 0}, upload=18363]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 11:03:34.418389194 (17h37m56.377486439s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 11:03:34.418394613 (17h37m56.37749186s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 11:03:34.572765743 (17h37m56.531862993s) [upload=18363]: Done uploading segments...
Aug 9 11:03:34.572825239 (17h37m56.531922475s) [upload=18363]: Upload finished. err: <nil>
Duration: 2.527921884s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [................X.X.......X..........................X......] duration:
848.274222ms
FAIL (2025-08-09 11:14:17 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 11:09:57.816521532 (17h44m19.775618784s) [upload=18478]: Starting upload Aug 9 11:09:57.816586443 (17h44m19.775683697s) [upload=18478]: Done starting upload Aug 9 11:09:57.816681710 (17h44m19.775778949s) [upload=18478]: Uploading segments... Aug 9 11:09:57.816723382 (17h44m19.775820633s) [upload=18478]: Got next segment. Inline: true Aug 9 11:09:57.816729621 (17h44m19.775826867s) [upload=18478]: Waiting for error group managing segments... Aug 9 11:09:57.816789140 (17h44m19.775886389s) [upload=18478]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 11:09:57.816796364 (17h44m19.775893609s) [upload=18478]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 11:09:57.816801874 (17h44m19.775899123s) [upload=18478]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 11:09:57.905351526 (17h44m19.864448771s) [upload=18478]: Done uploading segments... Aug 9 11:09:57.905385518 (17h44m19.864482762s) [upload=18478]: Upload finished. err: metaclient: Too Many Requests
Duration: 848.308898ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X...X....................................X.............] duration:
2.366353527s
FAIL (2025-08-09 11:13:57 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 30732f12d1c23351236b52fc46e02ade72cbcc01d371bae982a9652c8f3b11e2 != before 9273f3c49dd081d02a56c33fd79fa76e24e29e38ec5c47c511ef60d0bc1d3a49
======LOGS======
Aug 9 11:03:33.439875370 (17h37m55.398972606s) [upload=18363]: Starting upload
Aug 9 11:03:33.439969368 (17h37m55.399066621s) [upload=18363]: Done starting upload
Aug 9 11:03:33.440161922 (17h37m55.399259165s) [upload=18363]: Uploading segments...
Aug 9 11:03:33.440319250 (17h37m55.399416518s) [upload=18363]: Got next segment. Inline: false
Aug 9 11:03:33.440397655 (17h37m55.399494909s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 11:03:33.440404620 (17h37m55.399501867s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 11:03:33.639038109 (17h37m55.598135354s) [seg_pos={0 0}, upload=18363]: Begin upload segment...
Aug 9 11:03:33.639091904 (17h37m55.598189152s) [seg_pos={0 0}, upload=18363]: Done begin upload segment.
Aug 9 11:03:33.639134621 (17h37m55.598231853s) [noise=true , address=64.49.13.139:4474 , piece_id=RAJARTWAQ6HDQLUEFTKKBRG6LJCEZJU32AJGAZKFGYXDMBWFISRQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639141148 (17h37m55.598238399s) [noise=true , address=104.36.82.10:4093 , piece_id=SKI2RIGZMKQPM55NO23Y7VW7L4J35CWUWREONMLKFV3JEARAW4DQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639530470 (17h37m55.598627723s) [noise=true , address=104.36.82.16:4317 , piece_id=2UHP3NEII7IMQTF5QXEC3RAYWLDGKXLSMTYJJ53GPZVOPSDN3A6Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639607585 (17h37m55.598704833s) [noise=true , address=104.36.82.62:4437 , piece_id=6IHWL5KFKP7BFIOJBK22S54BCWDJLNU53NBL7YKMNJUUACKTBACQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639794168 (17h37m55.598891412s) [noise=true , address=104.36.82.36:4651 , piece_id=DKVNFKDGOV2JI25CG33WWVMYN6SOARCTVENJ4STBYYRCXVDHTWHQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640025622 (17h37m55.599122874s) [noise=true , address=104.36.82.44:4888 , piece_id=S6E6BTCSDGY2O3MPL2TZTU5DQCJ7ZM4G5KISVXZ757IDZBFVCQ4A, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640260031 (17h37m55.599357283s) [noise=true , address=104.36.82.59:4323 , piece_id=AMEOXBJH3FY7QEM4CUX5VVSERBMOFT6TCXC34RRODALRM3DQXGCQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640518584 (17h37m55.599615829s) [noise=true , address=104.36.82.5:4862 , piece_id=VBW5XUEAL34KRE2JRGQ4RDDBNYWFVDUBXBJ3QL2REGAPFXX3EHEA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640713081 (17h37m55.599810332s) [noise=true , address=104.36.82.38:4699 , piece_id=WYQRYJDHI5FVM2KTHLGBCDOBAOTYVWHQ6IDWI5GQ5MQUBHAUIFLA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641018305 (17h37m55.600115559s) [noise=true , address=104.36.82.49:4012 , piece_id=QWX44RJWWUGUI55TLSFF2JVTJJIRXHXDHB65X5WU4NVBPEFSBD5Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641109561 (17h37m55.600206809s) [noise=true , address=104.36.82.39:4759 , piece_id=UL2HMA7BUY7VLIOSHLIPKQM2ATWWDK2M6XXSGSA56HRGRUDWFLTA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641359433 (17h37m55.600456681s) [noise=true , address=104.36.82.46:4481 , piece_id=JGKZX2W3ZEELLRJ7PXRBXKEVDHI3MOUJHUQJWCLY5EXMTHATROWA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641638917 (17h37m55.600736168s) [noise=true , address=104.36.82.61:4398 , piece_id=PV2QIFCEUQAPFXDVGM7M6O6KHXBPCMLFFOTTI56KCN3QHBICTB6Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641656561 (17h37m55.600753806s) [noise=true , address=104.36.82.45:4916 , piece_id=6TY2WAMIDF6JEGXSINF6HJ6UZ4XW5RO2KCHIXUDKWTPNWPHSBGHA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641888735 (17h37m55.60098599s) [noise=true , address=104.36.82.22:4515 , piece_id=KNQOZZWUJOSUKCHQF5HKSOFVZKFVZVLKSBZMI2BZLPT7PMUBBASA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.642145267 (17h37m55.601242513s) [noise=true , address=104.36.82.37:4659 , piece_id=2HYQFY2DQOOVRU73DGQGERDTOCKX5PSCAAEXFIM2DXKO6COVUEEA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.642575454 (17h37m55.601672699s) [noise=true , address=104.36.82.16:4309 , piece_id=4GUOMDCITICDLOYZG32A3XCT42KYMGL3XQAZEQU26WCY32LEOOFQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.643109553 (17h37m55.602206812s) [noise=true , address=104.36.82.23:4449 , piece_id=GYBSPRZMW5DVWMHWOGU5TNS2FQ4O44NZXBM3PNKGMDGCWNIO4WNA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:34.225891854 (17h37m56.184989092s) [upload=18363]: Next returned nil segment
Aug 9 11:03:34.225941492 (17h37m56.185038737s) [upload=18363]: Waiting for error group managing segments...
Aug 9 11:03:34.396000323 (17h37m56.355097556s) [noise=true , address=104.36.82.62:4437 , piece_id=6IHWL5KFKP7BFIOJBK22S54BCWDJLNU53NBL7YKMNJUUACKTBACQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.396691127 (17h37m56.355788358s) [noise=true , address=104.36.82.44:4888 , piece_id=S6E6BTCSDGY2O3MPL2TZTU5DQCJ7ZM4G5KISVXZ757IDZBFVCQ4A, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.402779234 (17h37m56.361876483s) [noise=true , address=104.36.82.49:4012 , piece_id=QWX44RJWWUGUI55TLSFF2JVTJJIRXHXDHB65X5WU4NVBPEFSBD5Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.404422717 (17h37m56.363519973s) [noise=true , address=104.36.82.45:4916 , piece_id=6TY2WAMIDF6JEGXSINF6HJ6UZ4XW5RO2KCHIXUDKWTPNWPHSBGHA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.405872545 (17h37m56.364969793s) [noise=true , address=104.36.82.16:4317 , piece_id=2UHP3NEII7IMQTF5QXEC3RAYWLDGKXLSMTYJJ53GPZVOPSDN3A6Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.406694183 (17h37m56.365791421s) [noise=true , address=104.36.82.37:4659 , piece_id=2HYQFY2DQOOVRU73DGQGERDTOCKX5PSCAAEXFIM2DXKO6COVUEEA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.408468607 (17h37m56.367565845s) [noise=true , address=104.36.82.39:4759 , piece_id=UL2HMA7BUY7VLIOSHLIPKQM2ATWWDK2M6XXSGSA56HRGRUDWFLTA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.408705865 (17h37m56.367803099s) [noise=true , address=104.36.82.16:4309 , piece_id=4GUOMDCITICDLOYZG32A3XCT42KYMGL3XQAZEQU26WCY32LEOOFQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.409792379 (17h37m56.368889625s) [noise=true , address=104.36.82.5:4862 , piece_id=VBW5XUEAL34KRE2JRGQ4RDDBNYWFVDUBXBJ3QL2REGAPFXX3EHEA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.410123205 (17h37m56.369220457s) [noise=true , address=104.36.82.23:4449 , piece_id=GYBSPRZMW5DVWMHWOGU5TNS2FQ4O44NZXBM3PNKGMDGCWNIO4WNA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.410585122 (17h37m56.36968236s) [noise=true , address=104.36.82.38:4699 , piece_id=WYQRYJDHI5FVM2KTHLGBCDOBAOTYVWHQ6IDWI5GQ5MQUBHAUIFLA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.412570982 (17h37m56.371668232s) [noise=true , address=104.36.82.46:4481 , piece_id=JGKZX2W3ZEELLRJ7PXRBXKEVDHI3MOUJHUQJWCLY5EXMTHATROWA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417283695 (17h37m56.376380938s) [noise=true , address=104.36.82.36:4651 , piece_id=DKVNFKDGOV2JI25CG33WWVMYN6SOARCTVENJ4STBYYRCXVDHTWHQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417798285 (17h37m56.376895523s) [noise=true , address=104.36.82.61:4398 , piece_id=PV2QIFCEUQAPFXDVGM7M6O6KHXBPCMLFFOTTI56KCN3QHBICTB6Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417834276 (17h37m56.376931524s) [seg_pos={0 0}, upload=18363]: Segment reached optimal threshold of 14 pieces.
Aug 9 11:03:34.418045510 (17h37m56.377142744s) [noise=true , address=104.36.82.22:4515 , piece_id=KNQOZZWUJOSUKCHQF5HKSOFVZKFVZVLKSBZMI2BZLPT7PMUBBASA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZZmn2sRUkYuNmHY3RY7skQwAYoVYth7rJ8DhmjEpzgE4Rtmxb): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418071259 (17h37m56.377168492s) [noise=true , address=104.36.82.59:4323 , piece_id=AMEOXBJH3FY7QEM4CUX5VVSERBMOFT6TCXC34RRODALRM3DQXGCQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HLr6Ha1ysWYbUJ8He7RofMFCz8qVuJMBFkfJgnTUVw1kmXckz): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418152158 (17h37m56.377249395s) [noise=true , address=104.36.82.10:4093 , piece_id=SKI2RIGZMKQPM55NO23Y7VW7L4J35CWUWREONMLKFV3JEARAW4DQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SsKS8mvgkHszRNtGrt5bktXsJpbdggkeY4tuiAUni6hZ3FnAw): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418262605 (17h37m56.377359853s) [noise=true , address=64.49.13.139:4474 , piece_id=RAJARTWAQ6HDQLUEFTKKBRG6LJCEZJU32AJGAZKFGYXDMBWFISRQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection; write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection
Aug 9 11:03:34.418285940 (17h37m56.377383186s) [seg_pos={0 0}, upload=18363]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 11:03:34.418389194 (17h37m56.377486439s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 11:03:34.418394613 (17h37m56.37749186s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 11:03:34.572765743 (17h37m56.531862993s) [upload=18363]: Done uploading segments...
Aug 9 11:03:34.572825239 (17h37m56.531922475s) [upload=18363]: Upload finished. err: <nil>
Duration: 2.366373942s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.................X.X.......X..........................X.....] duration:
878.827437ms
FAIL (2025-08-09 11:13:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 11:09:57.816521532 (17h44m19.775618784s) [upload=18478]: Starting upload Aug 9 11:09:57.816586443 (17h44m19.775683697s) [upload=18478]: Done starting upload Aug 9 11:09:57.816681710 (17h44m19.775778949s) [upload=18478]: Uploading segments... Aug 9 11:09:57.816723382 (17h44m19.775820633s) [upload=18478]: Got next segment. Inline: true Aug 9 11:09:57.816729621 (17h44m19.775826867s) [upload=18478]: Waiting for error group managing segments... Aug 9 11:09:57.816789140 (17h44m19.775886389s) [upload=18478]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 11:09:57.816796364 (17h44m19.775893609s) [upload=18478]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 11:09:57.816801874 (17h44m19.775899123s) [upload=18478]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 11:09:57.905351526 (17h44m19.864448771s) [upload=18478]: Done uploading segments... Aug 9 11:09:57.905385518 (17h44m19.864482762s) [upload=18478]: Upload finished. err: metaclient: Too Many Requests
Duration: 878.862224ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X...X....................................X............] duration:
2.316734407s
FAIL (2025-08-09 11:12:51 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 30732f12d1c23351236b52fc46e02ade72cbcc01d371bae982a9652c8f3b11e2 != before 9273f3c49dd081d02a56c33fd79fa76e24e29e38ec5c47c511ef60d0bc1d3a49
======LOGS======
Aug 9 11:03:33.439875370 (17h37m55.398972606s) [upload=18363]: Starting upload
Aug 9 11:03:33.439969368 (17h37m55.399066621s) [upload=18363]: Done starting upload
Aug 9 11:03:33.440161922 (17h37m55.399259165s) [upload=18363]: Uploading segments...
Aug 9 11:03:33.440319250 (17h37m55.399416518s) [upload=18363]: Got next segment. Inline: false
Aug 9 11:03:33.440397655 (17h37m55.399494909s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 11:03:33.440404620 (17h37m55.399501867s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 11:03:33.639038109 (17h37m55.598135354s) [seg_pos={0 0}, upload=18363]: Begin upload segment...
Aug 9 11:03:33.639091904 (17h37m55.598189152s) [seg_pos={0 0}, upload=18363]: Done begin upload segment.
Aug 9 11:03:33.639134621 (17h37m55.598231853s) [noise=true , address=64.49.13.139:4474 , piece_id=RAJARTWAQ6HDQLUEFTKKBRG6LJCEZJU32AJGAZKFGYXDMBWFISRQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639141148 (17h37m55.598238399s) [noise=true , address=104.36.82.10:4093 , piece_id=SKI2RIGZMKQPM55NO23Y7VW7L4J35CWUWREONMLKFV3JEARAW4DQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639530470 (17h37m55.598627723s) [noise=true , address=104.36.82.16:4317 , piece_id=2UHP3NEII7IMQTF5QXEC3RAYWLDGKXLSMTYJJ53GPZVOPSDN3A6Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639607585 (17h37m55.598704833s) [noise=true , address=104.36.82.62:4437 , piece_id=6IHWL5KFKP7BFIOJBK22S54BCWDJLNU53NBL7YKMNJUUACKTBACQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639794168 (17h37m55.598891412s) [noise=true , address=104.36.82.36:4651 , piece_id=DKVNFKDGOV2JI25CG33WWVMYN6SOARCTVENJ4STBYYRCXVDHTWHQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640025622 (17h37m55.599122874s) [noise=true , address=104.36.82.44:4888 , piece_id=S6E6BTCSDGY2O3MPL2TZTU5DQCJ7ZM4G5KISVXZ757IDZBFVCQ4A, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640260031 (17h37m55.599357283s) [noise=true , address=104.36.82.59:4323 , piece_id=AMEOXBJH3FY7QEM4CUX5VVSERBMOFT6TCXC34RRODALRM3DQXGCQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640518584 (17h37m55.599615829s) [noise=true , address=104.36.82.5:4862 , piece_id=VBW5XUEAL34KRE2JRGQ4RDDBNYWFVDUBXBJ3QL2REGAPFXX3EHEA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640713081 (17h37m55.599810332s) [noise=true , address=104.36.82.38:4699 , piece_id=WYQRYJDHI5FVM2KTHLGBCDOBAOTYVWHQ6IDWI5GQ5MQUBHAUIFLA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641018305 (17h37m55.600115559s) [noise=true , address=104.36.82.49:4012 , piece_id=QWX44RJWWUGUI55TLSFF2JVTJJIRXHXDHB65X5WU4NVBPEFSBD5Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641109561 (17h37m55.600206809s) [noise=true , address=104.36.82.39:4759 , piece_id=UL2HMA7BUY7VLIOSHLIPKQM2ATWWDK2M6XXSGSA56HRGRUDWFLTA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641359433 (17h37m55.600456681s) [noise=true , address=104.36.82.46:4481 , piece_id=JGKZX2W3ZEELLRJ7PXRBXKEVDHI3MOUJHUQJWCLY5EXMTHATROWA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641638917 (17h37m55.600736168s) [noise=true , address=104.36.82.61:4398 , piece_id=PV2QIFCEUQAPFXDVGM7M6O6KHXBPCMLFFOTTI56KCN3QHBICTB6Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641656561 (17h37m55.600753806s) [noise=true , address=104.36.82.45:4916 , piece_id=6TY2WAMIDF6JEGXSINF6HJ6UZ4XW5RO2KCHIXUDKWTPNWPHSBGHA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641888735 (17h37m55.60098599s) [noise=true , address=104.36.82.22:4515 , piece_id=KNQOZZWUJOSUKCHQF5HKSOFVZKFVZVLKSBZMI2BZLPT7PMUBBASA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.642145267 (17h37m55.601242513s) [noise=true , address=104.36.82.37:4659 , piece_id=2HYQFY2DQOOVRU73DGQGERDTOCKX5PSCAAEXFIM2DXKO6COVUEEA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.642575454 (17h37m55.601672699s) [noise=true , address=104.36.82.16:4309 , piece_id=4GUOMDCITICDLOYZG32A3XCT42KYMGL3XQAZEQU26WCY32LEOOFQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.643109553 (17h37m55.602206812s) [noise=true , address=104.36.82.23:4449 , piece_id=GYBSPRZMW5DVWMHWOGU5TNS2FQ4O44NZXBM3PNKGMDGCWNIO4WNA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:34.225891854 (17h37m56.184989092s) [upload=18363]: Next returned nil segment
Aug 9 11:03:34.225941492 (17h37m56.185038737s) [upload=18363]: Waiting for error group managing segments...
Aug 9 11:03:34.396000323 (17h37m56.355097556s) [noise=true , address=104.36.82.62:4437 , piece_id=6IHWL5KFKP7BFIOJBK22S54BCWDJLNU53NBL7YKMNJUUACKTBACQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.396691127 (17h37m56.355788358s) [noise=true , address=104.36.82.44:4888 , piece_id=S6E6BTCSDGY2O3MPL2TZTU5DQCJ7ZM4G5KISVXZ757IDZBFVCQ4A, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.402779234 (17h37m56.361876483s) [noise=true , address=104.36.82.49:4012 , piece_id=QWX44RJWWUGUI55TLSFF2JVTJJIRXHXDHB65X5WU4NVBPEFSBD5Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.404422717 (17h37m56.363519973s) [noise=true , address=104.36.82.45:4916 , piece_id=6TY2WAMIDF6JEGXSINF6HJ6UZ4XW5RO2KCHIXUDKWTPNWPHSBGHA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.405872545 (17h37m56.364969793s) [noise=true , address=104.36.82.16:4317 , piece_id=2UHP3NEII7IMQTF5QXEC3RAYWLDGKXLSMTYJJ53GPZVOPSDN3A6Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.406694183 (17h37m56.365791421s) [noise=true , address=104.36.82.37:4659 , piece_id=2HYQFY2DQOOVRU73DGQGERDTOCKX5PSCAAEXFIM2DXKO6COVUEEA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.408468607 (17h37m56.367565845s) [noise=true , address=104.36.82.39:4759 , piece_id=UL2HMA7BUY7VLIOSHLIPKQM2ATWWDK2M6XXSGSA56HRGRUDWFLTA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.408705865 (17h37m56.367803099s) [noise=true , address=104.36.82.16:4309 , piece_id=4GUOMDCITICDLOYZG32A3XCT42KYMGL3XQAZEQU26WCY32LEOOFQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.409792379 (17h37m56.368889625s) [noise=true , address=104.36.82.5:4862 , piece_id=VBW5XUEAL34KRE2JRGQ4RDDBNYWFVDUBXBJ3QL2REGAPFXX3EHEA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.410123205 (17h37m56.369220457s) [noise=true , address=104.36.82.23:4449 , piece_id=GYBSPRZMW5DVWMHWOGU5TNS2FQ4O44NZXBM3PNKGMDGCWNIO4WNA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.410585122 (17h37m56.36968236s) [noise=true , address=104.36.82.38:4699 , piece_id=WYQRYJDHI5FVM2KTHLGBCDOBAOTYVWHQ6IDWI5GQ5MQUBHAUIFLA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.412570982 (17h37m56.371668232s) [noise=true , address=104.36.82.46:4481 , piece_id=JGKZX2W3ZEELLRJ7PXRBXKEVDHI3MOUJHUQJWCLY5EXMTHATROWA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417283695 (17h37m56.376380938s) [noise=true , address=104.36.82.36:4651 , piece_id=DKVNFKDGOV2JI25CG33WWVMYN6SOARCTVENJ4STBYYRCXVDHTWHQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417798285 (17h37m56.376895523s) [noise=true , address=104.36.82.61:4398 , piece_id=PV2QIFCEUQAPFXDVGM7M6O6KHXBPCMLFFOTTI56KCN3QHBICTB6Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417834276 (17h37m56.376931524s) [seg_pos={0 0}, upload=18363]: Segment reached optimal threshold of 14 pieces.
Aug 9 11:03:34.418045510 (17h37m56.377142744s) [noise=true , address=104.36.82.22:4515 , piece_id=KNQOZZWUJOSUKCHQF5HKSOFVZKFVZVLKSBZMI2BZLPT7PMUBBASA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZZmn2sRUkYuNmHY3RY7skQwAYoVYth7rJ8DhmjEpzgE4Rtmxb): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418071259 (17h37m56.377168492s) [noise=true , address=104.36.82.59:4323 , piece_id=AMEOXBJH3FY7QEM4CUX5VVSERBMOFT6TCXC34RRODALRM3DQXGCQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HLr6Ha1ysWYbUJ8He7RofMFCz8qVuJMBFkfJgnTUVw1kmXckz): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418152158 (17h37m56.377249395s) [noise=true , address=104.36.82.10:4093 , piece_id=SKI2RIGZMKQPM55NO23Y7VW7L4J35CWUWREONMLKFV3JEARAW4DQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SsKS8mvgkHszRNtGrt5bktXsJpbdggkeY4tuiAUni6hZ3FnAw): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418262605 (17h37m56.377359853s) [noise=true , address=64.49.13.139:4474 , piece_id=RAJARTWAQ6HDQLUEFTKKBRG6LJCEZJU32AJGAZKFGYXDMBWFISRQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection; write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection
Aug 9 11:03:34.418285940 (17h37m56.377383186s) [seg_pos={0 0}, upload=18363]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 11:03:34.418389194 (17h37m56.377486439s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 11:03:34.418394613 (17h37m56.37749186s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 11:03:34.572765743 (17h37m56.531862993s) [upload=18363]: Done uploading segments...
Aug 9 11:03:34.572825239 (17h37m56.531922475s) [upload=18363]: Upload finished. err: <nil>
Duration: 2.316795855s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..................X.X.......X..........................X....] duration:
858.219156ms
FAIL (2025-08-09 11:12:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 11:09:57.816521532 (17h44m19.775618784s) [upload=18478]: Starting upload Aug 9 11:09:57.816586443 (17h44m19.775683697s) [upload=18478]: Done starting upload Aug 9 11:09:57.816681710 (17h44m19.775778949s) [upload=18478]: Uploading segments... Aug 9 11:09:57.816723382 (17h44m19.775820633s) [upload=18478]: Got next segment. Inline: true Aug 9 11:09:57.816729621 (17h44m19.775826867s) [upload=18478]: Waiting for error group managing segments... Aug 9 11:09:57.816789140 (17h44m19.775886389s) [upload=18478]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 11:09:57.816796364 (17h44m19.775893609s) [upload=18478]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 11:09:57.816801874 (17h44m19.775899123s) [upload=18478]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 11:09:57.905351526 (17h44m19.864448771s) [upload=18478]: Done uploading segments... Aug 9 11:09:57.905385518 (17h44m19.864482762s) [upload=18478]: Upload finished. err: metaclient: Too Many Requests
Duration: 858.249905ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......X...X....................................X...........] duration:
2.412714301s
FAIL (2025-08-09 11:12:00 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 30732f12d1c23351236b52fc46e02ade72cbcc01d371bae982a9652c8f3b11e2 != before 9273f3c49dd081d02a56c33fd79fa76e24e29e38ec5c47c511ef60d0bc1d3a49
======LOGS======
Aug 9 11:03:33.439875370 (17h37m55.398972606s) [upload=18363]: Starting upload
Aug 9 11:03:33.439969368 (17h37m55.399066621s) [upload=18363]: Done starting upload
Aug 9 11:03:33.440161922 (17h37m55.399259165s) [upload=18363]: Uploading segments...
Aug 9 11:03:33.440319250 (17h37m55.399416518s) [upload=18363]: Got next segment. Inline: false
Aug 9 11:03:33.440397655 (17h37m55.399494909s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 11:03:33.440404620 (17h37m55.399501867s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 11:03:33.639038109 (17h37m55.598135354s) [seg_pos={0 0}, upload=18363]: Begin upload segment...
Aug 9 11:03:33.639091904 (17h37m55.598189152s) [seg_pos={0 0}, upload=18363]: Done begin upload segment.
Aug 9 11:03:33.639134621 (17h37m55.598231853s) [noise=true , address=64.49.13.139:4474 , piece_id=RAJARTWAQ6HDQLUEFTKKBRG6LJCEZJU32AJGAZKFGYXDMBWFISRQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639141148 (17h37m55.598238399s) [noise=true , address=104.36.82.10:4093 , piece_id=SKI2RIGZMKQPM55NO23Y7VW7L4J35CWUWREONMLKFV3JEARAW4DQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639530470 (17h37m55.598627723s) [noise=true , address=104.36.82.16:4317 , piece_id=2UHP3NEII7IMQTF5QXEC3RAYWLDGKXLSMTYJJ53GPZVOPSDN3A6Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639607585 (17h37m55.598704833s) [noise=true , address=104.36.82.62:4437 , piece_id=6IHWL5KFKP7BFIOJBK22S54BCWDJLNU53NBL7YKMNJUUACKTBACQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639794168 (17h37m55.598891412s) [noise=true , address=104.36.82.36:4651 , piece_id=DKVNFKDGOV2JI25CG33WWVMYN6SOARCTVENJ4STBYYRCXVDHTWHQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640025622 (17h37m55.599122874s) [noise=true , address=104.36.82.44:4888 , piece_id=S6E6BTCSDGY2O3MPL2TZTU5DQCJ7ZM4G5KISVXZ757IDZBFVCQ4A, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640260031 (17h37m55.599357283s) [noise=true , address=104.36.82.59:4323 , piece_id=AMEOXBJH3FY7QEM4CUX5VVSERBMOFT6TCXC34RRODALRM3DQXGCQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640518584 (17h37m55.599615829s) [noise=true , address=104.36.82.5:4862 , piece_id=VBW5XUEAL34KRE2JRGQ4RDDBNYWFVDUBXBJ3QL2REGAPFXX3EHEA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640713081 (17h37m55.599810332s) [noise=true , address=104.36.82.38:4699 , piece_id=WYQRYJDHI5FVM2KTHLGBCDOBAOTYVWHQ6IDWI5GQ5MQUBHAUIFLA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641018305 (17h37m55.600115559s) [noise=true , address=104.36.82.49:4012 , piece_id=QWX44RJWWUGUI55TLSFF2JVTJJIRXHXDHB65X5WU4NVBPEFSBD5Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641109561 (17h37m55.600206809s) [noise=true , address=104.36.82.39:4759 , piece_id=UL2HMA7BUY7VLIOSHLIPKQM2ATWWDK2M6XXSGSA56HRGRUDWFLTA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641359433 (17h37m55.600456681s) [noise=true , address=104.36.82.46:4481 , piece_id=JGKZX2W3ZEELLRJ7PXRBXKEVDHI3MOUJHUQJWCLY5EXMTHATROWA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641638917 (17h37m55.600736168s) [noise=true , address=104.36.82.61:4398 , piece_id=PV2QIFCEUQAPFXDVGM7M6O6KHXBPCMLFFOTTI56KCN3QHBICTB6Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641656561 (17h37m55.600753806s) [noise=true , address=104.36.82.45:4916 , piece_id=6TY2WAMIDF6JEGXSINF6HJ6UZ4XW5RO2KCHIXUDKWTPNWPHSBGHA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641888735 (17h37m55.60098599s) [noise=true , address=104.36.82.22:4515 , piece_id=KNQOZZWUJOSUKCHQF5HKSOFVZKFVZVLKSBZMI2BZLPT7PMUBBASA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.642145267 (17h37m55.601242513s) [noise=true , address=104.36.82.37:4659 , piece_id=2HYQFY2DQOOVRU73DGQGERDTOCKX5PSCAAEXFIM2DXKO6COVUEEA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.642575454 (17h37m55.601672699s) [noise=true , address=104.36.82.16:4309 , piece_id=4GUOMDCITICDLOYZG32A3XCT42KYMGL3XQAZEQU26WCY32LEOOFQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.643109553 (17h37m55.602206812s) [noise=true , address=104.36.82.23:4449 , piece_id=GYBSPRZMW5DVWMHWOGU5TNS2FQ4O44NZXBM3PNKGMDGCWNIO4WNA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:34.225891854 (17h37m56.184989092s) [upload=18363]: Next returned nil segment
Aug 9 11:03:34.225941492 (17h37m56.185038737s) [upload=18363]: Waiting for error group managing segments...
Aug 9 11:03:34.396000323 (17h37m56.355097556s) [noise=true , address=104.36.82.62:4437 , piece_id=6IHWL5KFKP7BFIOJBK22S54BCWDJLNU53NBL7YKMNJUUACKTBACQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.396691127 (17h37m56.355788358s) [noise=true , address=104.36.82.44:4888 , piece_id=S6E6BTCSDGY2O3MPL2TZTU5DQCJ7ZM4G5KISVXZ757IDZBFVCQ4A, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.402779234 (17h37m56.361876483s) [noise=true , address=104.36.82.49:4012 , piece_id=QWX44RJWWUGUI55TLSFF2JVTJJIRXHXDHB65X5WU4NVBPEFSBD5Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.404422717 (17h37m56.363519973s) [noise=true , address=104.36.82.45:4916 , piece_id=6TY2WAMIDF6JEGXSINF6HJ6UZ4XW5RO2KCHIXUDKWTPNWPHSBGHA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.405872545 (17h37m56.364969793s) [noise=true , address=104.36.82.16:4317 , piece_id=2UHP3NEII7IMQTF5QXEC3RAYWLDGKXLSMTYJJ53GPZVOPSDN3A6Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.406694183 (17h37m56.365791421s) [noise=true , address=104.36.82.37:4659 , piece_id=2HYQFY2DQOOVRU73DGQGERDTOCKX5PSCAAEXFIM2DXKO6COVUEEA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.408468607 (17h37m56.367565845s) [noise=true , address=104.36.82.39:4759 , piece_id=UL2HMA7BUY7VLIOSHLIPKQM2ATWWDK2M6XXSGSA56HRGRUDWFLTA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.408705865 (17h37m56.367803099s) [noise=true , address=104.36.82.16:4309 , piece_id=4GUOMDCITICDLOYZG32A3XCT42KYMGL3XQAZEQU26WCY32LEOOFQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.409792379 (17h37m56.368889625s) [noise=true , address=104.36.82.5:4862 , piece_id=VBW5XUEAL34KRE2JRGQ4RDDBNYWFVDUBXBJ3QL2REGAPFXX3EHEA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.410123205 (17h37m56.369220457s) [noise=true , address=104.36.82.23:4449 , piece_id=GYBSPRZMW5DVWMHWOGU5TNS2FQ4O44NZXBM3PNKGMDGCWNIO4WNA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.410585122 (17h37m56.36968236s) [noise=true , address=104.36.82.38:4699 , piece_id=WYQRYJDHI5FVM2KTHLGBCDOBAOTYVWHQ6IDWI5GQ5MQUBHAUIFLA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.412570982 (17h37m56.371668232s) [noise=true , address=104.36.82.46:4481 , piece_id=JGKZX2W3ZEELLRJ7PXRBXKEVDHI3MOUJHUQJWCLY5EXMTHATROWA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417283695 (17h37m56.376380938s) [noise=true , address=104.36.82.36:4651 , piece_id=DKVNFKDGOV2JI25CG33WWVMYN6SOARCTVENJ4STBYYRCXVDHTWHQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417798285 (17h37m56.376895523s) [noise=true , address=104.36.82.61:4398 , piece_id=PV2QIFCEUQAPFXDVGM7M6O6KHXBPCMLFFOTTI56KCN3QHBICTB6Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417834276 (17h37m56.376931524s) [seg_pos={0 0}, upload=18363]: Segment reached optimal threshold of 14 pieces.
Aug 9 11:03:34.418045510 (17h37m56.377142744s) [noise=true , address=104.36.82.22:4515 , piece_id=KNQOZZWUJOSUKCHQF5HKSOFVZKFVZVLKSBZMI2BZLPT7PMUBBASA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZZmn2sRUkYuNmHY3RY7skQwAYoVYth7rJ8DhmjEpzgE4Rtmxb): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418071259 (17h37m56.377168492s) [noise=true , address=104.36.82.59:4323 , piece_id=AMEOXBJH3FY7QEM4CUX5VVSERBMOFT6TCXC34RRODALRM3DQXGCQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HLr6Ha1ysWYbUJ8He7RofMFCz8qVuJMBFkfJgnTUVw1kmXckz): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418152158 (17h37m56.377249395s) [noise=true , address=104.36.82.10:4093 , piece_id=SKI2RIGZMKQPM55NO23Y7VW7L4J35CWUWREONMLKFV3JEARAW4DQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SsKS8mvgkHszRNtGrt5bktXsJpbdggkeY4tuiAUni6hZ3FnAw): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418262605 (17h37m56.377359853s) [noise=true , address=64.49.13.139:4474 , piece_id=RAJARTWAQ6HDQLUEFTKKBRG6LJCEZJU32AJGAZKFGYXDMBWFISRQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection; write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection
Aug 9 11:03:34.418285940 (17h37m56.377383186s) [seg_pos={0 0}, upload=18363]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 11:03:34.418389194 (17h37m56.377486439s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 11:03:34.418394613 (17h37m56.37749186s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 11:03:34.572765743 (17h37m56.531862993s) [upload=18363]: Done uploading segments...
Aug 9 11:03:34.572825239 (17h37m56.531922475s) [upload=18363]: Upload finished. err: <nil>
Duration: 2.412746842s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...................X.X.......X..........................X...] duration:
822.834427ms
FAIL (2025-08-09 11:11:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 11:09:57.816521532 (17h44m19.775618784s) [upload=18478]: Starting upload Aug 9 11:09:57.816586443 (17h44m19.775683697s) [upload=18478]: Done starting upload Aug 9 11:09:57.816681710 (17h44m19.775778949s) [upload=18478]: Uploading segments... Aug 9 11:09:57.816723382 (17h44m19.775820633s) [upload=18478]: Got next segment. Inline: true Aug 9 11:09:57.816729621 (17h44m19.775826867s) [upload=18478]: Waiting for error group managing segments... Aug 9 11:09:57.816789140 (17h44m19.775886389s) [upload=18478]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 11:09:57.816796364 (17h44m19.775893609s) [upload=18478]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 11:09:57.816801874 (17h44m19.775899123s) [upload=18478]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 11:09:57.905351526 (17h44m19.864448771s) [upload=18478]: Done uploading segments... Aug 9 11:09:57.905385518 (17h44m19.864482762s) [upload=18478]: Upload finished. err: metaclient: Too Many Requests
Duration: 822.8727ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........X...X....................................X..........] duration:
2.316740376s
FAIL (2025-08-09 11:10:54 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 30732f12d1c23351236b52fc46e02ade72cbcc01d371bae982a9652c8f3b11e2 != before 9273f3c49dd081d02a56c33fd79fa76e24e29e38ec5c47c511ef60d0bc1d3a49
======LOGS======
Aug 9 11:03:33.439875370 (17h37m55.398972606s) [upload=18363]: Starting upload
Aug 9 11:03:33.439969368 (17h37m55.399066621s) [upload=18363]: Done starting upload
Aug 9 11:03:33.440161922 (17h37m55.399259165s) [upload=18363]: Uploading segments...
Aug 9 11:03:33.440319250 (17h37m55.399416518s) [upload=18363]: Got next segment. Inline: false
Aug 9 11:03:33.440397655 (17h37m55.399494909s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 11:03:33.440404620 (17h37m55.399501867s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 11:03:33.639038109 (17h37m55.598135354s) [seg_pos={0 0}, upload=18363]: Begin upload segment...
Aug 9 11:03:33.639091904 (17h37m55.598189152s) [seg_pos={0 0}, upload=18363]: Done begin upload segment.
Aug 9 11:03:33.639134621 (17h37m55.598231853s) [noise=true , address=64.49.13.139:4474 , piece_id=RAJARTWAQ6HDQLUEFTKKBRG6LJCEZJU32AJGAZKFGYXDMBWFISRQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639141148 (17h37m55.598238399s) [noise=true , address=104.36.82.10:4093 , piece_id=SKI2RIGZMKQPM55NO23Y7VW7L4J35CWUWREONMLKFV3JEARAW4DQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639530470 (17h37m55.598627723s) [noise=true , address=104.36.82.16:4317 , piece_id=2UHP3NEII7IMQTF5QXEC3RAYWLDGKXLSMTYJJ53GPZVOPSDN3A6Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639607585 (17h37m55.598704833s) [noise=true , address=104.36.82.62:4437 , piece_id=6IHWL5KFKP7BFIOJBK22S54BCWDJLNU53NBL7YKMNJUUACKTBACQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639794168 (17h37m55.598891412s) [noise=true , address=104.36.82.36:4651 , piece_id=DKVNFKDGOV2JI25CG33WWVMYN6SOARCTVENJ4STBYYRCXVDHTWHQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640025622 (17h37m55.599122874s) [noise=true , address=104.36.82.44:4888 , piece_id=S6E6BTCSDGY2O3MPL2TZTU5DQCJ7ZM4G5KISVXZ757IDZBFVCQ4A, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640260031 (17h37m55.599357283s) [noise=true , address=104.36.82.59:4323 , piece_id=AMEOXBJH3FY7QEM4CUX5VVSERBMOFT6TCXC34RRODALRM3DQXGCQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640518584 (17h37m55.599615829s) [noise=true , address=104.36.82.5:4862 , piece_id=VBW5XUEAL34KRE2JRGQ4RDDBNYWFVDUBXBJ3QL2REGAPFXX3EHEA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640713081 (17h37m55.599810332s) [noise=true , address=104.36.82.38:4699 , piece_id=WYQRYJDHI5FVM2KTHLGBCDOBAOTYVWHQ6IDWI5GQ5MQUBHAUIFLA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641018305 (17h37m55.600115559s) [noise=true , address=104.36.82.49:4012 , piece_id=QWX44RJWWUGUI55TLSFF2JVTJJIRXHXDHB65X5WU4NVBPEFSBD5Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641109561 (17h37m55.600206809s) [noise=true , address=104.36.82.39:4759 , piece_id=UL2HMA7BUY7VLIOSHLIPKQM2ATWWDK2M6XXSGSA56HRGRUDWFLTA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641359433 (17h37m55.600456681s) [noise=true , address=104.36.82.46:4481 , piece_id=JGKZX2W3ZEELLRJ7PXRBXKEVDHI3MOUJHUQJWCLY5EXMTHATROWA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641638917 (17h37m55.600736168s) [noise=true , address=104.36.82.61:4398 , piece_id=PV2QIFCEUQAPFXDVGM7M6O6KHXBPCMLFFOTTI56KCN3QHBICTB6Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641656561 (17h37m55.600753806s) [noise=true , address=104.36.82.45:4916 , piece_id=6TY2WAMIDF6JEGXSINF6HJ6UZ4XW5RO2KCHIXUDKWTPNWPHSBGHA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641888735 (17h37m55.60098599s) [noise=true , address=104.36.82.22:4515 , piece_id=KNQOZZWUJOSUKCHQF5HKSOFVZKFVZVLKSBZMI2BZLPT7PMUBBASA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.642145267 (17h37m55.601242513s) [noise=true , address=104.36.82.37:4659 , piece_id=2HYQFY2DQOOVRU73DGQGERDTOCKX5PSCAAEXFIM2DXKO6COVUEEA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.642575454 (17h37m55.601672699s) [noise=true , address=104.36.82.16:4309 , piece_id=4GUOMDCITICDLOYZG32A3XCT42KYMGL3XQAZEQU26WCY32LEOOFQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.643109553 (17h37m55.602206812s) [noise=true , address=104.36.82.23:4449 , piece_id=GYBSPRZMW5DVWMHWOGU5TNS2FQ4O44NZXBM3PNKGMDGCWNIO4WNA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:34.225891854 (17h37m56.184989092s) [upload=18363]: Next returned nil segment
Aug 9 11:03:34.225941492 (17h37m56.185038737s) [upload=18363]: Waiting for error group managing segments...
Aug 9 11:03:34.396000323 (17h37m56.355097556s) [noise=true , address=104.36.82.62:4437 , piece_id=6IHWL5KFKP7BFIOJBK22S54BCWDJLNU53NBL7YKMNJUUACKTBACQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.396691127 (17h37m56.355788358s) [noise=true , address=104.36.82.44:4888 , piece_id=S6E6BTCSDGY2O3MPL2TZTU5DQCJ7ZM4G5KISVXZ757IDZBFVCQ4A, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.402779234 (17h37m56.361876483s) [noise=true , address=104.36.82.49:4012 , piece_id=QWX44RJWWUGUI55TLSFF2JVTJJIRXHXDHB65X5WU4NVBPEFSBD5Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.404422717 (17h37m56.363519973s) [noise=true , address=104.36.82.45:4916 , piece_id=6TY2WAMIDF6JEGXSINF6HJ6UZ4XW5RO2KCHIXUDKWTPNWPHSBGHA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.405872545 (17h37m56.364969793s) [noise=true , address=104.36.82.16:4317 , piece_id=2UHP3NEII7IMQTF5QXEC3RAYWLDGKXLSMTYJJ53GPZVOPSDN3A6Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.406694183 (17h37m56.365791421s) [noise=true , address=104.36.82.37:4659 , piece_id=2HYQFY2DQOOVRU73DGQGERDTOCKX5PSCAAEXFIM2DXKO6COVUEEA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.408468607 (17h37m56.367565845s) [noise=true , address=104.36.82.39:4759 , piece_id=UL2HMA7BUY7VLIOSHLIPKQM2ATWWDK2M6XXSGSA56HRGRUDWFLTA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.408705865 (17h37m56.367803099s) [noise=true , address=104.36.82.16:4309 , piece_id=4GUOMDCITICDLOYZG32A3XCT42KYMGL3XQAZEQU26WCY32LEOOFQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.409792379 (17h37m56.368889625s) [noise=true , address=104.36.82.5:4862 , piece_id=VBW5XUEAL34KRE2JRGQ4RDDBNYWFVDUBXBJ3QL2REGAPFXX3EHEA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.410123205 (17h37m56.369220457s) [noise=true , address=104.36.82.23:4449 , piece_id=GYBSPRZMW5DVWMHWOGU5TNS2FQ4O44NZXBM3PNKGMDGCWNIO4WNA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.410585122 (17h37m56.36968236s) [noise=true , address=104.36.82.38:4699 , piece_id=WYQRYJDHI5FVM2KTHLGBCDOBAOTYVWHQ6IDWI5GQ5MQUBHAUIFLA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.412570982 (17h37m56.371668232s) [noise=true , address=104.36.82.46:4481 , piece_id=JGKZX2W3ZEELLRJ7PXRBXKEVDHI3MOUJHUQJWCLY5EXMTHATROWA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417283695 (17h37m56.376380938s) [noise=true , address=104.36.82.36:4651 , piece_id=DKVNFKDGOV2JI25CG33WWVMYN6SOARCTVENJ4STBYYRCXVDHTWHQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417798285 (17h37m56.376895523s) [noise=true , address=104.36.82.61:4398 , piece_id=PV2QIFCEUQAPFXDVGM7M6O6KHXBPCMLFFOTTI56KCN3QHBICTB6Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417834276 (17h37m56.376931524s) [seg_pos={0 0}, upload=18363]: Segment reached optimal threshold of 14 pieces.
Aug 9 11:03:34.418045510 (17h37m56.377142744s) [noise=true , address=104.36.82.22:4515 , piece_id=KNQOZZWUJOSUKCHQF5HKSOFVZKFVZVLKSBZMI2BZLPT7PMUBBASA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZZmn2sRUkYuNmHY3RY7skQwAYoVYth7rJ8DhmjEpzgE4Rtmxb): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418071259 (17h37m56.377168492s) [noise=true , address=104.36.82.59:4323 , piece_id=AMEOXBJH3FY7QEM4CUX5VVSERBMOFT6TCXC34RRODALRM3DQXGCQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HLr6Ha1ysWYbUJ8He7RofMFCz8qVuJMBFkfJgnTUVw1kmXckz): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418152158 (17h37m56.377249395s) [noise=true , address=104.36.82.10:4093 , piece_id=SKI2RIGZMKQPM55NO23Y7VW7L4J35CWUWREONMLKFV3JEARAW4DQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SsKS8mvgkHszRNtGrt5bktXsJpbdggkeY4tuiAUni6hZ3FnAw): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418262605 (17h37m56.377359853s) [noise=true , address=64.49.13.139:4474 , piece_id=RAJARTWAQ6HDQLUEFTKKBRG6LJCEZJU32AJGAZKFGYXDMBWFISRQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection; write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection
Aug 9 11:03:34.418285940 (17h37m56.377383186s) [seg_pos={0 0}, upload=18363]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 11:03:34.418389194 (17h37m56.377486439s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 11:03:34.418394613 (17h37m56.37749186s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 11:03:34.572765743 (17h37m56.531862993s) [upload=18363]: Done uploading segments...
Aug 9 11:03:34.572825239 (17h37m56.531922475s) [upload=18363]: Upload finished. err: <nil>
Duration: 2.316776198s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [....................X.X.......X..........................X..] duration:
1.003813893s
FAIL (2025-08-09 11:10:46 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 11:09:57.816521532 (17h44m19.775618784s) [upload=18478]: Starting upload Aug 9 11:09:57.816586443 (17h44m19.775683697s) [upload=18478]: Done starting upload Aug 9 11:09:57.816681710 (17h44m19.775778949s) [upload=18478]: Uploading segments... Aug 9 11:09:57.816723382 (17h44m19.775820633s) [upload=18478]: Got next segment. Inline: true Aug 9 11:09:57.816729621 (17h44m19.775826867s) [upload=18478]: Waiting for error group managing segments... Aug 9 11:09:57.816789140 (17h44m19.775886389s) [upload=18478]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 11:09:57.816796364 (17h44m19.775893609s) [upload=18478]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 11:09:57.816801874 (17h44m19.775899123s) [upload=18478]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 11:09:57.905351526 (17h44m19.864448771s) [upload=18478]: Done uploading segments... Aug 9 11:09:57.905385518 (17h44m19.864482762s) [upload=18478]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.003843576s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.....................X.X.......X..........................X.] duration:
859.919002ms
FAIL (2025-08-09 11:10:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 11:09:57.816521532 (17h44m19.775618784s) [upload=18478]: Starting upload Aug 9 11:09:57.816586443 (17h44m19.775683697s) [upload=18478]: Done starting upload Aug 9 11:09:57.816681710 (17h44m19.775778949s) [upload=18478]: Uploading segments... Aug 9 11:09:57.816723382 (17h44m19.775820633s) [upload=18478]: Got next segment. Inline: true Aug 9 11:09:57.816729621 (17h44m19.775826867s) [upload=18478]: Waiting for error group managing segments... Aug 9 11:09:57.816789140 (17h44m19.775886389s) [upload=18478]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 11:09:57.816796364 (17h44m19.775893609s) [upload=18478]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 11:09:57.816801874 (17h44m19.775899123s) [upload=18478]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 11:09:57.905351526 (17h44m19.864448771s) [upload=18478]: Done uploading segments... Aug 9 11:09:57.905385518 (17h44m19.864482762s) [upload=18478]: Upload finished. err: metaclient: Too Many Requests
Duration: 859.952648ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [......................X.X.......X..........................X] duration:
361.035665ms
FAIL (2025-08-09 11:09:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 11:09:57.816521532 (17h44m19.775618784s) [upload=18478]: Starting upload Aug 9 11:09:57.816586443 (17h44m19.775683697s) [upload=18478]: Done starting upload Aug 9 11:09:57.816681710 (17h44m19.775778949s) [upload=18478]: Uploading segments... Aug 9 11:09:57.816723382 (17h44m19.775820633s) [upload=18478]: Got next segment. Inline: true Aug 9 11:09:57.816729621 (17h44m19.775826867s) [upload=18478]: Waiting for error group managing segments... Aug 9 11:09:57.816789140 (17h44m19.775886389s) [upload=18478]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 11:09:57.816796364 (17h44m19.775893609s) [upload=18478]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 9 11:09:57.816801874 (17h44m19.775899123s) [upload=18478]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 9 11:09:57.905351526 (17h44m19.864448771s) [upload=18478]: Done uploading segments... Aug 9 11:09:57.905385518 (17h44m19.864482762s) [upload=18478]: Upload finished. err: metaclient: Too Many Requests
Duration: 361.069528ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........X...X....................................X.........] duration:
2.430621232s
FAIL (2025-08-09 11:09:53 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 30732f12d1c23351236b52fc46e02ade72cbcc01d371bae982a9652c8f3b11e2 != before 9273f3c49dd081d02a56c33fd79fa76e24e29e38ec5c47c511ef60d0bc1d3a49
======LOGS======
Aug 9 11:03:33.439875370 (17h37m55.398972606s) [upload=18363]: Starting upload
Aug 9 11:03:33.439969368 (17h37m55.399066621s) [upload=18363]: Done starting upload
Aug 9 11:03:33.440161922 (17h37m55.399259165s) [upload=18363]: Uploading segments...
Aug 9 11:03:33.440319250 (17h37m55.399416518s) [upload=18363]: Got next segment. Inline: false
Aug 9 11:03:33.440397655 (17h37m55.399494909s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 11:03:33.440404620 (17h37m55.399501867s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 11:03:33.639038109 (17h37m55.598135354s) [seg_pos={0 0}, upload=18363]: Begin upload segment...
Aug 9 11:03:33.639091904 (17h37m55.598189152s) [seg_pos={0 0}, upload=18363]: Done begin upload segment.
Aug 9 11:03:33.639134621 (17h37m55.598231853s) [noise=true , address=64.49.13.139:4474 , piece_id=RAJARTWAQ6HDQLUEFTKKBRG6LJCEZJU32AJGAZKFGYXDMBWFISRQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639141148 (17h37m55.598238399s) [noise=true , address=104.36.82.10:4093 , piece_id=SKI2RIGZMKQPM55NO23Y7VW7L4J35CWUWREONMLKFV3JEARAW4DQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639530470 (17h37m55.598627723s) [noise=true , address=104.36.82.16:4317 , piece_id=2UHP3NEII7IMQTF5QXEC3RAYWLDGKXLSMTYJJ53GPZVOPSDN3A6Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639607585 (17h37m55.598704833s) [noise=true , address=104.36.82.62:4437 , piece_id=6IHWL5KFKP7BFIOJBK22S54BCWDJLNU53NBL7YKMNJUUACKTBACQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639794168 (17h37m55.598891412s) [noise=true , address=104.36.82.36:4651 , piece_id=DKVNFKDGOV2JI25CG33WWVMYN6SOARCTVENJ4STBYYRCXVDHTWHQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640025622 (17h37m55.599122874s) [noise=true , address=104.36.82.44:4888 , piece_id=S6E6BTCSDGY2O3MPL2TZTU5DQCJ7ZM4G5KISVXZ757IDZBFVCQ4A, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640260031 (17h37m55.599357283s) [noise=true , address=104.36.82.59:4323 , piece_id=AMEOXBJH3FY7QEM4CUX5VVSERBMOFT6TCXC34RRODALRM3DQXGCQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640518584 (17h37m55.599615829s) [noise=true , address=104.36.82.5:4862 , piece_id=VBW5XUEAL34KRE2JRGQ4RDDBNYWFVDUBXBJ3QL2REGAPFXX3EHEA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640713081 (17h37m55.599810332s) [noise=true , address=104.36.82.38:4699 , piece_id=WYQRYJDHI5FVM2KTHLGBCDOBAOTYVWHQ6IDWI5GQ5MQUBHAUIFLA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641018305 (17h37m55.600115559s) [noise=true , address=104.36.82.49:4012 , piece_id=QWX44RJWWUGUI55TLSFF2JVTJJIRXHXDHB65X5WU4NVBPEFSBD5Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641109561 (17h37m55.600206809s) [noise=true , address=104.36.82.39:4759 , piece_id=UL2HMA7BUY7VLIOSHLIPKQM2ATWWDK2M6XXSGSA56HRGRUDWFLTA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641359433 (17h37m55.600456681s) [noise=true , address=104.36.82.46:4481 , piece_id=JGKZX2W3ZEELLRJ7PXRBXKEVDHI3MOUJHUQJWCLY5EXMTHATROWA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641638917 (17h37m55.600736168s) [noise=true , address=104.36.82.61:4398 , piece_id=PV2QIFCEUQAPFXDVGM7M6O6KHXBPCMLFFOTTI56KCN3QHBICTB6Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641656561 (17h37m55.600753806s) [noise=true , address=104.36.82.45:4916 , piece_id=6TY2WAMIDF6JEGXSINF6HJ6UZ4XW5RO2KCHIXUDKWTPNWPHSBGHA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641888735 (17h37m55.60098599s) [noise=true , address=104.36.82.22:4515 , piece_id=KNQOZZWUJOSUKCHQF5HKSOFVZKFVZVLKSBZMI2BZLPT7PMUBBASA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.642145267 (17h37m55.601242513s) [noise=true , address=104.36.82.37:4659 , piece_id=2HYQFY2DQOOVRU73DGQGERDTOCKX5PSCAAEXFIM2DXKO6COVUEEA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.642575454 (17h37m55.601672699s) [noise=true , address=104.36.82.16:4309 , piece_id=4GUOMDCITICDLOYZG32A3XCT42KYMGL3XQAZEQU26WCY32LEOOFQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.643109553 (17h37m55.602206812s) [noise=true , address=104.36.82.23:4449 , piece_id=GYBSPRZMW5DVWMHWOGU5TNS2FQ4O44NZXBM3PNKGMDGCWNIO4WNA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:34.225891854 (17h37m56.184989092s) [upload=18363]: Next returned nil segment
Aug 9 11:03:34.225941492 (17h37m56.185038737s) [upload=18363]: Waiting for error group managing segments...
Aug 9 11:03:34.396000323 (17h37m56.355097556s) [noise=true , address=104.36.82.62:4437 , piece_id=6IHWL5KFKP7BFIOJBK22S54BCWDJLNU53NBL7YKMNJUUACKTBACQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.396691127 (17h37m56.355788358s) [noise=true , address=104.36.82.44:4888 , piece_id=S6E6BTCSDGY2O3MPL2TZTU5DQCJ7ZM4G5KISVXZ757IDZBFVCQ4A, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.402779234 (17h37m56.361876483s) [noise=true , address=104.36.82.49:4012 , piece_id=QWX44RJWWUGUI55TLSFF2JVTJJIRXHXDHB65X5WU4NVBPEFSBD5Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.404422717 (17h37m56.363519973s) [noise=true , address=104.36.82.45:4916 , piece_id=6TY2WAMIDF6JEGXSINF6HJ6UZ4XW5RO2KCHIXUDKWTPNWPHSBGHA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.405872545 (17h37m56.364969793s) [noise=true , address=104.36.82.16:4317 , piece_id=2UHP3NEII7IMQTF5QXEC3RAYWLDGKXLSMTYJJ53GPZVOPSDN3A6Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.406694183 (17h37m56.365791421s) [noise=true , address=104.36.82.37:4659 , piece_id=2HYQFY2DQOOVRU73DGQGERDTOCKX5PSCAAEXFIM2DXKO6COVUEEA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.408468607 (17h37m56.367565845s) [noise=true , address=104.36.82.39:4759 , piece_id=UL2HMA7BUY7VLIOSHLIPKQM2ATWWDK2M6XXSGSA56HRGRUDWFLTA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.408705865 (17h37m56.367803099s) [noise=true , address=104.36.82.16:4309 , piece_id=4GUOMDCITICDLOYZG32A3XCT42KYMGL3XQAZEQU26WCY32LEOOFQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.409792379 (17h37m56.368889625s) [noise=true , address=104.36.82.5:4862 , piece_id=VBW5XUEAL34KRE2JRGQ4RDDBNYWFVDUBXBJ3QL2REGAPFXX3EHEA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.410123205 (17h37m56.369220457s) [noise=true , address=104.36.82.23:4449 , piece_id=GYBSPRZMW5DVWMHWOGU5TNS2FQ4O44NZXBM3PNKGMDGCWNIO4WNA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.410585122 (17h37m56.36968236s) [noise=true , address=104.36.82.38:4699 , piece_id=WYQRYJDHI5FVM2KTHLGBCDOBAOTYVWHQ6IDWI5GQ5MQUBHAUIFLA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.412570982 (17h37m56.371668232s) [noise=true , address=104.36.82.46:4481 , piece_id=JGKZX2W3ZEELLRJ7PXRBXKEVDHI3MOUJHUQJWCLY5EXMTHATROWA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417283695 (17h37m56.376380938s) [noise=true , address=104.36.82.36:4651 , piece_id=DKVNFKDGOV2JI25CG33WWVMYN6SOARCTVENJ4STBYYRCXVDHTWHQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417798285 (17h37m56.376895523s) [noise=true , address=104.36.82.61:4398 , piece_id=PV2QIFCEUQAPFXDVGM7M6O6KHXBPCMLFFOTTI56KCN3QHBICTB6Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417834276 (17h37m56.376931524s) [seg_pos={0 0}, upload=18363]: Segment reached optimal threshold of 14 pieces.
Aug 9 11:03:34.418045510 (17h37m56.377142744s) [noise=true , address=104.36.82.22:4515 , piece_id=KNQOZZWUJOSUKCHQF5HKSOFVZKFVZVLKSBZMI2BZLPT7PMUBBASA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZZmn2sRUkYuNmHY3RY7skQwAYoVYth7rJ8DhmjEpzgE4Rtmxb): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418071259 (17h37m56.377168492s) [noise=true , address=104.36.82.59:4323 , piece_id=AMEOXBJH3FY7QEM4CUX5VVSERBMOFT6TCXC34RRODALRM3DQXGCQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HLr6Ha1ysWYbUJ8He7RofMFCz8qVuJMBFkfJgnTUVw1kmXckz): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418152158 (17h37m56.377249395s) [noise=true , address=104.36.82.10:4093 , piece_id=SKI2RIGZMKQPM55NO23Y7VW7L4J35CWUWREONMLKFV3JEARAW4DQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SsKS8mvgkHszRNtGrt5bktXsJpbdggkeY4tuiAUni6hZ3FnAw): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418262605 (17h37m56.377359853s) [noise=true , address=64.49.13.139:4474 , piece_id=RAJARTWAQ6HDQLUEFTKKBRG6LJCEZJU32AJGAZKFGYXDMBWFISRQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection; write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection
Aug 9 11:03:34.418285940 (17h37m56.377383186s) [seg_pos={0 0}, upload=18363]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 11:03:34.418389194 (17h37m56.377486439s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 11:03:34.418394613 (17h37m56.37749186s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 11:03:34.572765743 (17h37m56.531862993s) [upload=18363]: Done uploading segments...
Aug 9 11:03:34.572825239 (17h37m56.531922475s) [upload=18363]: Upload finished. err: <nil>
Duration: 2.430649364s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........X...X....................................X........] duration:
2.401477218s
FAIL (2025-08-09 11:08:57 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 30732f12d1c23351236b52fc46e02ade72cbcc01d371bae982a9652c8f3b11e2 != before 9273f3c49dd081d02a56c33fd79fa76e24e29e38ec5c47c511ef60d0bc1d3a49
======LOGS======
Aug 9 11:03:33.439875370 (17h37m55.398972606s) [upload=18363]: Starting upload
Aug 9 11:03:33.439969368 (17h37m55.399066621s) [upload=18363]: Done starting upload
Aug 9 11:03:33.440161922 (17h37m55.399259165s) [upload=18363]: Uploading segments...
Aug 9 11:03:33.440319250 (17h37m55.399416518s) [upload=18363]: Got next segment. Inline: false
Aug 9 11:03:33.440397655 (17h37m55.399494909s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 11:03:33.440404620 (17h37m55.399501867s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 11:03:33.639038109 (17h37m55.598135354s) [seg_pos={0 0}, upload=18363]: Begin upload segment...
Aug 9 11:03:33.639091904 (17h37m55.598189152s) [seg_pos={0 0}, upload=18363]: Done begin upload segment.
Aug 9 11:03:33.639134621 (17h37m55.598231853s) [noise=true , address=64.49.13.139:4474 , piece_id=RAJARTWAQ6HDQLUEFTKKBRG6LJCEZJU32AJGAZKFGYXDMBWFISRQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639141148 (17h37m55.598238399s) [noise=true , address=104.36.82.10:4093 , piece_id=SKI2RIGZMKQPM55NO23Y7VW7L4J35CWUWREONMLKFV3JEARAW4DQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639530470 (17h37m55.598627723s) [noise=true , address=104.36.82.16:4317 , piece_id=2UHP3NEII7IMQTF5QXEC3RAYWLDGKXLSMTYJJ53GPZVOPSDN3A6Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639607585 (17h37m55.598704833s) [noise=true , address=104.36.82.62:4437 , piece_id=6IHWL5KFKP7BFIOJBK22S54BCWDJLNU53NBL7YKMNJUUACKTBACQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639794168 (17h37m55.598891412s) [noise=true , address=104.36.82.36:4651 , piece_id=DKVNFKDGOV2JI25CG33WWVMYN6SOARCTVENJ4STBYYRCXVDHTWHQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640025622 (17h37m55.599122874s) [noise=true , address=104.36.82.44:4888 , piece_id=S6E6BTCSDGY2O3MPL2TZTU5DQCJ7ZM4G5KISVXZ757IDZBFVCQ4A, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640260031 (17h37m55.599357283s) [noise=true , address=104.36.82.59:4323 , piece_id=AMEOXBJH3FY7QEM4CUX5VVSERBMOFT6TCXC34RRODALRM3DQXGCQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640518584 (17h37m55.599615829s) [noise=true , address=104.36.82.5:4862 , piece_id=VBW5XUEAL34KRE2JRGQ4RDDBNYWFVDUBXBJ3QL2REGAPFXX3EHEA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640713081 (17h37m55.599810332s) [noise=true , address=104.36.82.38:4699 , piece_id=WYQRYJDHI5FVM2KTHLGBCDOBAOTYVWHQ6IDWI5GQ5MQUBHAUIFLA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641018305 (17h37m55.600115559s) [noise=true , address=104.36.82.49:4012 , piece_id=QWX44RJWWUGUI55TLSFF2JVTJJIRXHXDHB65X5WU4NVBPEFSBD5Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641109561 (17h37m55.600206809s) [noise=true , address=104.36.82.39:4759 , piece_id=UL2HMA7BUY7VLIOSHLIPKQM2ATWWDK2M6XXSGSA56HRGRUDWFLTA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641359433 (17h37m55.600456681s) [noise=true , address=104.36.82.46:4481 , piece_id=JGKZX2W3ZEELLRJ7PXRBXKEVDHI3MOUJHUQJWCLY5EXMTHATROWA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641638917 (17h37m55.600736168s) [noise=true , address=104.36.82.61:4398 , piece_id=PV2QIFCEUQAPFXDVGM7M6O6KHXBPCMLFFOTTI56KCN3QHBICTB6Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641656561 (17h37m55.600753806s) [noise=true , address=104.36.82.45:4916 , piece_id=6TY2WAMIDF6JEGXSINF6HJ6UZ4XW5RO2KCHIXUDKWTPNWPHSBGHA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641888735 (17h37m55.60098599s) [noise=true , address=104.36.82.22:4515 , piece_id=KNQOZZWUJOSUKCHQF5HKSOFVZKFVZVLKSBZMI2BZLPT7PMUBBASA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.642145267 (17h37m55.601242513s) [noise=true , address=104.36.82.37:4659 , piece_id=2HYQFY2DQOOVRU73DGQGERDTOCKX5PSCAAEXFIM2DXKO6COVUEEA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.642575454 (17h37m55.601672699s) [noise=true , address=104.36.82.16:4309 , piece_id=4GUOMDCITICDLOYZG32A3XCT42KYMGL3XQAZEQU26WCY32LEOOFQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.643109553 (17h37m55.602206812s) [noise=true , address=104.36.82.23:4449 , piece_id=GYBSPRZMW5DVWMHWOGU5TNS2FQ4O44NZXBM3PNKGMDGCWNIO4WNA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:34.225891854 (17h37m56.184989092s) [upload=18363]: Next returned nil segment
Aug 9 11:03:34.225941492 (17h37m56.185038737s) [upload=18363]: Waiting for error group managing segments...
Aug 9 11:03:34.396000323 (17h37m56.355097556s) [noise=true , address=104.36.82.62:4437 , piece_id=6IHWL5KFKP7BFIOJBK22S54BCWDJLNU53NBL7YKMNJUUACKTBACQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.396691127 (17h37m56.355788358s) [noise=true , address=104.36.82.44:4888 , piece_id=S6E6BTCSDGY2O3MPL2TZTU5DQCJ7ZM4G5KISVXZ757IDZBFVCQ4A, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.402779234 (17h37m56.361876483s) [noise=true , address=104.36.82.49:4012 , piece_id=QWX44RJWWUGUI55TLSFF2JVTJJIRXHXDHB65X5WU4NVBPEFSBD5Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.404422717 (17h37m56.363519973s) [noise=true , address=104.36.82.45:4916 , piece_id=6TY2WAMIDF6JEGXSINF6HJ6UZ4XW5RO2KCHIXUDKWTPNWPHSBGHA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.405872545 (17h37m56.364969793s) [noise=true , address=104.36.82.16:4317 , piece_id=2UHP3NEII7IMQTF5QXEC3RAYWLDGKXLSMTYJJ53GPZVOPSDN3A6Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.406694183 (17h37m56.365791421s) [noise=true , address=104.36.82.37:4659 , piece_id=2HYQFY2DQOOVRU73DGQGERDTOCKX5PSCAAEXFIM2DXKO6COVUEEA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.408468607 (17h37m56.367565845s) [noise=true , address=104.36.82.39:4759 , piece_id=UL2HMA7BUY7VLIOSHLIPKQM2ATWWDK2M6XXSGSA56HRGRUDWFLTA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.408705865 (17h37m56.367803099s) [noise=true , address=104.36.82.16:4309 , piece_id=4GUOMDCITICDLOYZG32A3XCT42KYMGL3XQAZEQU26WCY32LEOOFQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.409792379 (17h37m56.368889625s) [noise=true , address=104.36.82.5:4862 , piece_id=VBW5XUEAL34KRE2JRGQ4RDDBNYWFVDUBXBJ3QL2REGAPFXX3EHEA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.410123205 (17h37m56.369220457s) [noise=true , address=104.36.82.23:4449 , piece_id=GYBSPRZMW5DVWMHWOGU5TNS2FQ4O44NZXBM3PNKGMDGCWNIO4WNA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.410585122 (17h37m56.36968236s) [noise=true , address=104.36.82.38:4699 , piece_id=WYQRYJDHI5FVM2KTHLGBCDOBAOTYVWHQ6IDWI5GQ5MQUBHAUIFLA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.412570982 (17h37m56.371668232s) [noise=true , address=104.36.82.46:4481 , piece_id=JGKZX2W3ZEELLRJ7PXRBXKEVDHI3MOUJHUQJWCLY5EXMTHATROWA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417283695 (17h37m56.376380938s) [noise=true , address=104.36.82.36:4651 , piece_id=DKVNFKDGOV2JI25CG33WWVMYN6SOARCTVENJ4STBYYRCXVDHTWHQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417798285 (17h37m56.376895523s) [noise=true , address=104.36.82.61:4398 , piece_id=PV2QIFCEUQAPFXDVGM7M6O6KHXBPCMLFFOTTI56KCN3QHBICTB6Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417834276 (17h37m56.376931524s) [seg_pos={0 0}, upload=18363]: Segment reached optimal threshold of 14 pieces.
Aug 9 11:03:34.418045510 (17h37m56.377142744s) [noise=true , address=104.36.82.22:4515 , piece_id=KNQOZZWUJOSUKCHQF5HKSOFVZKFVZVLKSBZMI2BZLPT7PMUBBASA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZZmn2sRUkYuNmHY3RY7skQwAYoVYth7rJ8DhmjEpzgE4Rtmxb): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418071259 (17h37m56.377168492s) [noise=true , address=104.36.82.59:4323 , piece_id=AMEOXBJH3FY7QEM4CUX5VVSERBMOFT6TCXC34RRODALRM3DQXGCQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HLr6Ha1ysWYbUJ8He7RofMFCz8qVuJMBFkfJgnTUVw1kmXckz): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418152158 (17h37m56.377249395s) [noise=true , address=104.36.82.10:4093 , piece_id=SKI2RIGZMKQPM55NO23Y7VW7L4J35CWUWREONMLKFV3JEARAW4DQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SsKS8mvgkHszRNtGrt5bktXsJpbdggkeY4tuiAUni6hZ3FnAw): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418262605 (17h37m56.377359853s) [noise=true , address=64.49.13.139:4474 , piece_id=RAJARTWAQ6HDQLUEFTKKBRG6LJCEZJU32AJGAZKFGYXDMBWFISRQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection; write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection
Aug 9 11:03:34.418285940 (17h37m56.377383186s) [seg_pos={0 0}, upload=18363]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 11:03:34.418389194 (17h37m56.377486439s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 11:03:34.418394613 (17h37m56.37749186s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 11:03:34.572765743 (17h37m56.531862993s) [upload=18363]: Done uploading segments...
Aug 9 11:03:34.572825239 (17h37m56.531922475s) [upload=18363]: Upload finished. err: <nil>
Duration: 2.401511984s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......................X.X.......X..........................] duration:
837.811452ms
FAIL (2025-08-09 11:08:46 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 9 10:48:27.285285809 (17h22m49.244383054s) [upload=18101]: Starting upload
Aug 9 10:48:27.285335971 (17h22m49.24443321s) [upload=18101]: Done starting upload
Aug 9 10:48:27.285402380 (17h22m49.244499619s) [upload=18101]: Uploading segments...
Aug 9 10:48:27.285447241 (17h22m49.244544494s) [upload=18101]: Got next segment. Inline: true
Aug 9 10:48:27.285453082 (17h22m49.244550326s) [upload=18101]: Waiting for error group managing segments...
Aug 9 10:48:27.285494392 (17h22m49.244591637s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 10:48:27.285499846 (17h22m49.244597082s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 9 10:48:27.285509862 (17h22m49.244607098s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 10:48:27.479866989 (17h22m49.438964255s) [upload=18101]: Done uploading segments...
Aug 9 10:48:27.479887363 (17h22m49.438984602s) [upload=18101]: Upload finished. err: <nil>
Duration: 837.841771ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........X...X....................................X.......] duration:
2.398870796s
FAIL (2025-08-09 11:08:11 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 30732f12d1c23351236b52fc46e02ade72cbcc01d371bae982a9652c8f3b11e2 != before 9273f3c49dd081d02a56c33fd79fa76e24e29e38ec5c47c511ef60d0bc1d3a49
======LOGS======
Aug 9 11:03:33.439875370 (17h37m55.398972606s) [upload=18363]: Starting upload
Aug 9 11:03:33.439969368 (17h37m55.399066621s) [upload=18363]: Done starting upload
Aug 9 11:03:33.440161922 (17h37m55.399259165s) [upload=18363]: Uploading segments...
Aug 9 11:03:33.440319250 (17h37m55.399416518s) [upload=18363]: Got next segment. Inline: false
Aug 9 11:03:33.440397655 (17h37m55.399494909s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 11:03:33.440404620 (17h37m55.399501867s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 11:03:33.639038109 (17h37m55.598135354s) [seg_pos={0 0}, upload=18363]: Begin upload segment...
Aug 9 11:03:33.639091904 (17h37m55.598189152s) [seg_pos={0 0}, upload=18363]: Done begin upload segment.
Aug 9 11:03:33.639134621 (17h37m55.598231853s) [noise=true , address=64.49.13.139:4474 , piece_id=RAJARTWAQ6HDQLUEFTKKBRG6LJCEZJU32AJGAZKFGYXDMBWFISRQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639141148 (17h37m55.598238399s) [noise=true , address=104.36.82.10:4093 , piece_id=SKI2RIGZMKQPM55NO23Y7VW7L4J35CWUWREONMLKFV3JEARAW4DQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639530470 (17h37m55.598627723s) [noise=true , address=104.36.82.16:4317 , piece_id=2UHP3NEII7IMQTF5QXEC3RAYWLDGKXLSMTYJJ53GPZVOPSDN3A6Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639607585 (17h37m55.598704833s) [noise=true , address=104.36.82.62:4437 , piece_id=6IHWL5KFKP7BFIOJBK22S54BCWDJLNU53NBL7YKMNJUUACKTBACQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639794168 (17h37m55.598891412s) [noise=true , address=104.36.82.36:4651 , piece_id=DKVNFKDGOV2JI25CG33WWVMYN6SOARCTVENJ4STBYYRCXVDHTWHQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640025622 (17h37m55.599122874s) [noise=true , address=104.36.82.44:4888 , piece_id=S6E6BTCSDGY2O3MPL2TZTU5DQCJ7ZM4G5KISVXZ757IDZBFVCQ4A, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640260031 (17h37m55.599357283s) [noise=true , address=104.36.82.59:4323 , piece_id=AMEOXBJH3FY7QEM4CUX5VVSERBMOFT6TCXC34RRODALRM3DQXGCQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640518584 (17h37m55.599615829s) [noise=true , address=104.36.82.5:4862 , piece_id=VBW5XUEAL34KRE2JRGQ4RDDBNYWFVDUBXBJ3QL2REGAPFXX3EHEA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640713081 (17h37m55.599810332s) [noise=true , address=104.36.82.38:4699 , piece_id=WYQRYJDHI5FVM2KTHLGBCDOBAOTYVWHQ6IDWI5GQ5MQUBHAUIFLA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641018305 (17h37m55.600115559s) [noise=true , address=104.36.82.49:4012 , piece_id=QWX44RJWWUGUI55TLSFF2JVTJJIRXHXDHB65X5WU4NVBPEFSBD5Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641109561 (17h37m55.600206809s) [noise=true , address=104.36.82.39:4759 , piece_id=UL2HMA7BUY7VLIOSHLIPKQM2ATWWDK2M6XXSGSA56HRGRUDWFLTA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641359433 (17h37m55.600456681s) [noise=true , address=104.36.82.46:4481 , piece_id=JGKZX2W3ZEELLRJ7PXRBXKEVDHI3MOUJHUQJWCLY5EXMTHATROWA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641638917 (17h37m55.600736168s) [noise=true , address=104.36.82.61:4398 , piece_id=PV2QIFCEUQAPFXDVGM7M6O6KHXBPCMLFFOTTI56KCN3QHBICTB6Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641656561 (17h37m55.600753806s) [noise=true , address=104.36.82.45:4916 , piece_id=6TY2WAMIDF6JEGXSINF6HJ6UZ4XW5RO2KCHIXUDKWTPNWPHSBGHA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641888735 (17h37m55.60098599s) [noise=true , address=104.36.82.22:4515 , piece_id=KNQOZZWUJOSUKCHQF5HKSOFVZKFVZVLKSBZMI2BZLPT7PMUBBASA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.642145267 (17h37m55.601242513s) [noise=true , address=104.36.82.37:4659 , piece_id=2HYQFY2DQOOVRU73DGQGERDTOCKX5PSCAAEXFIM2DXKO6COVUEEA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.642575454 (17h37m55.601672699s) [noise=true , address=104.36.82.16:4309 , piece_id=4GUOMDCITICDLOYZG32A3XCT42KYMGL3XQAZEQU26WCY32LEOOFQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.643109553 (17h37m55.602206812s) [noise=true , address=104.36.82.23:4449 , piece_id=GYBSPRZMW5DVWMHWOGU5TNS2FQ4O44NZXBM3PNKGMDGCWNIO4WNA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:34.225891854 (17h37m56.184989092s) [upload=18363]: Next returned nil segment
Aug 9 11:03:34.225941492 (17h37m56.185038737s) [upload=18363]: Waiting for error group managing segments...
Aug 9 11:03:34.396000323 (17h37m56.355097556s) [noise=true , address=104.36.82.62:4437 , piece_id=6IHWL5KFKP7BFIOJBK22S54BCWDJLNU53NBL7YKMNJUUACKTBACQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.396691127 (17h37m56.355788358s) [noise=true , address=104.36.82.44:4888 , piece_id=S6E6BTCSDGY2O3MPL2TZTU5DQCJ7ZM4G5KISVXZ757IDZBFVCQ4A, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.402779234 (17h37m56.361876483s) [noise=true , address=104.36.82.49:4012 , piece_id=QWX44RJWWUGUI55TLSFF2JVTJJIRXHXDHB65X5WU4NVBPEFSBD5Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.404422717 (17h37m56.363519973s) [noise=true , address=104.36.82.45:4916 , piece_id=6TY2WAMIDF6JEGXSINF6HJ6UZ4XW5RO2KCHIXUDKWTPNWPHSBGHA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.405872545 (17h37m56.364969793s) [noise=true , address=104.36.82.16:4317 , piece_id=2UHP3NEII7IMQTF5QXEC3RAYWLDGKXLSMTYJJ53GPZVOPSDN3A6Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.406694183 (17h37m56.365791421s) [noise=true , address=104.36.82.37:4659 , piece_id=2HYQFY2DQOOVRU73DGQGERDTOCKX5PSCAAEXFIM2DXKO6COVUEEA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.408468607 (17h37m56.367565845s) [noise=true , address=104.36.82.39:4759 , piece_id=UL2HMA7BUY7VLIOSHLIPKQM2ATWWDK2M6XXSGSA56HRGRUDWFLTA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.408705865 (17h37m56.367803099s) [noise=true , address=104.36.82.16:4309 , piece_id=4GUOMDCITICDLOYZG32A3XCT42KYMGL3XQAZEQU26WCY32LEOOFQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.409792379 (17h37m56.368889625s) [noise=true , address=104.36.82.5:4862 , piece_id=VBW5XUEAL34KRE2JRGQ4RDDBNYWFVDUBXBJ3QL2REGAPFXX3EHEA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.410123205 (17h37m56.369220457s) [noise=true , address=104.36.82.23:4449 , piece_id=GYBSPRZMW5DVWMHWOGU5TNS2FQ4O44NZXBM3PNKGMDGCWNIO4WNA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.410585122 (17h37m56.36968236s) [noise=true , address=104.36.82.38:4699 , piece_id=WYQRYJDHI5FVM2KTHLGBCDOBAOTYVWHQ6IDWI5GQ5MQUBHAUIFLA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.412570982 (17h37m56.371668232s) [noise=true , address=104.36.82.46:4481 , piece_id=JGKZX2W3ZEELLRJ7PXRBXKEVDHI3MOUJHUQJWCLY5EXMTHATROWA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417283695 (17h37m56.376380938s) [noise=true , address=104.36.82.36:4651 , piece_id=DKVNFKDGOV2JI25CG33WWVMYN6SOARCTVENJ4STBYYRCXVDHTWHQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417798285 (17h37m56.376895523s) [noise=true , address=104.36.82.61:4398 , piece_id=PV2QIFCEUQAPFXDVGM7M6O6KHXBPCMLFFOTTI56KCN3QHBICTB6Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417834276 (17h37m56.376931524s) [seg_pos={0 0}, upload=18363]: Segment reached optimal threshold of 14 pieces.
Aug 9 11:03:34.418045510 (17h37m56.377142744s) [noise=true , address=104.36.82.22:4515 , piece_id=KNQOZZWUJOSUKCHQF5HKSOFVZKFVZVLKSBZMI2BZLPT7PMUBBASA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZZmn2sRUkYuNmHY3RY7skQwAYoVYth7rJ8DhmjEpzgE4Rtmxb): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418071259 (17h37m56.377168492s) [noise=true , address=104.36.82.59:4323 , piece_id=AMEOXBJH3FY7QEM4CUX5VVSERBMOFT6TCXC34RRODALRM3DQXGCQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HLr6Ha1ysWYbUJ8He7RofMFCz8qVuJMBFkfJgnTUVw1kmXckz): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418152158 (17h37m56.377249395s) [noise=true , address=104.36.82.10:4093 , piece_id=SKI2RIGZMKQPM55NO23Y7VW7L4J35CWUWREONMLKFV3JEARAW4DQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SsKS8mvgkHszRNtGrt5bktXsJpbdggkeY4tuiAUni6hZ3FnAw): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418262605 (17h37m56.377359853s) [noise=true , address=64.49.13.139:4474 , piece_id=RAJARTWAQ6HDQLUEFTKKBRG6LJCEZJU32AJGAZKFGYXDMBWFISRQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection; write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection
Aug 9 11:03:34.418285940 (17h37m56.377383186s) [seg_pos={0 0}, upload=18363]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 11:03:34.418389194 (17h37m56.377486439s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 11:03:34.418394613 (17h37m56.37749186s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 11:03:34.572765743 (17h37m56.531862993s) [upload=18363]: Done uploading segments...
Aug 9 11:03:34.572825239 (17h37m56.531922475s) [upload=18363]: Upload finished. err: <nil>
Duration: 2.398906081s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........................X.X.......X.........................] duration:
959.945348ms
FAIL (2025-08-09 11:07:57 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 9 10:48:27.285285809 (17h22m49.244383054s) [upload=18101]: Starting upload
Aug 9 10:48:27.285335971 (17h22m49.24443321s) [upload=18101]: Done starting upload
Aug 9 10:48:27.285402380 (17h22m49.244499619s) [upload=18101]: Uploading segments...
Aug 9 10:48:27.285447241 (17h22m49.244544494s) [upload=18101]: Got next segment. Inline: true
Aug 9 10:48:27.285453082 (17h22m49.244550326s) [upload=18101]: Waiting for error group managing segments...
Aug 9 10:48:27.285494392 (17h22m49.244591637s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 10:48:27.285499846 (17h22m49.244597082s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 9 10:48:27.285509862 (17h22m49.244607098s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 10:48:27.479866989 (17h22m49.438964255s) [upload=18101]: Done uploading segments...
Aug 9 10:48:27.479887363 (17h22m49.438984602s) [upload=18101]: Upload finished. err: <nil>
Duration: 959.990574ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [............X...X....................................X......] duration:
2.351057585s
FAIL (2025-08-09 11:07:48 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 30732f12d1c23351236b52fc46e02ade72cbcc01d371bae982a9652c8f3b11e2 != before 9273f3c49dd081d02a56c33fd79fa76e24e29e38ec5c47c511ef60d0bc1d3a49
======LOGS======
Aug 9 11:03:33.439875370 (17h37m55.398972606s) [upload=18363]: Starting upload
Aug 9 11:03:33.439969368 (17h37m55.399066621s) [upload=18363]: Done starting upload
Aug 9 11:03:33.440161922 (17h37m55.399259165s) [upload=18363]: Uploading segments...
Aug 9 11:03:33.440319250 (17h37m55.399416518s) [upload=18363]: Got next segment. Inline: false
Aug 9 11:03:33.440397655 (17h37m55.399494909s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 11:03:33.440404620 (17h37m55.399501867s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 11:03:33.639038109 (17h37m55.598135354s) [seg_pos={0 0}, upload=18363]: Begin upload segment...
Aug 9 11:03:33.639091904 (17h37m55.598189152s) [seg_pos={0 0}, upload=18363]: Done begin upload segment.
Aug 9 11:03:33.639134621 (17h37m55.598231853s) [noise=true , address=64.49.13.139:4474 , piece_id=RAJARTWAQ6HDQLUEFTKKBRG6LJCEZJU32AJGAZKFGYXDMBWFISRQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639141148 (17h37m55.598238399s) [noise=true , address=104.36.82.10:4093 , piece_id=SKI2RIGZMKQPM55NO23Y7VW7L4J35CWUWREONMLKFV3JEARAW4DQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639530470 (17h37m55.598627723s) [noise=true , address=104.36.82.16:4317 , piece_id=2UHP3NEII7IMQTF5QXEC3RAYWLDGKXLSMTYJJ53GPZVOPSDN3A6Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639607585 (17h37m55.598704833s) [noise=true , address=104.36.82.62:4437 , piece_id=6IHWL5KFKP7BFIOJBK22S54BCWDJLNU53NBL7YKMNJUUACKTBACQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639794168 (17h37m55.598891412s) [noise=true , address=104.36.82.36:4651 , piece_id=DKVNFKDGOV2JI25CG33WWVMYN6SOARCTVENJ4STBYYRCXVDHTWHQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640025622 (17h37m55.599122874s) [noise=true , address=104.36.82.44:4888 , piece_id=S6E6BTCSDGY2O3MPL2TZTU5DQCJ7ZM4G5KISVXZ757IDZBFVCQ4A, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640260031 (17h37m55.599357283s) [noise=true , address=104.36.82.59:4323 , piece_id=AMEOXBJH3FY7QEM4CUX5VVSERBMOFT6TCXC34RRODALRM3DQXGCQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640518584 (17h37m55.599615829s) [noise=true , address=104.36.82.5:4862 , piece_id=VBW5XUEAL34KRE2JRGQ4RDDBNYWFVDUBXBJ3QL2REGAPFXX3EHEA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640713081 (17h37m55.599810332s) [noise=true , address=104.36.82.38:4699 , piece_id=WYQRYJDHI5FVM2KTHLGBCDOBAOTYVWHQ6IDWI5GQ5MQUBHAUIFLA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641018305 (17h37m55.600115559s) [noise=true , address=104.36.82.49:4012 , piece_id=QWX44RJWWUGUI55TLSFF2JVTJJIRXHXDHB65X5WU4NVBPEFSBD5Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641109561 (17h37m55.600206809s) [noise=true , address=104.36.82.39:4759 , piece_id=UL2HMA7BUY7VLIOSHLIPKQM2ATWWDK2M6XXSGSA56HRGRUDWFLTA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641359433 (17h37m55.600456681s) [noise=true , address=104.36.82.46:4481 , piece_id=JGKZX2W3ZEELLRJ7PXRBXKEVDHI3MOUJHUQJWCLY5EXMTHATROWA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641638917 (17h37m55.600736168s) [noise=true , address=104.36.82.61:4398 , piece_id=PV2QIFCEUQAPFXDVGM7M6O6KHXBPCMLFFOTTI56KCN3QHBICTB6Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641656561 (17h37m55.600753806s) [noise=true , address=104.36.82.45:4916 , piece_id=6TY2WAMIDF6JEGXSINF6HJ6UZ4XW5RO2KCHIXUDKWTPNWPHSBGHA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641888735 (17h37m55.60098599s) [noise=true , address=104.36.82.22:4515 , piece_id=KNQOZZWUJOSUKCHQF5HKSOFVZKFVZVLKSBZMI2BZLPT7PMUBBASA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.642145267 (17h37m55.601242513s) [noise=true , address=104.36.82.37:4659 , piece_id=2HYQFY2DQOOVRU73DGQGERDTOCKX5PSCAAEXFIM2DXKO6COVUEEA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.642575454 (17h37m55.601672699s) [noise=true , address=104.36.82.16:4309 , piece_id=4GUOMDCITICDLOYZG32A3XCT42KYMGL3XQAZEQU26WCY32LEOOFQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.643109553 (17h37m55.602206812s) [noise=true , address=104.36.82.23:4449 , piece_id=GYBSPRZMW5DVWMHWOGU5TNS2FQ4O44NZXBM3PNKGMDGCWNIO4WNA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:34.225891854 (17h37m56.184989092s) [upload=18363]: Next returned nil segment
Aug 9 11:03:34.225941492 (17h37m56.185038737s) [upload=18363]: Waiting for error group managing segments...
Aug 9 11:03:34.396000323 (17h37m56.355097556s) [noise=true , address=104.36.82.62:4437 , piece_id=6IHWL5KFKP7BFIOJBK22S54BCWDJLNU53NBL7YKMNJUUACKTBACQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.396691127 (17h37m56.355788358s) [noise=true , address=104.36.82.44:4888 , piece_id=S6E6BTCSDGY2O3MPL2TZTU5DQCJ7ZM4G5KISVXZ757IDZBFVCQ4A, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.402779234 (17h37m56.361876483s) [noise=true , address=104.36.82.49:4012 , piece_id=QWX44RJWWUGUI55TLSFF2JVTJJIRXHXDHB65X5WU4NVBPEFSBD5Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.404422717 (17h37m56.363519973s) [noise=true , address=104.36.82.45:4916 , piece_id=6TY2WAMIDF6JEGXSINF6HJ6UZ4XW5RO2KCHIXUDKWTPNWPHSBGHA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.405872545 (17h37m56.364969793s) [noise=true , address=104.36.82.16:4317 , piece_id=2UHP3NEII7IMQTF5QXEC3RAYWLDGKXLSMTYJJ53GPZVOPSDN3A6Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.406694183 (17h37m56.365791421s) [noise=true , address=104.36.82.37:4659 , piece_id=2HYQFY2DQOOVRU73DGQGERDTOCKX5PSCAAEXFIM2DXKO6COVUEEA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.408468607 (17h37m56.367565845s) [noise=true , address=104.36.82.39:4759 , piece_id=UL2HMA7BUY7VLIOSHLIPKQM2ATWWDK2M6XXSGSA56HRGRUDWFLTA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.408705865 (17h37m56.367803099s) [noise=true , address=104.36.82.16:4309 , piece_id=4GUOMDCITICDLOYZG32A3XCT42KYMGL3XQAZEQU26WCY32LEOOFQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.409792379 (17h37m56.368889625s) [noise=true , address=104.36.82.5:4862 , piece_id=VBW5XUEAL34KRE2JRGQ4RDDBNYWFVDUBXBJ3QL2REGAPFXX3EHEA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.410123205 (17h37m56.369220457s) [noise=true , address=104.36.82.23:4449 , piece_id=GYBSPRZMW5DVWMHWOGU5TNS2FQ4O44NZXBM3PNKGMDGCWNIO4WNA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.410585122 (17h37m56.36968236s) [noise=true , address=104.36.82.38:4699 , piece_id=WYQRYJDHI5FVM2KTHLGBCDOBAOTYVWHQ6IDWI5GQ5MQUBHAUIFLA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.412570982 (17h37m56.371668232s) [noise=true , address=104.36.82.46:4481 , piece_id=JGKZX2W3ZEELLRJ7PXRBXKEVDHI3MOUJHUQJWCLY5EXMTHATROWA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417283695 (17h37m56.376380938s) [noise=true , address=104.36.82.36:4651 , piece_id=DKVNFKDGOV2JI25CG33WWVMYN6SOARCTVENJ4STBYYRCXVDHTWHQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417798285 (17h37m56.376895523s) [noise=true , address=104.36.82.61:4398 , piece_id=PV2QIFCEUQAPFXDVGM7M6O6KHXBPCMLFFOTTI56KCN3QHBICTB6Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417834276 (17h37m56.376931524s) [seg_pos={0 0}, upload=18363]: Segment reached optimal threshold of 14 pieces.
Aug 9 11:03:34.418045510 (17h37m56.377142744s) [noise=true , address=104.36.82.22:4515 , piece_id=KNQOZZWUJOSUKCHQF5HKSOFVZKFVZVLKSBZMI2BZLPT7PMUBBASA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZZmn2sRUkYuNmHY3RY7skQwAYoVYth7rJ8DhmjEpzgE4Rtmxb): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418071259 (17h37m56.377168492s) [noise=true , address=104.36.82.59:4323 , piece_id=AMEOXBJH3FY7QEM4CUX5VVSERBMOFT6TCXC34RRODALRM3DQXGCQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HLr6Ha1ysWYbUJ8He7RofMFCz8qVuJMBFkfJgnTUVw1kmXckz): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418152158 (17h37m56.377249395s) [noise=true , address=104.36.82.10:4093 , piece_id=SKI2RIGZMKQPM55NO23Y7VW7L4J35CWUWREONMLKFV3JEARAW4DQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SsKS8mvgkHszRNtGrt5bktXsJpbdggkeY4tuiAUni6hZ3FnAw): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418262605 (17h37m56.377359853s) [noise=true , address=64.49.13.139:4474 , piece_id=RAJARTWAQ6HDQLUEFTKKBRG6LJCEZJU32AJGAZKFGYXDMBWFISRQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection; write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection
Aug 9 11:03:34.418285940 (17h37m56.377383186s) [seg_pos={0 0}, upload=18363]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 11:03:34.418389194 (17h37m56.377486439s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 11:03:34.418394613 (17h37m56.37749186s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 11:03:34.572765743 (17h37m56.531862993s) [upload=18363]: Done uploading segments...
Aug 9 11:03:34.572825239 (17h37m56.531922475s) [upload=18363]: Upload finished. err: <nil>
Duration: 2.351083633s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........................X.X.......X........................] duration:
830.775296ms
FAIL (2025-08-09 11:07:24 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 9 10:48:27.285285809 (17h22m49.244383054s) [upload=18101]: Starting upload
Aug 9 10:48:27.285335971 (17h22m49.24443321s) [upload=18101]: Done starting upload
Aug 9 10:48:27.285402380 (17h22m49.244499619s) [upload=18101]: Uploading segments...
Aug 9 10:48:27.285447241 (17h22m49.244544494s) [upload=18101]: Got next segment. Inline: true
Aug 9 10:48:27.285453082 (17h22m49.244550326s) [upload=18101]: Waiting for error group managing segments...
Aug 9 10:48:27.285494392 (17h22m49.244591637s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 10:48:27.285499846 (17h22m49.244597082s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 9 10:48:27.285509862 (17h22m49.244607098s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 10:48:27.479866989 (17h22m49.438964255s) [upload=18101]: Done uploading segments...
Aug 9 10:48:27.479887363 (17h22m49.438984602s) [upload=18101]: Upload finished. err: <nil>
Duration: 830.874864ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............X...X....................................X.....] duration:
2.325342676s
FAIL (2025-08-09 11:07:20 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 30732f12d1c23351236b52fc46e02ade72cbcc01d371bae982a9652c8f3b11e2 != before 9273f3c49dd081d02a56c33fd79fa76e24e29e38ec5c47c511ef60d0bc1d3a49
======LOGS======
Aug 9 11:03:33.439875370 (17h37m55.398972606s) [upload=18363]: Starting upload
Aug 9 11:03:33.439969368 (17h37m55.399066621s) [upload=18363]: Done starting upload
Aug 9 11:03:33.440161922 (17h37m55.399259165s) [upload=18363]: Uploading segments...
Aug 9 11:03:33.440319250 (17h37m55.399416518s) [upload=18363]: Got next segment. Inline: false
Aug 9 11:03:33.440397655 (17h37m55.399494909s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 11:03:33.440404620 (17h37m55.399501867s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 11:03:33.639038109 (17h37m55.598135354s) [seg_pos={0 0}, upload=18363]: Begin upload segment...
Aug 9 11:03:33.639091904 (17h37m55.598189152s) [seg_pos={0 0}, upload=18363]: Done begin upload segment.
Aug 9 11:03:33.639134621 (17h37m55.598231853s) [noise=true , address=64.49.13.139:4474 , piece_id=RAJARTWAQ6HDQLUEFTKKBRG6LJCEZJU32AJGAZKFGYXDMBWFISRQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639141148 (17h37m55.598238399s) [noise=true , address=104.36.82.10:4093 , piece_id=SKI2RIGZMKQPM55NO23Y7VW7L4J35CWUWREONMLKFV3JEARAW4DQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639530470 (17h37m55.598627723s) [noise=true , address=104.36.82.16:4317 , piece_id=2UHP3NEII7IMQTF5QXEC3RAYWLDGKXLSMTYJJ53GPZVOPSDN3A6Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639607585 (17h37m55.598704833s) [noise=true , address=104.36.82.62:4437 , piece_id=6IHWL5KFKP7BFIOJBK22S54BCWDJLNU53NBL7YKMNJUUACKTBACQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639794168 (17h37m55.598891412s) [noise=true , address=104.36.82.36:4651 , piece_id=DKVNFKDGOV2JI25CG33WWVMYN6SOARCTVENJ4STBYYRCXVDHTWHQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640025622 (17h37m55.599122874s) [noise=true , address=104.36.82.44:4888 , piece_id=S6E6BTCSDGY2O3MPL2TZTU5DQCJ7ZM4G5KISVXZ757IDZBFVCQ4A, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640260031 (17h37m55.599357283s) [noise=true , address=104.36.82.59:4323 , piece_id=AMEOXBJH3FY7QEM4CUX5VVSERBMOFT6TCXC34RRODALRM3DQXGCQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640518584 (17h37m55.599615829s) [noise=true , address=104.36.82.5:4862 , piece_id=VBW5XUEAL34KRE2JRGQ4RDDBNYWFVDUBXBJ3QL2REGAPFXX3EHEA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640713081 (17h37m55.599810332s) [noise=true , address=104.36.82.38:4699 , piece_id=WYQRYJDHI5FVM2KTHLGBCDOBAOTYVWHQ6IDWI5GQ5MQUBHAUIFLA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641018305 (17h37m55.600115559s) [noise=true , address=104.36.82.49:4012 , piece_id=QWX44RJWWUGUI55TLSFF2JVTJJIRXHXDHB65X5WU4NVBPEFSBD5Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641109561 (17h37m55.600206809s) [noise=true , address=104.36.82.39:4759 , piece_id=UL2HMA7BUY7VLIOSHLIPKQM2ATWWDK2M6XXSGSA56HRGRUDWFLTA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641359433 (17h37m55.600456681s) [noise=true , address=104.36.82.46:4481 , piece_id=JGKZX2W3ZEELLRJ7PXRBXKEVDHI3MOUJHUQJWCLY5EXMTHATROWA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641638917 (17h37m55.600736168s) [noise=true , address=104.36.82.61:4398 , piece_id=PV2QIFCEUQAPFXDVGM7M6O6KHXBPCMLFFOTTI56KCN3QHBICTB6Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641656561 (17h37m55.600753806s) [noise=true , address=104.36.82.45:4916 , piece_id=6TY2WAMIDF6JEGXSINF6HJ6UZ4XW5RO2KCHIXUDKWTPNWPHSBGHA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641888735 (17h37m55.60098599s) [noise=true , address=104.36.82.22:4515 , piece_id=KNQOZZWUJOSUKCHQF5HKSOFVZKFVZVLKSBZMI2BZLPT7PMUBBASA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.642145267 (17h37m55.601242513s) [noise=true , address=104.36.82.37:4659 , piece_id=2HYQFY2DQOOVRU73DGQGERDTOCKX5PSCAAEXFIM2DXKO6COVUEEA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.642575454 (17h37m55.601672699s) [noise=true , address=104.36.82.16:4309 , piece_id=4GUOMDCITICDLOYZG32A3XCT42KYMGL3XQAZEQU26WCY32LEOOFQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.643109553 (17h37m55.602206812s) [noise=true , address=104.36.82.23:4449 , piece_id=GYBSPRZMW5DVWMHWOGU5TNS2FQ4O44NZXBM3PNKGMDGCWNIO4WNA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:34.225891854 (17h37m56.184989092s) [upload=18363]: Next returned nil segment
Aug 9 11:03:34.225941492 (17h37m56.185038737s) [upload=18363]: Waiting for error group managing segments...
Aug 9 11:03:34.396000323 (17h37m56.355097556s) [noise=true , address=104.36.82.62:4437 , piece_id=6IHWL5KFKP7BFIOJBK22S54BCWDJLNU53NBL7YKMNJUUACKTBACQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.396691127 (17h37m56.355788358s) [noise=true , address=104.36.82.44:4888 , piece_id=S6E6BTCSDGY2O3MPL2TZTU5DQCJ7ZM4G5KISVXZ757IDZBFVCQ4A, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.402779234 (17h37m56.361876483s) [noise=true , address=104.36.82.49:4012 , piece_id=QWX44RJWWUGUI55TLSFF2JVTJJIRXHXDHB65X5WU4NVBPEFSBD5Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.404422717 (17h37m56.363519973s) [noise=true , address=104.36.82.45:4916 , piece_id=6TY2WAMIDF6JEGXSINF6HJ6UZ4XW5RO2KCHIXUDKWTPNWPHSBGHA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.405872545 (17h37m56.364969793s) [noise=true , address=104.36.82.16:4317 , piece_id=2UHP3NEII7IMQTF5QXEC3RAYWLDGKXLSMTYJJ53GPZVOPSDN3A6Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.406694183 (17h37m56.365791421s) [noise=true , address=104.36.82.37:4659 , piece_id=2HYQFY2DQOOVRU73DGQGERDTOCKX5PSCAAEXFIM2DXKO6COVUEEA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.408468607 (17h37m56.367565845s) [noise=true , address=104.36.82.39:4759 , piece_id=UL2HMA7BUY7VLIOSHLIPKQM2ATWWDK2M6XXSGSA56HRGRUDWFLTA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.408705865 (17h37m56.367803099s) [noise=true , address=104.36.82.16:4309 , piece_id=4GUOMDCITICDLOYZG32A3XCT42KYMGL3XQAZEQU26WCY32LEOOFQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.409792379 (17h37m56.368889625s) [noise=true , address=104.36.82.5:4862 , piece_id=VBW5XUEAL34KRE2JRGQ4RDDBNYWFVDUBXBJ3QL2REGAPFXX3EHEA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.410123205 (17h37m56.369220457s) [noise=true , address=104.36.82.23:4449 , piece_id=GYBSPRZMW5DVWMHWOGU5TNS2FQ4O44NZXBM3PNKGMDGCWNIO4WNA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.410585122 (17h37m56.36968236s) [noise=true , address=104.36.82.38:4699 , piece_id=WYQRYJDHI5FVM2KTHLGBCDOBAOTYVWHQ6IDWI5GQ5MQUBHAUIFLA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.412570982 (17h37m56.371668232s) [noise=true , address=104.36.82.46:4481 , piece_id=JGKZX2W3ZEELLRJ7PXRBXKEVDHI3MOUJHUQJWCLY5EXMTHATROWA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417283695 (17h37m56.376380938s) [noise=true , address=104.36.82.36:4651 , piece_id=DKVNFKDGOV2JI25CG33WWVMYN6SOARCTVENJ4STBYYRCXVDHTWHQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417798285 (17h37m56.376895523s) [noise=true , address=104.36.82.61:4398 , piece_id=PV2QIFCEUQAPFXDVGM7M6O6KHXBPCMLFFOTTI56KCN3QHBICTB6Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417834276 (17h37m56.376931524s) [seg_pos={0 0}, upload=18363]: Segment reached optimal threshold of 14 pieces.
Aug 9 11:03:34.418045510 (17h37m56.377142744s) [noise=true , address=104.36.82.22:4515 , piece_id=KNQOZZWUJOSUKCHQF5HKSOFVZKFVZVLKSBZMI2BZLPT7PMUBBASA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZZmn2sRUkYuNmHY3RY7skQwAYoVYth7rJ8DhmjEpzgE4Rtmxb): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418071259 (17h37m56.377168492s) [noise=true , address=104.36.82.59:4323 , piece_id=AMEOXBJH3FY7QEM4CUX5VVSERBMOFT6TCXC34RRODALRM3DQXGCQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HLr6Ha1ysWYbUJ8He7RofMFCz8qVuJMBFkfJgnTUVw1kmXckz): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418152158 (17h37m56.377249395s) [noise=true , address=104.36.82.10:4093 , piece_id=SKI2RIGZMKQPM55NO23Y7VW7L4J35CWUWREONMLKFV3JEARAW4DQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SsKS8mvgkHszRNtGrt5bktXsJpbdggkeY4tuiAUni6hZ3FnAw): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418262605 (17h37m56.377359853s) [noise=true , address=64.49.13.139:4474 , piece_id=RAJARTWAQ6HDQLUEFTKKBRG6LJCEZJU32AJGAZKFGYXDMBWFISRQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection; write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection
Aug 9 11:03:34.418285940 (17h37m56.377383186s) [seg_pos={0 0}, upload=18363]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 11:03:34.418389194 (17h37m56.377486439s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 11:03:34.418394613 (17h37m56.37749186s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 11:03:34.572765743 (17h37m56.531862993s) [upload=18363]: Done uploading segments...
Aug 9 11:03:34.572825239 (17h37m56.531922475s) [upload=18363]: Upload finished. err: <nil>
Duration: 2.325378355s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............X...X....................................X....] duration:
2.342487019s
FAIL (2025-08-09 11:06:33 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 30732f12d1c23351236b52fc46e02ade72cbcc01d371bae982a9652c8f3b11e2 != before 9273f3c49dd081d02a56c33fd79fa76e24e29e38ec5c47c511ef60d0bc1d3a49
======LOGS======
Aug 9 11:03:33.439875370 (17h37m55.398972606s) [upload=18363]: Starting upload
Aug 9 11:03:33.439969368 (17h37m55.399066621s) [upload=18363]: Done starting upload
Aug 9 11:03:33.440161922 (17h37m55.399259165s) [upload=18363]: Uploading segments...
Aug 9 11:03:33.440319250 (17h37m55.399416518s) [upload=18363]: Got next segment. Inline: false
Aug 9 11:03:33.440397655 (17h37m55.399494909s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 11:03:33.440404620 (17h37m55.399501867s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 11:03:33.639038109 (17h37m55.598135354s) [seg_pos={0 0}, upload=18363]: Begin upload segment...
Aug 9 11:03:33.639091904 (17h37m55.598189152s) [seg_pos={0 0}, upload=18363]: Done begin upload segment.
Aug 9 11:03:33.639134621 (17h37m55.598231853s) [noise=true , address=64.49.13.139:4474 , piece_id=RAJARTWAQ6HDQLUEFTKKBRG6LJCEZJU32AJGAZKFGYXDMBWFISRQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639141148 (17h37m55.598238399s) [noise=true , address=104.36.82.10:4093 , piece_id=SKI2RIGZMKQPM55NO23Y7VW7L4J35CWUWREONMLKFV3JEARAW4DQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639530470 (17h37m55.598627723s) [noise=true , address=104.36.82.16:4317 , piece_id=2UHP3NEII7IMQTF5QXEC3RAYWLDGKXLSMTYJJ53GPZVOPSDN3A6Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639607585 (17h37m55.598704833s) [noise=true , address=104.36.82.62:4437 , piece_id=6IHWL5KFKP7BFIOJBK22S54BCWDJLNU53NBL7YKMNJUUACKTBACQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639794168 (17h37m55.598891412s) [noise=true , address=104.36.82.36:4651 , piece_id=DKVNFKDGOV2JI25CG33WWVMYN6SOARCTVENJ4STBYYRCXVDHTWHQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640025622 (17h37m55.599122874s) [noise=true , address=104.36.82.44:4888 , piece_id=S6E6BTCSDGY2O3MPL2TZTU5DQCJ7ZM4G5KISVXZ757IDZBFVCQ4A, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640260031 (17h37m55.599357283s) [noise=true , address=104.36.82.59:4323 , piece_id=AMEOXBJH3FY7QEM4CUX5VVSERBMOFT6TCXC34RRODALRM3DQXGCQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640518584 (17h37m55.599615829s) [noise=true , address=104.36.82.5:4862 , piece_id=VBW5XUEAL34KRE2JRGQ4RDDBNYWFVDUBXBJ3QL2REGAPFXX3EHEA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640713081 (17h37m55.599810332s) [noise=true , address=104.36.82.38:4699 , piece_id=WYQRYJDHI5FVM2KTHLGBCDOBAOTYVWHQ6IDWI5GQ5MQUBHAUIFLA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641018305 (17h37m55.600115559s) [noise=true , address=104.36.82.49:4012 , piece_id=QWX44RJWWUGUI55TLSFF2JVTJJIRXHXDHB65X5WU4NVBPEFSBD5Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641109561 (17h37m55.600206809s) [noise=true , address=104.36.82.39:4759 , piece_id=UL2HMA7BUY7VLIOSHLIPKQM2ATWWDK2M6XXSGSA56HRGRUDWFLTA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641359433 (17h37m55.600456681s) [noise=true , address=104.36.82.46:4481 , piece_id=JGKZX2W3ZEELLRJ7PXRBXKEVDHI3MOUJHUQJWCLY5EXMTHATROWA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641638917 (17h37m55.600736168s) [noise=true , address=104.36.82.61:4398 , piece_id=PV2QIFCEUQAPFXDVGM7M6O6KHXBPCMLFFOTTI56KCN3QHBICTB6Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641656561 (17h37m55.600753806s) [noise=true , address=104.36.82.45:4916 , piece_id=6TY2WAMIDF6JEGXSINF6HJ6UZ4XW5RO2KCHIXUDKWTPNWPHSBGHA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641888735 (17h37m55.60098599s) [noise=true , address=104.36.82.22:4515 , piece_id=KNQOZZWUJOSUKCHQF5HKSOFVZKFVZVLKSBZMI2BZLPT7PMUBBASA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.642145267 (17h37m55.601242513s) [noise=true , address=104.36.82.37:4659 , piece_id=2HYQFY2DQOOVRU73DGQGERDTOCKX5PSCAAEXFIM2DXKO6COVUEEA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.642575454 (17h37m55.601672699s) [noise=true , address=104.36.82.16:4309 , piece_id=4GUOMDCITICDLOYZG32A3XCT42KYMGL3XQAZEQU26WCY32LEOOFQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.643109553 (17h37m55.602206812s) [noise=true , address=104.36.82.23:4449 , piece_id=GYBSPRZMW5DVWMHWOGU5TNS2FQ4O44NZXBM3PNKGMDGCWNIO4WNA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:34.225891854 (17h37m56.184989092s) [upload=18363]: Next returned nil segment
Aug 9 11:03:34.225941492 (17h37m56.185038737s) [upload=18363]: Waiting for error group managing segments...
Aug 9 11:03:34.396000323 (17h37m56.355097556s) [noise=true , address=104.36.82.62:4437 , piece_id=6IHWL5KFKP7BFIOJBK22S54BCWDJLNU53NBL7YKMNJUUACKTBACQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.396691127 (17h37m56.355788358s) [noise=true , address=104.36.82.44:4888 , piece_id=S6E6BTCSDGY2O3MPL2TZTU5DQCJ7ZM4G5KISVXZ757IDZBFVCQ4A, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.402779234 (17h37m56.361876483s) [noise=true , address=104.36.82.49:4012 , piece_id=QWX44RJWWUGUI55TLSFF2JVTJJIRXHXDHB65X5WU4NVBPEFSBD5Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.404422717 (17h37m56.363519973s) [noise=true , address=104.36.82.45:4916 , piece_id=6TY2WAMIDF6JEGXSINF6HJ6UZ4XW5RO2KCHIXUDKWTPNWPHSBGHA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.405872545 (17h37m56.364969793s) [noise=true , address=104.36.82.16:4317 , piece_id=2UHP3NEII7IMQTF5QXEC3RAYWLDGKXLSMTYJJ53GPZVOPSDN3A6Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.406694183 (17h37m56.365791421s) [noise=true , address=104.36.82.37:4659 , piece_id=2HYQFY2DQOOVRU73DGQGERDTOCKX5PSCAAEXFIM2DXKO6COVUEEA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.408468607 (17h37m56.367565845s) [noise=true , address=104.36.82.39:4759 , piece_id=UL2HMA7BUY7VLIOSHLIPKQM2ATWWDK2M6XXSGSA56HRGRUDWFLTA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.408705865 (17h37m56.367803099s) [noise=true , address=104.36.82.16:4309 , piece_id=4GUOMDCITICDLOYZG32A3XCT42KYMGL3XQAZEQU26WCY32LEOOFQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.409792379 (17h37m56.368889625s) [noise=true , address=104.36.82.5:4862 , piece_id=VBW5XUEAL34KRE2JRGQ4RDDBNYWFVDUBXBJ3QL2REGAPFXX3EHEA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.410123205 (17h37m56.369220457s) [noise=true , address=104.36.82.23:4449 , piece_id=GYBSPRZMW5DVWMHWOGU5TNS2FQ4O44NZXBM3PNKGMDGCWNIO4WNA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.410585122 (17h37m56.36968236s) [noise=true , address=104.36.82.38:4699 , piece_id=WYQRYJDHI5FVM2KTHLGBCDOBAOTYVWHQ6IDWI5GQ5MQUBHAUIFLA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.412570982 (17h37m56.371668232s) [noise=true , address=104.36.82.46:4481 , piece_id=JGKZX2W3ZEELLRJ7PXRBXKEVDHI3MOUJHUQJWCLY5EXMTHATROWA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417283695 (17h37m56.376380938s) [noise=true , address=104.36.82.36:4651 , piece_id=DKVNFKDGOV2JI25CG33WWVMYN6SOARCTVENJ4STBYYRCXVDHTWHQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417798285 (17h37m56.376895523s) [noise=true , address=104.36.82.61:4398 , piece_id=PV2QIFCEUQAPFXDVGM7M6O6KHXBPCMLFFOTTI56KCN3QHBICTB6Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417834276 (17h37m56.376931524s) [seg_pos={0 0}, upload=18363]: Segment reached optimal threshold of 14 pieces.
Aug 9 11:03:34.418045510 (17h37m56.377142744s) [noise=true , address=104.36.82.22:4515 , piece_id=KNQOZZWUJOSUKCHQF5HKSOFVZKFVZVLKSBZMI2BZLPT7PMUBBASA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZZmn2sRUkYuNmHY3RY7skQwAYoVYth7rJ8DhmjEpzgE4Rtmxb): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418071259 (17h37m56.377168492s) [noise=true , address=104.36.82.59:4323 , piece_id=AMEOXBJH3FY7QEM4CUX5VVSERBMOFT6TCXC34RRODALRM3DQXGCQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HLr6Ha1ysWYbUJ8He7RofMFCz8qVuJMBFkfJgnTUVw1kmXckz): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418152158 (17h37m56.377249395s) [noise=true , address=104.36.82.10:4093 , piece_id=SKI2RIGZMKQPM55NO23Y7VW7L4J35CWUWREONMLKFV3JEARAW4DQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SsKS8mvgkHszRNtGrt5bktXsJpbdggkeY4tuiAUni6hZ3FnAw): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418262605 (17h37m56.377359853s) [noise=true , address=64.49.13.139:4474 , piece_id=RAJARTWAQ6HDQLUEFTKKBRG6LJCEZJU32AJGAZKFGYXDMBWFISRQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection; write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection
Aug 9 11:03:34.418285940 (17h37m56.377383186s) [seg_pos={0 0}, upload=18363]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 11:03:34.418389194 (17h37m56.377486439s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 11:03:34.418394613 (17h37m56.37749186s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 11:03:34.572765743 (17h37m56.531862993s) [upload=18363]: Done uploading segments...
Aug 9 11:03:34.572825239 (17h37m56.531922475s) [upload=18363]: Upload finished. err: <nil>
Duration: 2.342513563s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........................X.X.......X.......................] duration:
889.136234ms
FAIL (2025-08-09 11:06:23 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 9 10:48:27.285285809 (17h22m49.244383054s) [upload=18101]: Starting upload
Aug 9 10:48:27.285335971 (17h22m49.24443321s) [upload=18101]: Done starting upload
Aug 9 10:48:27.285402380 (17h22m49.244499619s) [upload=18101]: Uploading segments...
Aug 9 10:48:27.285447241 (17h22m49.244544494s) [upload=18101]: Got next segment. Inline: true
Aug 9 10:48:27.285453082 (17h22m49.244550326s) [upload=18101]: Waiting for error group managing segments...
Aug 9 10:48:27.285494392 (17h22m49.244591637s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 10:48:27.285499846 (17h22m49.244597082s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 9 10:48:27.285509862 (17h22m49.244607098s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 10:48:27.479866989 (17h22m49.438964255s) [upload=18101]: Done uploading segments...
Aug 9 10:48:27.479887363 (17h22m49.438984602s) [upload=18101]: Upload finished. err: <nil>
Duration: 889.171625ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...............X...X....................................X...] duration:
2.283111282s
FAIL (2025-08-09 11:05:52 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 30732f12d1c23351236b52fc46e02ade72cbcc01d371bae982a9652c8f3b11e2 != before 9273f3c49dd081d02a56c33fd79fa76e24e29e38ec5c47c511ef60d0bc1d3a49
======LOGS======
Aug 9 11:03:33.439875370 (17h37m55.398972606s) [upload=18363]: Starting upload
Aug 9 11:03:33.439969368 (17h37m55.399066621s) [upload=18363]: Done starting upload
Aug 9 11:03:33.440161922 (17h37m55.399259165s) [upload=18363]: Uploading segments...
Aug 9 11:03:33.440319250 (17h37m55.399416518s) [upload=18363]: Got next segment. Inline: false
Aug 9 11:03:33.440397655 (17h37m55.399494909s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 11:03:33.440404620 (17h37m55.399501867s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 11:03:33.639038109 (17h37m55.598135354s) [seg_pos={0 0}, upload=18363]: Begin upload segment...
Aug 9 11:03:33.639091904 (17h37m55.598189152s) [seg_pos={0 0}, upload=18363]: Done begin upload segment.
Aug 9 11:03:33.639134621 (17h37m55.598231853s) [noise=true , address=64.49.13.139:4474 , piece_id=RAJARTWAQ6HDQLUEFTKKBRG6LJCEZJU32AJGAZKFGYXDMBWFISRQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639141148 (17h37m55.598238399s) [noise=true , address=104.36.82.10:4093 , piece_id=SKI2RIGZMKQPM55NO23Y7VW7L4J35CWUWREONMLKFV3JEARAW4DQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639530470 (17h37m55.598627723s) [noise=true , address=104.36.82.16:4317 , piece_id=2UHP3NEII7IMQTF5QXEC3RAYWLDGKXLSMTYJJ53GPZVOPSDN3A6Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639607585 (17h37m55.598704833s) [noise=true , address=104.36.82.62:4437 , piece_id=6IHWL5KFKP7BFIOJBK22S54BCWDJLNU53NBL7YKMNJUUACKTBACQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639794168 (17h37m55.598891412s) [noise=true , address=104.36.82.36:4651 , piece_id=DKVNFKDGOV2JI25CG33WWVMYN6SOARCTVENJ4STBYYRCXVDHTWHQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640025622 (17h37m55.599122874s) [noise=true , address=104.36.82.44:4888 , piece_id=S6E6BTCSDGY2O3MPL2TZTU5DQCJ7ZM4G5KISVXZ757IDZBFVCQ4A, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640260031 (17h37m55.599357283s) [noise=true , address=104.36.82.59:4323 , piece_id=AMEOXBJH3FY7QEM4CUX5VVSERBMOFT6TCXC34RRODALRM3DQXGCQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640518584 (17h37m55.599615829s) [noise=true , address=104.36.82.5:4862 , piece_id=VBW5XUEAL34KRE2JRGQ4RDDBNYWFVDUBXBJ3QL2REGAPFXX3EHEA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640713081 (17h37m55.599810332s) [noise=true , address=104.36.82.38:4699 , piece_id=WYQRYJDHI5FVM2KTHLGBCDOBAOTYVWHQ6IDWI5GQ5MQUBHAUIFLA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641018305 (17h37m55.600115559s) [noise=true , address=104.36.82.49:4012 , piece_id=QWX44RJWWUGUI55TLSFF2JVTJJIRXHXDHB65X5WU4NVBPEFSBD5Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641109561 (17h37m55.600206809s) [noise=true , address=104.36.82.39:4759 , piece_id=UL2HMA7BUY7VLIOSHLIPKQM2ATWWDK2M6XXSGSA56HRGRUDWFLTA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641359433 (17h37m55.600456681s) [noise=true , address=104.36.82.46:4481 , piece_id=JGKZX2W3ZEELLRJ7PXRBXKEVDHI3MOUJHUQJWCLY5EXMTHATROWA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641638917 (17h37m55.600736168s) [noise=true , address=104.36.82.61:4398 , piece_id=PV2QIFCEUQAPFXDVGM7M6O6KHXBPCMLFFOTTI56KCN3QHBICTB6Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641656561 (17h37m55.600753806s) [noise=true , address=104.36.82.45:4916 , piece_id=6TY2WAMIDF6JEGXSINF6HJ6UZ4XW5RO2KCHIXUDKWTPNWPHSBGHA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641888735 (17h37m55.60098599s) [noise=true , address=104.36.82.22:4515 , piece_id=KNQOZZWUJOSUKCHQF5HKSOFVZKFVZVLKSBZMI2BZLPT7PMUBBASA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.642145267 (17h37m55.601242513s) [noise=true , address=104.36.82.37:4659 , piece_id=2HYQFY2DQOOVRU73DGQGERDTOCKX5PSCAAEXFIM2DXKO6COVUEEA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.642575454 (17h37m55.601672699s) [noise=true , address=104.36.82.16:4309 , piece_id=4GUOMDCITICDLOYZG32A3XCT42KYMGL3XQAZEQU26WCY32LEOOFQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.643109553 (17h37m55.602206812s) [noise=true , address=104.36.82.23:4449 , piece_id=GYBSPRZMW5DVWMHWOGU5TNS2FQ4O44NZXBM3PNKGMDGCWNIO4WNA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:34.225891854 (17h37m56.184989092s) [upload=18363]: Next returned nil segment
Aug 9 11:03:34.225941492 (17h37m56.185038737s) [upload=18363]: Waiting for error group managing segments...
Aug 9 11:03:34.396000323 (17h37m56.355097556s) [noise=true , address=104.36.82.62:4437 , piece_id=6IHWL5KFKP7BFIOJBK22S54BCWDJLNU53NBL7YKMNJUUACKTBACQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.396691127 (17h37m56.355788358s) [noise=true , address=104.36.82.44:4888 , piece_id=S6E6BTCSDGY2O3MPL2TZTU5DQCJ7ZM4G5KISVXZ757IDZBFVCQ4A, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.402779234 (17h37m56.361876483s) [noise=true , address=104.36.82.49:4012 , piece_id=QWX44RJWWUGUI55TLSFF2JVTJJIRXHXDHB65X5WU4NVBPEFSBD5Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.404422717 (17h37m56.363519973s) [noise=true , address=104.36.82.45:4916 , piece_id=6TY2WAMIDF6JEGXSINF6HJ6UZ4XW5RO2KCHIXUDKWTPNWPHSBGHA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.405872545 (17h37m56.364969793s) [noise=true , address=104.36.82.16:4317 , piece_id=2UHP3NEII7IMQTF5QXEC3RAYWLDGKXLSMTYJJ53GPZVOPSDN3A6Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.406694183 (17h37m56.365791421s) [noise=true , address=104.36.82.37:4659 , piece_id=2HYQFY2DQOOVRU73DGQGERDTOCKX5PSCAAEXFIM2DXKO6COVUEEA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.408468607 (17h37m56.367565845s) [noise=true , address=104.36.82.39:4759 , piece_id=UL2HMA7BUY7VLIOSHLIPKQM2ATWWDK2M6XXSGSA56HRGRUDWFLTA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.408705865 (17h37m56.367803099s) [noise=true , address=104.36.82.16:4309 , piece_id=4GUOMDCITICDLOYZG32A3XCT42KYMGL3XQAZEQU26WCY32LEOOFQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.409792379 (17h37m56.368889625s) [noise=true , address=104.36.82.5:4862 , piece_id=VBW5XUEAL34KRE2JRGQ4RDDBNYWFVDUBXBJ3QL2REGAPFXX3EHEA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.410123205 (17h37m56.369220457s) [noise=true , address=104.36.82.23:4449 , piece_id=GYBSPRZMW5DVWMHWOGU5TNS2FQ4O44NZXBM3PNKGMDGCWNIO4WNA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.410585122 (17h37m56.36968236s) [noise=true , address=104.36.82.38:4699 , piece_id=WYQRYJDHI5FVM2KTHLGBCDOBAOTYVWHQ6IDWI5GQ5MQUBHAUIFLA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.412570982 (17h37m56.371668232s) [noise=true , address=104.36.82.46:4481 , piece_id=JGKZX2W3ZEELLRJ7PXRBXKEVDHI3MOUJHUQJWCLY5EXMTHATROWA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417283695 (17h37m56.376380938s) [noise=true , address=104.36.82.36:4651 , piece_id=DKVNFKDGOV2JI25CG33WWVMYN6SOARCTVENJ4STBYYRCXVDHTWHQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417798285 (17h37m56.376895523s) [noise=true , address=104.36.82.61:4398 , piece_id=PV2QIFCEUQAPFXDVGM7M6O6KHXBPCMLFFOTTI56KCN3QHBICTB6Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417834276 (17h37m56.376931524s) [seg_pos={0 0}, upload=18363]: Segment reached optimal threshold of 14 pieces.
Aug 9 11:03:34.418045510 (17h37m56.377142744s) [noise=true , address=104.36.82.22:4515 , piece_id=KNQOZZWUJOSUKCHQF5HKSOFVZKFVZVLKSBZMI2BZLPT7PMUBBASA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZZmn2sRUkYuNmHY3RY7skQwAYoVYth7rJ8DhmjEpzgE4Rtmxb): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418071259 (17h37m56.377168492s) [noise=true , address=104.36.82.59:4323 , piece_id=AMEOXBJH3FY7QEM4CUX5VVSERBMOFT6TCXC34RRODALRM3DQXGCQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HLr6Ha1ysWYbUJ8He7RofMFCz8qVuJMBFkfJgnTUVw1kmXckz): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418152158 (17h37m56.377249395s) [noise=true , address=104.36.82.10:4093 , piece_id=SKI2RIGZMKQPM55NO23Y7VW7L4J35CWUWREONMLKFV3JEARAW4DQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SsKS8mvgkHszRNtGrt5bktXsJpbdggkeY4tuiAUni6hZ3FnAw): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418262605 (17h37m56.377359853s) [noise=true , address=64.49.13.139:4474 , piece_id=RAJARTWAQ6HDQLUEFTKKBRG6LJCEZJU32AJGAZKFGYXDMBWFISRQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection; write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection
Aug 9 11:03:34.418285940 (17h37m56.377383186s) [seg_pos={0 0}, upload=18363]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 11:03:34.418389194 (17h37m56.377486439s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 11:03:34.418394613 (17h37m56.37749186s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 11:03:34.572765743 (17h37m56.531862993s) [upload=18363]: Done uploading segments...
Aug 9 11:03:34.572825239 (17h37m56.531922475s) [upload=18363]: Upload finished. err: <nil>
Duration: 2.283142764s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [................X...X....................................X..] duration:
2.517627988s
FAIL (2025-08-09 11:05:22 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 30732f12d1c23351236b52fc46e02ade72cbcc01d371bae982a9652c8f3b11e2 != before 9273f3c49dd081d02a56c33fd79fa76e24e29e38ec5c47c511ef60d0bc1d3a49
======LOGS======
Aug 9 11:03:33.439875370 (17h37m55.398972606s) [upload=18363]: Starting upload
Aug 9 11:03:33.439969368 (17h37m55.399066621s) [upload=18363]: Done starting upload
Aug 9 11:03:33.440161922 (17h37m55.399259165s) [upload=18363]: Uploading segments...
Aug 9 11:03:33.440319250 (17h37m55.399416518s) [upload=18363]: Got next segment. Inline: false
Aug 9 11:03:33.440397655 (17h37m55.399494909s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 11:03:33.440404620 (17h37m55.399501867s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 11:03:33.639038109 (17h37m55.598135354s) [seg_pos={0 0}, upload=18363]: Begin upload segment...
Aug 9 11:03:33.639091904 (17h37m55.598189152s) [seg_pos={0 0}, upload=18363]: Done begin upload segment.
Aug 9 11:03:33.639134621 (17h37m55.598231853s) [noise=true , address=64.49.13.139:4474 , piece_id=RAJARTWAQ6HDQLUEFTKKBRG6LJCEZJU32AJGAZKFGYXDMBWFISRQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639141148 (17h37m55.598238399s) [noise=true , address=104.36.82.10:4093 , piece_id=SKI2RIGZMKQPM55NO23Y7VW7L4J35CWUWREONMLKFV3JEARAW4DQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639530470 (17h37m55.598627723s) [noise=true , address=104.36.82.16:4317 , piece_id=2UHP3NEII7IMQTF5QXEC3RAYWLDGKXLSMTYJJ53GPZVOPSDN3A6Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639607585 (17h37m55.598704833s) [noise=true , address=104.36.82.62:4437 , piece_id=6IHWL5KFKP7BFIOJBK22S54BCWDJLNU53NBL7YKMNJUUACKTBACQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639794168 (17h37m55.598891412s) [noise=true , address=104.36.82.36:4651 , piece_id=DKVNFKDGOV2JI25CG33WWVMYN6SOARCTVENJ4STBYYRCXVDHTWHQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640025622 (17h37m55.599122874s) [noise=true , address=104.36.82.44:4888 , piece_id=S6E6BTCSDGY2O3MPL2TZTU5DQCJ7ZM4G5KISVXZ757IDZBFVCQ4A, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640260031 (17h37m55.599357283s) [noise=true , address=104.36.82.59:4323 , piece_id=AMEOXBJH3FY7QEM4CUX5VVSERBMOFT6TCXC34RRODALRM3DQXGCQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640518584 (17h37m55.599615829s) [noise=true , address=104.36.82.5:4862 , piece_id=VBW5XUEAL34KRE2JRGQ4RDDBNYWFVDUBXBJ3QL2REGAPFXX3EHEA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640713081 (17h37m55.599810332s) [noise=true , address=104.36.82.38:4699 , piece_id=WYQRYJDHI5FVM2KTHLGBCDOBAOTYVWHQ6IDWI5GQ5MQUBHAUIFLA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641018305 (17h37m55.600115559s) [noise=true , address=104.36.82.49:4012 , piece_id=QWX44RJWWUGUI55TLSFF2JVTJJIRXHXDHB65X5WU4NVBPEFSBD5Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641109561 (17h37m55.600206809s) [noise=true , address=104.36.82.39:4759 , piece_id=UL2HMA7BUY7VLIOSHLIPKQM2ATWWDK2M6XXSGSA56HRGRUDWFLTA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641359433 (17h37m55.600456681s) [noise=true , address=104.36.82.46:4481 , piece_id=JGKZX2W3ZEELLRJ7PXRBXKEVDHI3MOUJHUQJWCLY5EXMTHATROWA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641638917 (17h37m55.600736168s) [noise=true , address=104.36.82.61:4398 , piece_id=PV2QIFCEUQAPFXDVGM7M6O6KHXBPCMLFFOTTI56KCN3QHBICTB6Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641656561 (17h37m55.600753806s) [noise=true , address=104.36.82.45:4916 , piece_id=6TY2WAMIDF6JEGXSINF6HJ6UZ4XW5RO2KCHIXUDKWTPNWPHSBGHA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641888735 (17h37m55.60098599s) [noise=true , address=104.36.82.22:4515 , piece_id=KNQOZZWUJOSUKCHQF5HKSOFVZKFVZVLKSBZMI2BZLPT7PMUBBASA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.642145267 (17h37m55.601242513s) [noise=true , address=104.36.82.37:4659 , piece_id=2HYQFY2DQOOVRU73DGQGERDTOCKX5PSCAAEXFIM2DXKO6COVUEEA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.642575454 (17h37m55.601672699s) [noise=true , address=104.36.82.16:4309 , piece_id=4GUOMDCITICDLOYZG32A3XCT42KYMGL3XQAZEQU26WCY32LEOOFQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.643109553 (17h37m55.602206812s) [noise=true , address=104.36.82.23:4449 , piece_id=GYBSPRZMW5DVWMHWOGU5TNS2FQ4O44NZXBM3PNKGMDGCWNIO4WNA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:34.225891854 (17h37m56.184989092s) [upload=18363]: Next returned nil segment
Aug 9 11:03:34.225941492 (17h37m56.185038737s) [upload=18363]: Waiting for error group managing segments...
Aug 9 11:03:34.396000323 (17h37m56.355097556s) [noise=true , address=104.36.82.62:4437 , piece_id=6IHWL5KFKP7BFIOJBK22S54BCWDJLNU53NBL7YKMNJUUACKTBACQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.396691127 (17h37m56.355788358s) [noise=true , address=104.36.82.44:4888 , piece_id=S6E6BTCSDGY2O3MPL2TZTU5DQCJ7ZM4G5KISVXZ757IDZBFVCQ4A, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.402779234 (17h37m56.361876483s) [noise=true , address=104.36.82.49:4012 , piece_id=QWX44RJWWUGUI55TLSFF2JVTJJIRXHXDHB65X5WU4NVBPEFSBD5Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.404422717 (17h37m56.363519973s) [noise=true , address=104.36.82.45:4916 , piece_id=6TY2WAMIDF6JEGXSINF6HJ6UZ4XW5RO2KCHIXUDKWTPNWPHSBGHA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.405872545 (17h37m56.364969793s) [noise=true , address=104.36.82.16:4317 , piece_id=2UHP3NEII7IMQTF5QXEC3RAYWLDGKXLSMTYJJ53GPZVOPSDN3A6Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.406694183 (17h37m56.365791421s) [noise=true , address=104.36.82.37:4659 , piece_id=2HYQFY2DQOOVRU73DGQGERDTOCKX5PSCAAEXFIM2DXKO6COVUEEA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.408468607 (17h37m56.367565845s) [noise=true , address=104.36.82.39:4759 , piece_id=UL2HMA7BUY7VLIOSHLIPKQM2ATWWDK2M6XXSGSA56HRGRUDWFLTA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.408705865 (17h37m56.367803099s) [noise=true , address=104.36.82.16:4309 , piece_id=4GUOMDCITICDLOYZG32A3XCT42KYMGL3XQAZEQU26WCY32LEOOFQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.409792379 (17h37m56.368889625s) [noise=true , address=104.36.82.5:4862 , piece_id=VBW5XUEAL34KRE2JRGQ4RDDBNYWFVDUBXBJ3QL2REGAPFXX3EHEA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.410123205 (17h37m56.369220457s) [noise=true , address=104.36.82.23:4449 , piece_id=GYBSPRZMW5DVWMHWOGU5TNS2FQ4O44NZXBM3PNKGMDGCWNIO4WNA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.410585122 (17h37m56.36968236s) [noise=true , address=104.36.82.38:4699 , piece_id=WYQRYJDHI5FVM2KTHLGBCDOBAOTYVWHQ6IDWI5GQ5MQUBHAUIFLA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.412570982 (17h37m56.371668232s) [noise=true , address=104.36.82.46:4481 , piece_id=JGKZX2W3ZEELLRJ7PXRBXKEVDHI3MOUJHUQJWCLY5EXMTHATROWA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417283695 (17h37m56.376380938s) [noise=true , address=104.36.82.36:4651 , piece_id=DKVNFKDGOV2JI25CG33WWVMYN6SOARCTVENJ4STBYYRCXVDHTWHQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417798285 (17h37m56.376895523s) [noise=true , address=104.36.82.61:4398 , piece_id=PV2QIFCEUQAPFXDVGM7M6O6KHXBPCMLFFOTTI56KCN3QHBICTB6Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417834276 (17h37m56.376931524s) [seg_pos={0 0}, upload=18363]: Segment reached optimal threshold of 14 pieces.
Aug 9 11:03:34.418045510 (17h37m56.377142744s) [noise=true , address=104.36.82.22:4515 , piece_id=KNQOZZWUJOSUKCHQF5HKSOFVZKFVZVLKSBZMI2BZLPT7PMUBBASA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZZmn2sRUkYuNmHY3RY7skQwAYoVYth7rJ8DhmjEpzgE4Rtmxb): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418071259 (17h37m56.377168492s) [noise=true , address=104.36.82.59:4323 , piece_id=AMEOXBJH3FY7QEM4CUX5VVSERBMOFT6TCXC34RRODALRM3DQXGCQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HLr6Ha1ysWYbUJ8He7RofMFCz8qVuJMBFkfJgnTUVw1kmXckz): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418152158 (17h37m56.377249395s) [noise=true , address=104.36.82.10:4093 , piece_id=SKI2RIGZMKQPM55NO23Y7VW7L4J35CWUWREONMLKFV3JEARAW4DQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SsKS8mvgkHszRNtGrt5bktXsJpbdggkeY4tuiAUni6hZ3FnAw): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418262605 (17h37m56.377359853s) [noise=true , address=64.49.13.139:4474 , piece_id=RAJARTWAQ6HDQLUEFTKKBRG6LJCEZJU32AJGAZKFGYXDMBWFISRQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection; write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection
Aug 9 11:03:34.418285940 (17h37m56.377383186s) [seg_pos={0 0}, upload=18363]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 11:03:34.418389194 (17h37m56.377486439s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 11:03:34.418394613 (17h37m56.37749186s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 11:03:34.572765743 (17h37m56.531862993s) [upload=18363]: Done uploading segments...
Aug 9 11:03:34.572825239 (17h37m56.531922475s) [upload=18363]: Upload finished. err: <nil>
Duration: 2.517652869s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [X..........................X.X.......X......................] duration:
885.213052ms
FAIL (2025-08-09 11:05:14 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 9 10:48:27.285285809 (17h22m49.244383054s) [upload=18101]: Starting upload
Aug 9 10:48:27.285335971 (17h22m49.24443321s) [upload=18101]: Done starting upload
Aug 9 10:48:27.285402380 (17h22m49.244499619s) [upload=18101]: Uploading segments...
Aug 9 10:48:27.285447241 (17h22m49.244544494s) [upload=18101]: Got next segment. Inline: true
Aug 9 10:48:27.285453082 (17h22m49.244550326s) [upload=18101]: Waiting for error group managing segments...
Aug 9 10:48:27.285494392 (17h22m49.244591637s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 10:48:27.285499846 (17h22m49.244597082s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 9 10:48:27.285509862 (17h22m49.244607098s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 10:48:27.479866989 (17h22m49.438964255s) [upload=18101]: Done uploading segments...
Aug 9 10:48:27.479887363 (17h22m49.438984602s) [upload=18101]: Upload finished. err: <nil>
Duration: 885.247119ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.X..........................X.X.......X.....................] duration:
819.930417ms
FAIL (2025-08-09 11:04:43 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 9 10:48:27.285285809 (17h22m49.244383054s) [upload=18101]: Starting upload
Aug 9 10:48:27.285335971 (17h22m49.24443321s) [upload=18101]: Done starting upload
Aug 9 10:48:27.285402380 (17h22m49.244499619s) [upload=18101]: Uploading segments...
Aug 9 10:48:27.285447241 (17h22m49.244544494s) [upload=18101]: Got next segment. Inline: true
Aug 9 10:48:27.285453082 (17h22m49.244550326s) [upload=18101]: Waiting for error group managing segments...
Aug 9 10:48:27.285494392 (17h22m49.244591637s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 10:48:27.285499846 (17h22m49.244597082s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 9 10:48:27.285509862 (17h22m49.244607098s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 10:48:27.479866989 (17h22m49.438964255s) [upload=18101]: Done uploading segments...
Aug 9 10:48:27.479887363 (17h22m49.438984602s) [upload=18101]: Upload finished. err: <nil>
Duration: 819.964131ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.................X...X....................................X.] duration:
2.346058214s
FAIL (2025-08-09 11:04:38 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 30732f12d1c23351236b52fc46e02ade72cbcc01d371bae982a9652c8f3b11e2 != before 9273f3c49dd081d02a56c33fd79fa76e24e29e38ec5c47c511ef60d0bc1d3a49
======LOGS======
Aug 9 11:03:33.439875370 (17h37m55.398972606s) [upload=18363]: Starting upload
Aug 9 11:03:33.439969368 (17h37m55.399066621s) [upload=18363]: Done starting upload
Aug 9 11:03:33.440161922 (17h37m55.399259165s) [upload=18363]: Uploading segments...
Aug 9 11:03:33.440319250 (17h37m55.399416518s) [upload=18363]: Got next segment. Inline: false
Aug 9 11:03:33.440397655 (17h37m55.399494909s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 11:03:33.440404620 (17h37m55.399501867s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 11:03:33.639038109 (17h37m55.598135354s) [seg_pos={0 0}, upload=18363]: Begin upload segment...
Aug 9 11:03:33.639091904 (17h37m55.598189152s) [seg_pos={0 0}, upload=18363]: Done begin upload segment.
Aug 9 11:03:33.639134621 (17h37m55.598231853s) [noise=true , address=64.49.13.139:4474 , piece_id=RAJARTWAQ6HDQLUEFTKKBRG6LJCEZJU32AJGAZKFGYXDMBWFISRQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639141148 (17h37m55.598238399s) [noise=true , address=104.36.82.10:4093 , piece_id=SKI2RIGZMKQPM55NO23Y7VW7L4J35CWUWREONMLKFV3JEARAW4DQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639530470 (17h37m55.598627723s) [noise=true , address=104.36.82.16:4317 , piece_id=2UHP3NEII7IMQTF5QXEC3RAYWLDGKXLSMTYJJ53GPZVOPSDN3A6Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639607585 (17h37m55.598704833s) [noise=true , address=104.36.82.62:4437 , piece_id=6IHWL5KFKP7BFIOJBK22S54BCWDJLNU53NBL7YKMNJUUACKTBACQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639794168 (17h37m55.598891412s) [noise=true , address=104.36.82.36:4651 , piece_id=DKVNFKDGOV2JI25CG33WWVMYN6SOARCTVENJ4STBYYRCXVDHTWHQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640025622 (17h37m55.599122874s) [noise=true , address=104.36.82.44:4888 , piece_id=S6E6BTCSDGY2O3MPL2TZTU5DQCJ7ZM4G5KISVXZ757IDZBFVCQ4A, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640260031 (17h37m55.599357283s) [noise=true , address=104.36.82.59:4323 , piece_id=AMEOXBJH3FY7QEM4CUX5VVSERBMOFT6TCXC34RRODALRM3DQXGCQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640518584 (17h37m55.599615829s) [noise=true , address=104.36.82.5:4862 , piece_id=VBW5XUEAL34KRE2JRGQ4RDDBNYWFVDUBXBJ3QL2REGAPFXX3EHEA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640713081 (17h37m55.599810332s) [noise=true , address=104.36.82.38:4699 , piece_id=WYQRYJDHI5FVM2KTHLGBCDOBAOTYVWHQ6IDWI5GQ5MQUBHAUIFLA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641018305 (17h37m55.600115559s) [noise=true , address=104.36.82.49:4012 , piece_id=QWX44RJWWUGUI55TLSFF2JVTJJIRXHXDHB65X5WU4NVBPEFSBD5Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641109561 (17h37m55.600206809s) [noise=true , address=104.36.82.39:4759 , piece_id=UL2HMA7BUY7VLIOSHLIPKQM2ATWWDK2M6XXSGSA56HRGRUDWFLTA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641359433 (17h37m55.600456681s) [noise=true , address=104.36.82.46:4481 , piece_id=JGKZX2W3ZEELLRJ7PXRBXKEVDHI3MOUJHUQJWCLY5EXMTHATROWA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641638917 (17h37m55.600736168s) [noise=true , address=104.36.82.61:4398 , piece_id=PV2QIFCEUQAPFXDVGM7M6O6KHXBPCMLFFOTTI56KCN3QHBICTB6Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641656561 (17h37m55.600753806s) [noise=true , address=104.36.82.45:4916 , piece_id=6TY2WAMIDF6JEGXSINF6HJ6UZ4XW5RO2KCHIXUDKWTPNWPHSBGHA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641888735 (17h37m55.60098599s) [noise=true , address=104.36.82.22:4515 , piece_id=KNQOZZWUJOSUKCHQF5HKSOFVZKFVZVLKSBZMI2BZLPT7PMUBBASA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.642145267 (17h37m55.601242513s) [noise=true , address=104.36.82.37:4659 , piece_id=2HYQFY2DQOOVRU73DGQGERDTOCKX5PSCAAEXFIM2DXKO6COVUEEA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.642575454 (17h37m55.601672699s) [noise=true , address=104.36.82.16:4309 , piece_id=4GUOMDCITICDLOYZG32A3XCT42KYMGL3XQAZEQU26WCY32LEOOFQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.643109553 (17h37m55.602206812s) [noise=true , address=104.36.82.23:4449 , piece_id=GYBSPRZMW5DVWMHWOGU5TNS2FQ4O44NZXBM3PNKGMDGCWNIO4WNA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:34.225891854 (17h37m56.184989092s) [upload=18363]: Next returned nil segment
Aug 9 11:03:34.225941492 (17h37m56.185038737s) [upload=18363]: Waiting for error group managing segments...
Aug 9 11:03:34.396000323 (17h37m56.355097556s) [noise=true , address=104.36.82.62:4437 , piece_id=6IHWL5KFKP7BFIOJBK22S54BCWDJLNU53NBL7YKMNJUUACKTBACQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.396691127 (17h37m56.355788358s) [noise=true , address=104.36.82.44:4888 , piece_id=S6E6BTCSDGY2O3MPL2TZTU5DQCJ7ZM4G5KISVXZ757IDZBFVCQ4A, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.402779234 (17h37m56.361876483s) [noise=true , address=104.36.82.49:4012 , piece_id=QWX44RJWWUGUI55TLSFF2JVTJJIRXHXDHB65X5WU4NVBPEFSBD5Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.404422717 (17h37m56.363519973s) [noise=true , address=104.36.82.45:4916 , piece_id=6TY2WAMIDF6JEGXSINF6HJ6UZ4XW5RO2KCHIXUDKWTPNWPHSBGHA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.405872545 (17h37m56.364969793s) [noise=true , address=104.36.82.16:4317 , piece_id=2UHP3NEII7IMQTF5QXEC3RAYWLDGKXLSMTYJJ53GPZVOPSDN3A6Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.406694183 (17h37m56.365791421s) [noise=true , address=104.36.82.37:4659 , piece_id=2HYQFY2DQOOVRU73DGQGERDTOCKX5PSCAAEXFIM2DXKO6COVUEEA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.408468607 (17h37m56.367565845s) [noise=true , address=104.36.82.39:4759 , piece_id=UL2HMA7BUY7VLIOSHLIPKQM2ATWWDK2M6XXSGSA56HRGRUDWFLTA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.408705865 (17h37m56.367803099s) [noise=true , address=104.36.82.16:4309 , piece_id=4GUOMDCITICDLOYZG32A3XCT42KYMGL3XQAZEQU26WCY32LEOOFQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.409792379 (17h37m56.368889625s) [noise=true , address=104.36.82.5:4862 , piece_id=VBW5XUEAL34KRE2JRGQ4RDDBNYWFVDUBXBJ3QL2REGAPFXX3EHEA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.410123205 (17h37m56.369220457s) [noise=true , address=104.36.82.23:4449 , piece_id=GYBSPRZMW5DVWMHWOGU5TNS2FQ4O44NZXBM3PNKGMDGCWNIO4WNA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.410585122 (17h37m56.36968236s) [noise=true , address=104.36.82.38:4699 , piece_id=WYQRYJDHI5FVM2KTHLGBCDOBAOTYVWHQ6IDWI5GQ5MQUBHAUIFLA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.412570982 (17h37m56.371668232s) [noise=true , address=104.36.82.46:4481 , piece_id=JGKZX2W3ZEELLRJ7PXRBXKEVDHI3MOUJHUQJWCLY5EXMTHATROWA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417283695 (17h37m56.376380938s) [noise=true , address=104.36.82.36:4651 , piece_id=DKVNFKDGOV2JI25CG33WWVMYN6SOARCTVENJ4STBYYRCXVDHTWHQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417798285 (17h37m56.376895523s) [noise=true , address=104.36.82.61:4398 , piece_id=PV2QIFCEUQAPFXDVGM7M6O6KHXBPCMLFFOTTI56KCN3QHBICTB6Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417834276 (17h37m56.376931524s) [seg_pos={0 0}, upload=18363]: Segment reached optimal threshold of 14 pieces.
Aug 9 11:03:34.418045510 (17h37m56.377142744s) [noise=true , address=104.36.82.22:4515 , piece_id=KNQOZZWUJOSUKCHQF5HKSOFVZKFVZVLKSBZMI2BZLPT7PMUBBASA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZZmn2sRUkYuNmHY3RY7skQwAYoVYth7rJ8DhmjEpzgE4Rtmxb): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418071259 (17h37m56.377168492s) [noise=true , address=104.36.82.59:4323 , piece_id=AMEOXBJH3FY7QEM4CUX5VVSERBMOFT6TCXC34RRODALRM3DQXGCQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HLr6Ha1ysWYbUJ8He7RofMFCz8qVuJMBFkfJgnTUVw1kmXckz): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418152158 (17h37m56.377249395s) [noise=true , address=104.36.82.10:4093 , piece_id=SKI2RIGZMKQPM55NO23Y7VW7L4J35CWUWREONMLKFV3JEARAW4DQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SsKS8mvgkHszRNtGrt5bktXsJpbdggkeY4tuiAUni6hZ3FnAw): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418262605 (17h37m56.377359853s) [noise=true , address=64.49.13.139:4474 , piece_id=RAJARTWAQ6HDQLUEFTKKBRG6LJCEZJU32AJGAZKFGYXDMBWFISRQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection; write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection
Aug 9 11:03:34.418285940 (17h37m56.377383186s) [seg_pos={0 0}, upload=18363]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 11:03:34.418389194 (17h37m56.377486439s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 11:03:34.418394613 (17h37m56.37749186s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 11:03:34.572765743 (17h37m56.531862993s) [upload=18363]: Done uploading segments...
Aug 9 11:03:34.572825239 (17h37m56.531922475s) [upload=18363]: Upload finished. err: <nil>
Duration: 2.346089781s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..X..........................X.X.......X....................] duration:
848.108626ms
FAIL (2025-08-09 11:04:28 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 9 10:48:27.285285809 (17h22m49.244383054s) [upload=18101]: Starting upload
Aug 9 10:48:27.285335971 (17h22m49.24443321s) [upload=18101]: Done starting upload
Aug 9 10:48:27.285402380 (17h22m49.244499619s) [upload=18101]: Uploading segments...
Aug 9 10:48:27.285447241 (17h22m49.244544494s) [upload=18101]: Got next segment. Inline: true
Aug 9 10:48:27.285453082 (17h22m49.244550326s) [upload=18101]: Waiting for error group managing segments...
Aug 9 10:48:27.285494392 (17h22m49.244591637s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 10:48:27.285499846 (17h22m49.244597082s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 9 10:48:27.285509862 (17h22m49.244607098s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 10:48:27.479866989 (17h22m49.438964255s) [upload=18101]: Done uploading segments...
Aug 9 10:48:27.479887363 (17h22m49.438984602s) [upload=18101]: Upload finished. err: <nil>
Duration: 848.205492ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...X..........................X.X.......X...................] duration:
1.063087246s
FAIL (2025-08-09 11:04:11 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 9 10:48:27.285285809 (17h22m49.244383054s) [upload=18101]: Starting upload
Aug 9 10:48:27.285335971 (17h22m49.24443321s) [upload=18101]: Done starting upload
Aug 9 10:48:27.285402380 (17h22m49.244499619s) [upload=18101]: Uploading segments...
Aug 9 10:48:27.285447241 (17h22m49.244544494s) [upload=18101]: Got next segment. Inline: true
Aug 9 10:48:27.285453082 (17h22m49.244550326s) [upload=18101]: Waiting for error group managing segments...
Aug 9 10:48:27.285494392 (17h22m49.244591637s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 10:48:27.285499846 (17h22m49.244597082s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 9 10:48:27.285509862 (17h22m49.244607098s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 10:48:27.479866989 (17h22m49.438964255s) [upload=18101]: Done uploading segments...
Aug 9 10:48:27.479887363 (17h22m49.438984602s) [upload=18101]: Upload finished. err: <nil>
Duration: 1.063149399s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [X.................X...X....................................X] duration:
2.251925039s
FAIL (2025-08-09 11:03:35 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 30732f12d1c23351236b52fc46e02ade72cbcc01d371bae982a9652c8f3b11e2 != before 9273f3c49dd081d02a56c33fd79fa76e24e29e38ec5c47c511ef60d0bc1d3a49
======LOGS======
Aug 9 11:03:33.439875370 (17h37m55.398972606s) [upload=18363]: Starting upload
Aug 9 11:03:33.439969368 (17h37m55.399066621s) [upload=18363]: Done starting upload
Aug 9 11:03:33.440161922 (17h37m55.399259165s) [upload=18363]: Uploading segments...
Aug 9 11:03:33.440319250 (17h37m55.399416518s) [upload=18363]: Got next segment. Inline: false
Aug 9 11:03:33.440397655 (17h37m55.399494909s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 11:03:33.440404620 (17h37m55.399501867s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 9 11:03:33.639038109 (17h37m55.598135354s) [seg_pos={0 0}, upload=18363]: Begin upload segment...
Aug 9 11:03:33.639091904 (17h37m55.598189152s) [seg_pos={0 0}, upload=18363]: Done begin upload segment.
Aug 9 11:03:33.639134621 (17h37m55.598231853s) [noise=true , address=64.49.13.139:4474 , piece_id=RAJARTWAQ6HDQLUEFTKKBRG6LJCEZJU32AJGAZKFGYXDMBWFISRQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639141148 (17h37m55.598238399s) [noise=true , address=104.36.82.10:4093 , piece_id=SKI2RIGZMKQPM55NO23Y7VW7L4J35CWUWREONMLKFV3JEARAW4DQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639530470 (17h37m55.598627723s) [noise=true , address=104.36.82.16:4317 , piece_id=2UHP3NEII7IMQTF5QXEC3RAYWLDGKXLSMTYJJ53GPZVOPSDN3A6Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639607585 (17h37m55.598704833s) [noise=true , address=104.36.82.62:4437 , piece_id=6IHWL5KFKP7BFIOJBK22S54BCWDJLNU53NBL7YKMNJUUACKTBACQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.639794168 (17h37m55.598891412s) [noise=true , address=104.36.82.36:4651 , piece_id=DKVNFKDGOV2JI25CG33WWVMYN6SOARCTVENJ4STBYYRCXVDHTWHQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640025622 (17h37m55.599122874s) [noise=true , address=104.36.82.44:4888 , piece_id=S6E6BTCSDGY2O3MPL2TZTU5DQCJ7ZM4G5KISVXZ757IDZBFVCQ4A, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640260031 (17h37m55.599357283s) [noise=true , address=104.36.82.59:4323 , piece_id=AMEOXBJH3FY7QEM4CUX5VVSERBMOFT6TCXC34RRODALRM3DQXGCQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640518584 (17h37m55.599615829s) [noise=true , address=104.36.82.5:4862 , piece_id=VBW5XUEAL34KRE2JRGQ4RDDBNYWFVDUBXBJ3QL2REGAPFXX3EHEA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.640713081 (17h37m55.599810332s) [noise=true , address=104.36.82.38:4699 , piece_id=WYQRYJDHI5FVM2KTHLGBCDOBAOTYVWHQ6IDWI5GQ5MQUBHAUIFLA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641018305 (17h37m55.600115559s) [noise=true , address=104.36.82.49:4012 , piece_id=QWX44RJWWUGUI55TLSFF2JVTJJIRXHXDHB65X5WU4NVBPEFSBD5Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641109561 (17h37m55.600206809s) [noise=true , address=104.36.82.39:4759 , piece_id=UL2HMA7BUY7VLIOSHLIPKQM2ATWWDK2M6XXSGSA56HRGRUDWFLTA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641359433 (17h37m55.600456681s) [noise=true , address=104.36.82.46:4481 , piece_id=JGKZX2W3ZEELLRJ7PXRBXKEVDHI3MOUJHUQJWCLY5EXMTHATROWA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641638917 (17h37m55.600736168s) [noise=true , address=104.36.82.61:4398 , piece_id=PV2QIFCEUQAPFXDVGM7M6O6KHXBPCMLFFOTTI56KCN3QHBICTB6Q, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641656561 (17h37m55.600753806s) [noise=true , address=104.36.82.45:4916 , piece_id=6TY2WAMIDF6JEGXSINF6HJ6UZ4XW5RO2KCHIXUDKWTPNWPHSBGHA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.641888735 (17h37m55.60098599s) [noise=true , address=104.36.82.22:4515 , piece_id=KNQOZZWUJOSUKCHQF5HKSOFVZKFVZVLKSBZMI2BZLPT7PMUBBASA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.642145267 (17h37m55.601242513s) [noise=true , address=104.36.82.37:4659 , piece_id=2HYQFY2DQOOVRU73DGQGERDTOCKX5PSCAAEXFIM2DXKO6COVUEEA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.642575454 (17h37m55.601672699s) [noise=true , address=104.36.82.16:4309 , piece_id=4GUOMDCITICDLOYZG32A3XCT42KYMGL3XQAZEQU26WCY32LEOOFQ, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:33.643109553 (17h37m55.602206812s) [noise=true , address=104.36.82.23:4449 , piece_id=GYBSPRZMW5DVWMHWOGU5TNS2FQ4O44NZXBM3PNKGMDGCWNIO4WNA, seg_pos={0 0}, upload=18363]: Uploading piece...
Aug 9 11:03:34.225891854 (17h37m56.184989092s) [upload=18363]: Next returned nil segment
Aug 9 11:03:34.225941492 (17h37m56.185038737s) [upload=18363]: Waiting for error group managing segments...
Aug 9 11:03:34.396000323 (17h37m56.355097556s) [noise=true , address=104.36.82.62:4437 , piece_id=6IHWL5KFKP7BFIOJBK22S54BCWDJLNU53NBL7YKMNJUUACKTBACQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.396691127 (17h37m56.355788358s) [noise=true , address=104.36.82.44:4888 , piece_id=S6E6BTCSDGY2O3MPL2TZTU5DQCJ7ZM4G5KISVXZ757IDZBFVCQ4A, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.402779234 (17h37m56.361876483s) [noise=true , address=104.36.82.49:4012 , piece_id=QWX44RJWWUGUI55TLSFF2JVTJJIRXHXDHB65X5WU4NVBPEFSBD5Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.404422717 (17h37m56.363519973s) [noise=true , address=104.36.82.45:4916 , piece_id=6TY2WAMIDF6JEGXSINF6HJ6UZ4XW5RO2KCHIXUDKWTPNWPHSBGHA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.405872545 (17h37m56.364969793s) [noise=true , address=104.36.82.16:4317 , piece_id=2UHP3NEII7IMQTF5QXEC3RAYWLDGKXLSMTYJJ53GPZVOPSDN3A6Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.406694183 (17h37m56.365791421s) [noise=true , address=104.36.82.37:4659 , piece_id=2HYQFY2DQOOVRU73DGQGERDTOCKX5PSCAAEXFIM2DXKO6COVUEEA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.408468607 (17h37m56.367565845s) [noise=true , address=104.36.82.39:4759 , piece_id=UL2HMA7BUY7VLIOSHLIPKQM2ATWWDK2M6XXSGSA56HRGRUDWFLTA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.408705865 (17h37m56.367803099s) [noise=true , address=104.36.82.16:4309 , piece_id=4GUOMDCITICDLOYZG32A3XCT42KYMGL3XQAZEQU26WCY32LEOOFQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.409792379 (17h37m56.368889625s) [noise=true , address=104.36.82.5:4862 , piece_id=VBW5XUEAL34KRE2JRGQ4RDDBNYWFVDUBXBJ3QL2REGAPFXX3EHEA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.410123205 (17h37m56.369220457s) [noise=true , address=104.36.82.23:4449 , piece_id=GYBSPRZMW5DVWMHWOGU5TNS2FQ4O44NZXBM3PNKGMDGCWNIO4WNA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.410585122 (17h37m56.36968236s) [noise=true , address=104.36.82.38:4699 , piece_id=WYQRYJDHI5FVM2KTHLGBCDOBAOTYVWHQ6IDWI5GQ5MQUBHAUIFLA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.412570982 (17h37m56.371668232s) [noise=true , address=104.36.82.46:4481 , piece_id=JGKZX2W3ZEELLRJ7PXRBXKEVDHI3MOUJHUQJWCLY5EXMTHATROWA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417283695 (17h37m56.376380938s) [noise=true , address=104.36.82.36:4651 , piece_id=DKVNFKDGOV2JI25CG33WWVMYN6SOARCTVENJ4STBYYRCXVDHTWHQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417798285 (17h37m56.376895523s) [noise=true , address=104.36.82.61:4398 , piece_id=PV2QIFCEUQAPFXDVGM7M6O6KHXBPCMLFFOTTI56KCN3QHBICTB6Q, seg_pos={0 0}, upload=18363]: Done uploading piece. err: <nil>
Aug 9 11:03:34.417834276 (17h37m56.376931524s) [seg_pos={0 0}, upload=18363]: Segment reached optimal threshold of 14 pieces.
Aug 9 11:03:34.418045510 (17h37m56.377142744s) [noise=true , address=104.36.82.22:4515 , piece_id=KNQOZZWUJOSUKCHQF5HKSOFVZKFVZVLKSBZMI2BZLPT7PMUBBASA, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZZmn2sRUkYuNmHY3RY7skQwAYoVYth7rJ8DhmjEpzgE4Rtmxb): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418071259 (17h37m56.377168492s) [noise=true , address=104.36.82.59:4323 , piece_id=AMEOXBJH3FY7QEM4CUX5VVSERBMOFT6TCXC34RRODALRM3DQXGCQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HLr6Ha1ysWYbUJ8He7RofMFCz8qVuJMBFkfJgnTUVw1kmXckz): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418152158 (17h37m56.377249395s) [noise=true , address=104.36.82.10:4093 , piece_id=SKI2RIGZMKQPM55NO23Y7VW7L4J35CWUWREONMLKFV3JEARAW4DQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1SsKS8mvgkHszRNtGrt5bktXsJpbdggkeY4tuiAUni6hZ3FnAw): protocol: expected piece hash; context canceled; EOF
Aug 9 11:03:34.418262605 (17h37m56.377359853s) [noise=true , address=64.49.13.139:4474 , piece_id=RAJARTWAQ6HDQLUEFTKKBRG6LJCEZJU32AJGAZKFGYXDMBWFISRQ, seg_pos={0 0}, upload=18363]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:126wi7mavkxXLAWpoK1VP6QX2QPddsydzkMNRJc5uDU3LrCRVY2): protocol: write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection; write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:46644->64.49.13.139:4474: use of closed network connection
Aug 9 11:03:34.418285940 (17h37m56.377383186s) [seg_pos={0 0}, upload=18363]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 9 11:03:34.418389194 (17h37m56.377486439s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 9 11:03:34.418394613 (17h37m56.37749186s) [upload=18363]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 11:03:34.572765743 (17h37m56.531862993s) [upload=18363]: Done uploading segments...
Aug 9 11:03:34.572825239 (17h37m56.531922475s) [upload=18363]: Upload finished. err: <nil>
Duration: 2.25195473s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [....X..........................X.X.......X..................] duration:
827.236044ms
FAIL (2025-08-09 11:03:18 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 9 10:48:27.285285809 (17h22m49.244383054s) [upload=18101]: Starting upload
Aug 9 10:48:27.285335971 (17h22m49.24443321s) [upload=18101]: Done starting upload
Aug 9 10:48:27.285402380 (17h22m49.244499619s) [upload=18101]: Uploading segments...
Aug 9 10:48:27.285447241 (17h22m49.244544494s) [upload=18101]: Got next segment. Inline: true
Aug 9 10:48:27.285453082 (17h22m49.244550326s) [upload=18101]: Waiting for error group managing segments...
Aug 9 10:48:27.285494392 (17h22m49.244591637s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 10:48:27.285499846 (17h22m49.244597082s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 9 10:48:27.285509862 (17h22m49.244607098s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 10:48:27.479866989 (17h22m49.438964255s) [upload=18101]: Done uploading segments...
Aug 9 10:48:27.479887363 (17h22m49.438984602s) [upload=18101]: Upload finished. err: <nil>
Duration: 827.288214ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.X.................X...X....................................] duration:
2.359527538s
FAIL (2025-08-09 11:02:41 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 10:35:38.321148367 (17h10m0.280245612s) [upload=17877]: Starting upload Aug 9 10:35:38.321200893 (17h10m0.280298131s) [upload=17877]: Done starting upload Aug 9 10:35:38.321351423 (17h10m0.280448662s) [upload=17877]: Uploading segments... Aug 9 10:35:38.321453565 (17h10m0.28055081s) [upload=17877]: Got next segment. Inline: false Aug 9 10:35:38.321500503 (17h10m0.280597747s) [upload=17877]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 10:35:38.321505898 (17h10m0.280603143s) [upload=17877]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 10:35:38.409971617 (17h10m0.369068873s) [upload=17877]: Next segment err: metaclient: Too Many Requests Aug 9 10:35:38.410000840 (17h10m0.369098095s) [upload=17877]: Done uploading segments... Aug 9 10:35:38.410046611 (17h10m0.369143867s) [upload=17877]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.359560925s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.....X..........................X.X.......X.................] duration:
854.580858ms
FAIL (2025-08-09 11:02:34 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 9 10:48:27.285285809 (17h22m49.244383054s) [upload=18101]: Starting upload
Aug 9 10:48:27.285335971 (17h22m49.24443321s) [upload=18101]: Done starting upload
Aug 9 10:48:27.285402380 (17h22m49.244499619s) [upload=18101]: Uploading segments...
Aug 9 10:48:27.285447241 (17h22m49.244544494s) [upload=18101]: Got next segment. Inline: true
Aug 9 10:48:27.285453082 (17h22m49.244550326s) [upload=18101]: Waiting for error group managing segments...
Aug 9 10:48:27.285494392 (17h22m49.244591637s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 10:48:27.285499846 (17h22m49.244597082s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 9 10:48:27.285509862 (17h22m49.244607098s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 10:48:27.479866989 (17h22m49.438964255s) [upload=18101]: Done uploading segments...
Aug 9 10:48:27.479887363 (17h22m49.438984602s) [upload=18101]: Upload finished. err: <nil>
Duration: 854.607297ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..X.................X...X...................................] duration:
2.484110913s
FAIL (2025-08-09 11:01:42 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 10:35:38.321148367 (17h10m0.280245612s) [upload=17877]: Starting upload Aug 9 10:35:38.321200893 (17h10m0.280298131s) [upload=17877]: Done starting upload Aug 9 10:35:38.321351423 (17h10m0.280448662s) [upload=17877]: Uploading segments... Aug 9 10:35:38.321453565 (17h10m0.28055081s) [upload=17877]: Got next segment. Inline: false Aug 9 10:35:38.321500503 (17h10m0.280597747s) [upload=17877]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 10:35:38.321505898 (17h10m0.280603143s) [upload=17877]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 10:35:38.409971617 (17h10m0.369068873s) [upload=17877]: Next segment err: metaclient: Too Many Requests Aug 9 10:35:38.410000840 (17h10m0.369098095s) [upload=17877]: Done uploading segments... Aug 9 10:35:38.410046611 (17h10m0.369143867s) [upload=17877]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.484155039s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [......X..........................X.X.......X................] duration:
838.281569ms
FAIL (2025-08-09 11:01:28 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 9 10:48:27.285285809 (17h22m49.244383054s) [upload=18101]: Starting upload
Aug 9 10:48:27.285335971 (17h22m49.24443321s) [upload=18101]: Done starting upload
Aug 9 10:48:27.285402380 (17h22m49.244499619s) [upload=18101]: Uploading segments...
Aug 9 10:48:27.285447241 (17h22m49.244544494s) [upload=18101]: Got next segment. Inline: true
Aug 9 10:48:27.285453082 (17h22m49.244550326s) [upload=18101]: Waiting for error group managing segments...
Aug 9 10:48:27.285494392 (17h22m49.244591637s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 10:48:27.285499846 (17h22m49.244597082s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 9 10:48:27.285509862 (17h22m49.244607098s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 10:48:27.479866989 (17h22m49.438964255s) [upload=18101]: Done uploading segments...
Aug 9 10:48:27.479887363 (17h22m49.438984602s) [upload=18101]: Upload finished. err: <nil>
Duration: 838.306668ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.......X..........................X.X.......X...............] duration:
837.373518ms
FAIL (2025-08-09 11:01:02 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 9 10:48:27.285285809 (17h22m49.244383054s) [upload=18101]: Starting upload
Aug 9 10:48:27.285335971 (17h22m49.24443321s) [upload=18101]: Done starting upload
Aug 9 10:48:27.285402380 (17h22m49.244499619s) [upload=18101]: Uploading segments...
Aug 9 10:48:27.285447241 (17h22m49.244544494s) [upload=18101]: Got next segment. Inline: true
Aug 9 10:48:27.285453082 (17h22m49.244550326s) [upload=18101]: Waiting for error group managing segments...
Aug 9 10:48:27.285494392 (17h22m49.244591637s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 10:48:27.285499846 (17h22m49.244597082s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 9 10:48:27.285509862 (17h22m49.244607098s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 10:48:27.479866989 (17h22m49.438964255s) [upload=18101]: Done uploading segments...
Aug 9 10:48:27.479887363 (17h22m49.438984602s) [upload=18101]: Upload finished. err: <nil>
Duration: 837.463219ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [...X.................X...X..................................] duration:
2.403790251s
FAIL (2025-08-09 11:00:31 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 10:35:38.321148367 (17h10m0.280245612s) [upload=17877]: Starting upload Aug 9 10:35:38.321200893 (17h10m0.280298131s) [upload=17877]: Done starting upload Aug 9 10:35:38.321351423 (17h10m0.280448662s) [upload=17877]: Uploading segments... Aug 9 10:35:38.321453565 (17h10m0.28055081s) [upload=17877]: Got next segment. Inline: false Aug 9 10:35:38.321500503 (17h10m0.280597747s) [upload=17877]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 10:35:38.321505898 (17h10m0.280603143s) [upload=17877]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 10:35:38.409971617 (17h10m0.369068873s) [upload=17877]: Next segment err: metaclient: Too Many Requests Aug 9 10:35:38.410000840 (17h10m0.369098095s) [upload=17877]: Done uploading segments... Aug 9 10:35:38.410046611 (17h10m0.369143867s) [upload=17877]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.403827986s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [........X..........................X.X.......X..............] duration:
905.046313ms
FAIL (2025-08-09 11:00:12 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 9 10:48:27.285285809 (17h22m49.244383054s) [upload=18101]: Starting upload
Aug 9 10:48:27.285335971 (17h22m49.24443321s) [upload=18101]: Done starting upload
Aug 9 10:48:27.285402380 (17h22m49.244499619s) [upload=18101]: Uploading segments...
Aug 9 10:48:27.285447241 (17h22m49.244544494s) [upload=18101]: Got next segment. Inline: true
Aug 9 10:48:27.285453082 (17h22m49.244550326s) [upload=18101]: Waiting for error group managing segments...
Aug 9 10:48:27.285494392 (17h22m49.244591637s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 10:48:27.285499846 (17h22m49.244597082s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 9 10:48:27.285509862 (17h22m49.244607098s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 10:48:27.479866989 (17h22m49.438964255s) [upload=18101]: Done uploading segments...
Aug 9 10:48:27.479887363 (17h22m49.438984602s) [upload=18101]: Upload finished. err: <nil>
Duration: 905.074365ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [....X.................X...X.................................] duration:
2.328676115s
FAIL (2025-08-09 10:59:52 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 10:35:38.321148367 (17h10m0.280245612s) [upload=17877]: Starting upload Aug 9 10:35:38.321200893 (17h10m0.280298131s) [upload=17877]: Done starting upload Aug 9 10:35:38.321351423 (17h10m0.280448662s) [upload=17877]: Uploading segments... Aug 9 10:35:38.321453565 (17h10m0.28055081s) [upload=17877]: Got next segment. Inline: false Aug 9 10:35:38.321500503 (17h10m0.280597747s) [upload=17877]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 10:35:38.321505898 (17h10m0.280603143s) [upload=17877]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 10:35:38.409971617 (17h10m0.369068873s) [upload=17877]: Next segment err: metaclient: Too Many Requests Aug 9 10:35:38.410000840 (17h10m0.369098095s) [upload=17877]: Done uploading segments... Aug 9 10:35:38.410046611 (17h10m0.369143867s) [upload=17877]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.32871462s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.....X.................X...X................................] duration:
2.280473322s
FAIL (2025-08-09 10:59:25 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 10:35:38.321148367 (17h10m0.280245612s) [upload=17877]: Starting upload Aug 9 10:35:38.321200893 (17h10m0.280298131s) [upload=17877]: Done starting upload Aug 9 10:35:38.321351423 (17h10m0.280448662s) [upload=17877]: Uploading segments... Aug 9 10:35:38.321453565 (17h10m0.28055081s) [upload=17877]: Got next segment. Inline: false Aug 9 10:35:38.321500503 (17h10m0.280597747s) [upload=17877]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 10:35:38.321505898 (17h10m0.280603143s) [upload=17877]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 10:35:38.409971617 (17h10m0.369068873s) [upload=17877]: Next segment err: metaclient: Too Many Requests Aug 9 10:35:38.410000840 (17h10m0.369098095s) [upload=17877]: Done uploading segments... Aug 9 10:35:38.410046611 (17h10m0.369143867s) [upload=17877]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.280506043s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [.........X..........................X.X.......X.............] duration:
995.92234ms
FAIL (2025-08-09 10:59:11 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 9 10:48:27.285285809 (17h22m49.244383054s) [upload=18101]: Starting upload
Aug 9 10:48:27.285335971 (17h22m49.24443321s) [upload=18101]: Done starting upload
Aug 9 10:48:27.285402380 (17h22m49.244499619s) [upload=18101]: Uploading segments...
Aug 9 10:48:27.285447241 (17h22m49.244544494s) [upload=18101]: Got next segment. Inline: true
Aug 9 10:48:27.285453082 (17h22m49.244550326s) [upload=18101]: Waiting for error group managing segments...
Aug 9 10:48:27.285494392 (17h22m49.244591637s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 10:48:27.285499846 (17h22m49.244597082s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 9 10:48:27.285509862 (17h22m49.244607098s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 10:48:27.479866989 (17h22m49.438964255s) [upload=18101]: Done uploading segments...
Aug 9 10:48:27.479887363 (17h22m49.438984602s) [upload=18101]: Upload finished. err: <nil>
Duration: 995.951378ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [......X.................X...X...............................] duration:
2.3379711s
FAIL (2025-08-09 10:59:03 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 10:35:38.321148367 (17h10m0.280245612s) [upload=17877]: Starting upload Aug 9 10:35:38.321200893 (17h10m0.280298131s) [upload=17877]: Done starting upload Aug 9 10:35:38.321351423 (17h10m0.280448662s) [upload=17877]: Uploading segments... Aug 9 10:35:38.321453565 (17h10m0.28055081s) [upload=17877]: Got next segment. Inline: false Aug 9 10:35:38.321500503 (17h10m0.280597747s) [upload=17877]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 10:35:38.321505898 (17h10m0.280603143s) [upload=17877]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 10:35:38.409971617 (17h10m0.369068873s) [upload=17877]: Next segment err: metaclient: Too Many Requests Aug 9 10:35:38.410000840 (17h10m0.369098095s) [upload=17877]: Done uploading segments... Aug 9 10:35:38.410046611 (17h10m0.369143867s) [upload=17877]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.338009423s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.......X.................X...X..............................] duration:
2.35199959s
FAIL (2025-08-09 10:58:26 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 10:35:38.321148367 (17h10m0.280245612s) [upload=17877]: Starting upload Aug 9 10:35:38.321200893 (17h10m0.280298131s) [upload=17877]: Done starting upload Aug 9 10:35:38.321351423 (17h10m0.280448662s) [upload=17877]: Uploading segments... Aug 9 10:35:38.321453565 (17h10m0.28055081s) [upload=17877]: Got next segment. Inline: false Aug 9 10:35:38.321500503 (17h10m0.280597747s) [upload=17877]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 10:35:38.321505898 (17h10m0.280603143s) [upload=17877]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 10:35:38.409971617 (17h10m0.369068873s) [upload=17877]: Next segment err: metaclient: Too Many Requests Aug 9 10:35:38.410000840 (17h10m0.369098095s) [upload=17877]: Done uploading segments... Aug 9 10:35:38.410046611 (17h10m0.369143867s) [upload=17877]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.352030164s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [..........X..........................X.X.......X............] duration:
844.891245ms
FAIL (2025-08-09 10:58:18 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 9 10:48:27.285285809 (17h22m49.244383054s) [upload=18101]: Starting upload
Aug 9 10:48:27.285335971 (17h22m49.24443321s) [upload=18101]: Done starting upload
Aug 9 10:48:27.285402380 (17h22m49.244499619s) [upload=18101]: Uploading segments...
Aug 9 10:48:27.285447241 (17h22m49.244544494s) [upload=18101]: Got next segment. Inline: true
Aug 9 10:48:27.285453082 (17h22m49.244550326s) [upload=18101]: Waiting for error group managing segments...
Aug 9 10:48:27.285494392 (17h22m49.244591637s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 10:48:27.285499846 (17h22m49.244597082s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 9 10:48:27.285509862 (17h22m49.244607098s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 10:48:27.479866989 (17h22m49.438964255s) [upload=18101]: Done uploading segments...
Aug 9 10:48:27.479887363 (17h22m49.438984602s) [upload=18101]: Upload finished. err: <nil>
Duration: 844.918881ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [........X.................X...X.............................] duration:
2.484786914s
FAIL (2025-08-09 10:58:02 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 10:35:38.321148367 (17h10m0.280245612s) [upload=17877]: Starting upload Aug 9 10:35:38.321200893 (17h10m0.280298131s) [upload=17877]: Done starting upload Aug 9 10:35:38.321351423 (17h10m0.280448662s) [upload=17877]: Uploading segments... Aug 9 10:35:38.321453565 (17h10m0.28055081s) [upload=17877]: Got next segment. Inline: false Aug 9 10:35:38.321500503 (17h10m0.280597747s) [upload=17877]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 10:35:38.321505898 (17h10m0.280603143s) [upload=17877]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 10:35:38.409971617 (17h10m0.369068873s) [upload=17877]: Next segment err: metaclient: Too Many Requests Aug 9 10:35:38.410000840 (17h10m0.369098095s) [upload=17877]: Done uploading segments... Aug 9 10:35:38.410046611 (17h10m0.369143867s) [upload=17877]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.484838115s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........X.................X...X............................] duration:
2.463284178s
FAIL (2025-08-09 10:57:32 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 10:35:38.321148367 (17h10m0.280245612s) [upload=17877]: Starting upload Aug 9 10:35:38.321200893 (17h10m0.280298131s) [upload=17877]: Done starting upload Aug 9 10:35:38.321351423 (17h10m0.280448662s) [upload=17877]: Uploading segments... Aug 9 10:35:38.321453565 (17h10m0.28055081s) [upload=17877]: Got next segment. Inline: false Aug 9 10:35:38.321500503 (17h10m0.280597747s) [upload=17877]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 10:35:38.321505898 (17h10m0.280603143s) [upload=17877]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 10:35:38.409971617 (17h10m0.369068873s) [upload=17877]: Next segment err: metaclient: Too Many Requests Aug 9 10:35:38.410000840 (17h10m0.369098095s) [upload=17877]: Done uploading segments... Aug 9 10:35:38.410046611 (17h10m0.369143867s) [upload=17877]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.463312388s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
4 out of 60 is failed (threshold=3) [...........X..........................X.X.......X...........] duration:
911.016619ms
FAIL (2025-08-09 10:57:22 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/1K")
======LOGS======
Aug 9 10:48:27.285285809 (17h22m49.244383054s) [upload=18101]: Starting upload
Aug 9 10:48:27.285335971 (17h22m49.24443321s) [upload=18101]: Done starting upload
Aug 9 10:48:27.285402380 (17h22m49.244499619s) [upload=18101]: Uploading segments...
Aug 9 10:48:27.285447241 (17h22m49.244544494s) [upload=18101]: Got next segment. Inline: true
Aug 9 10:48:27.285453082 (17h22m49.244550326s) [upload=18101]: Waiting for error group managing segments...
Aug 9 10:48:27.285494392 (17h22m49.244591637s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 9 10:48:27.285499846 (17h22m49.244597082s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 9 10:48:27.285509862 (17h22m49.244607098s) [upload=18101]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 9 10:48:27.479866989 (17h22m49.438964255s) [upload=18101]: Done uploading segments...
Aug 9 10:48:27.479887363 (17h22m49.438984602s) [upload=18101]: Upload finished. err: <nil>
Duration: 911.043927ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........X.................X...X...........................] duration:
2.441998642s
FAIL (2025-08-09 10:57:06 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 9 10:35:38.321148367 (17h10m0.280245612s) [upload=17877]: Starting upload Aug 9 10:35:38.321200893 (17h10m0.280298131s) [upload=17877]: Done starting upload Aug 9 10:35:38.321351423 (17h10m0.280448662s) [upload=17877]: Uploading segments... Aug 9 10:35:38.321453565 (17h10m0.28055081s) [upload=17877]: Got next segment. Inline: false Aug 9 10:35:38.321500503 (17h10m0.280597747s) [upload=17877]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 9 10:35:38.321505898 (17h10m0.280603143s) [upload=17877]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 9 10:35:38.409971617 (17h10m0.369068873s) [upload=17877]: Next segment err: metaclient: Too Many Requests Aug 9 10:35:38.410000840 (17h10m0.369098095s) [upload=17877]: Done uploading segments... Aug 9 10:35:38.410046611 (17h10m0.369143867s) [upload=17877]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.44203084s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|