Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
897.178911ms
FAIL (2025-08-13 16:20:09 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 15:52:37.423060541 (118h26m59.382157787s) [upload=123422]: Starting upload Aug 13 15:52:37.423131152 (118h26m59.382228397s) [upload=123422]: Done starting upload Aug 13 15:52:37.423247351 (118h26m59.382344585s) [upload=123422]: Uploading segments... Aug 13 15:52:37.423394744 (118h26m59.382491998s) [upload=123422]: Got next segment. Inline: true Aug 13 15:52:37.423414806 (118h26m59.38251206s) [upload=123422]: Waiting for error group managing segments... Aug 13 15:52:37.423497026 (118h26m59.382594281s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 15:52:37.423504013 (118h26m59.382601268s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 15:52:37.423508338 (118h26m59.38260559s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 15:52:37.512170488 (118h26m59.471267736s) [upload=123422]: Done uploading segments... Aug 13 15:52:37.512189314 (118h26m59.471286551s) [upload=123422]: Upload finished. err: metaclient: Too Many Requests
Duration: 897.213689ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [...........XX.....X.......X....X....X.......................] duration:
2.359952889s
FAIL (2025-08-13 16:19:39 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 16:01:55.740236569 (118h36m17.699333823s) [upload=123579]: Starting upload
Aug 13 16:01:55.740313857 (118h36m17.699411124s) [upload=123579]: Done starting upload
Aug 13 16:01:55.740738444 (118h36m17.699835697s) [upload=123579]: Uploading segments...
Aug 13 16:01:55.740814721 (118h36m17.699911976s) [upload=123579]: Got next segment. Inline: false
Aug 13 16:01:55.740869673 (118h36m17.699966933s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 16:01:55.740876857 (118h36m17.699974112s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 16:01:55.981812059 (118h36m17.940909336s) [seg_pos={0 0}, upload=123579]: Begin upload segment...
Aug 13 16:01:55.981895391 (118h36m17.940992669s) [seg_pos={0 0}, upload=123579]: Done begin upload segment.
Aug 13 16:01:55.981975453 (118h36m17.941072708s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982056793 (118h36m17.941154065s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982487161 (118h36m17.94158441s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982609215 (118h36m17.94170647s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982789408 (118h36m17.941886656s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983072248 (118h36m17.942169496s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983083057 (118h36m17.942180312s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983354911 (118h36m17.942452157s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983514251 (118h36m17.942611518s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983643753 (118h36m17.942740987s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984072147 (118h36m17.943169404s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984099587 (118h36m17.943196843s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984474849 (118h36m17.943572101s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984523663 (118h36m17.94362092s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984999396 (118h36m17.944096654s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985431509 (118h36m17.944528767s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985836559 (118h36m17.944933814s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.986258205 (118h36m17.945355464s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:56.559658395 (118h36m18.518755642s) [upload=123579]: Next returned nil segment
Aug 13 16:01:56.559698013 (118h36m18.518795264s) [upload=123579]: Waiting for error group managing segments...
Aug 13 16:01:56.721763441 (118h36m18.680860673s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.727530195 (118h36m18.686627432s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.728285184 (118h36m18.68738242s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.736592730 (118h36m18.695689969s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.738386040 (118h36m18.697483276s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.739597394 (118h36m18.698694629s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.755620356 (118h36m18.714717595s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.759300012 (118h36m18.718397252s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.768417366 (118h36m18.727514619s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.773802478 (118h36m18.732899731s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.878542305 (118h36m18.83763954s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.914318972 (118h36m18.873416228s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.973490398 (118h36m18.932587643s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980598540 (118h36m18.939695779s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980632061 (118h36m18.939729307s) [seg_pos={0 0}, upload=123579]: Segment reached optimal threshold of 14 pieces.
Aug 13 16:01:56.980949418 (118h36m18.940046652s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981054858 (118h36m18.940152105s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection
Aug 13 16:01:56.981078543 (118h36m18.940175775s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection
Aug 13 16:01:56.981090831 (118h36m18.940188062s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c3M8p1BgTVe9F8XUmwE2F8raje9keFzAiDE5TepKTMFDxdR2Q): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981102502 (118h36m18.940199734s) [seg_pos={0 0}, upload=123579]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 16:01:56.981216904 (118h36m18.940314153s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 16:01:56.981221931 (118h36m18.940319163s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 16:01:57.268808250 (118h36m19.227905483s) [upload=123579]: Done uploading segments...
Aug 13 16:01:57.268833635 (118h36m19.227930881s) [upload=123579]: Upload finished. err: <nil>
Duration: 2.359985875s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [............XX.....X.......X....X....X......................] duration:
2.536676908s
FAIL (2025-08-13 16:19:19 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 16:01:55.740236569 (118h36m17.699333823s) [upload=123579]: Starting upload
Aug 13 16:01:55.740313857 (118h36m17.699411124s) [upload=123579]: Done starting upload
Aug 13 16:01:55.740738444 (118h36m17.699835697s) [upload=123579]: Uploading segments...
Aug 13 16:01:55.740814721 (118h36m17.699911976s) [upload=123579]: Got next segment. Inline: false
Aug 13 16:01:55.740869673 (118h36m17.699966933s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 16:01:55.740876857 (118h36m17.699974112s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 16:01:55.981812059 (118h36m17.940909336s) [seg_pos={0 0}, upload=123579]: Begin upload segment...
Aug 13 16:01:55.981895391 (118h36m17.940992669s) [seg_pos={0 0}, upload=123579]: Done begin upload segment.
Aug 13 16:01:55.981975453 (118h36m17.941072708s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982056793 (118h36m17.941154065s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982487161 (118h36m17.94158441s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982609215 (118h36m17.94170647s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982789408 (118h36m17.941886656s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983072248 (118h36m17.942169496s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983083057 (118h36m17.942180312s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983354911 (118h36m17.942452157s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983514251 (118h36m17.942611518s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983643753 (118h36m17.942740987s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984072147 (118h36m17.943169404s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984099587 (118h36m17.943196843s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984474849 (118h36m17.943572101s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984523663 (118h36m17.94362092s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984999396 (118h36m17.944096654s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985431509 (118h36m17.944528767s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985836559 (118h36m17.944933814s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.986258205 (118h36m17.945355464s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:56.559658395 (118h36m18.518755642s) [upload=123579]: Next returned nil segment
Aug 13 16:01:56.559698013 (118h36m18.518795264s) [upload=123579]: Waiting for error group managing segments...
Aug 13 16:01:56.721763441 (118h36m18.680860673s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.727530195 (118h36m18.686627432s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.728285184 (118h36m18.68738242s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.736592730 (118h36m18.695689969s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.738386040 (118h36m18.697483276s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.739597394 (118h36m18.698694629s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.755620356 (118h36m18.714717595s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.759300012 (118h36m18.718397252s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.768417366 (118h36m18.727514619s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.773802478 (118h36m18.732899731s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.878542305 (118h36m18.83763954s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.914318972 (118h36m18.873416228s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.973490398 (118h36m18.932587643s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980598540 (118h36m18.939695779s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980632061 (118h36m18.939729307s) [seg_pos={0 0}, upload=123579]: Segment reached optimal threshold of 14 pieces.
Aug 13 16:01:56.980949418 (118h36m18.940046652s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981054858 (118h36m18.940152105s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection
Aug 13 16:01:56.981078543 (118h36m18.940175775s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection
Aug 13 16:01:56.981090831 (118h36m18.940188062s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c3M8p1BgTVe9F8XUmwE2F8raje9keFzAiDE5TepKTMFDxdR2Q): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981102502 (118h36m18.940199734s) [seg_pos={0 0}, upload=123579]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 16:01:56.981216904 (118h36m18.940314153s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 16:01:56.981221931 (118h36m18.940319163s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 16:01:57.268808250 (118h36m19.227905483s) [upload=123579]: Done uploading segments...
Aug 13 16:01:57.268833635 (118h36m19.227930881s) [upload=123579]: Upload finished. err: <nil>
Duration: 2.536720953s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
901.618154ms
FAIL (2025-08-13 16:18:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 15:52:37.423060541 (118h26m59.382157787s) [upload=123422]: Starting upload Aug 13 15:52:37.423131152 (118h26m59.382228397s) [upload=123422]: Done starting upload Aug 13 15:52:37.423247351 (118h26m59.382344585s) [upload=123422]: Uploading segments... Aug 13 15:52:37.423394744 (118h26m59.382491998s) [upload=123422]: Got next segment. Inline: true Aug 13 15:52:37.423414806 (118h26m59.38251206s) [upload=123422]: Waiting for error group managing segments... Aug 13 15:52:37.423497026 (118h26m59.382594281s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 15:52:37.423504013 (118h26m59.382601268s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 15:52:37.423508338 (118h26m59.38260559s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 15:52:37.512170488 (118h26m59.471267736s) [upload=123422]: Done uploading segments... Aug 13 15:52:37.512189314 (118h26m59.471286551s) [upload=123422]: Upload finished. err: metaclient: Too Many Requests
Duration: 901.703403ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
900.562131ms
FAIL (2025-08-13 16:18:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 15:52:37.423060541 (118h26m59.382157787s) [upload=123422]: Starting upload Aug 13 15:52:37.423131152 (118h26m59.382228397s) [upload=123422]: Done starting upload Aug 13 15:52:37.423247351 (118h26m59.382344585s) [upload=123422]: Uploading segments... Aug 13 15:52:37.423394744 (118h26m59.382491998s) [upload=123422]: Got next segment. Inline: true Aug 13 15:52:37.423414806 (118h26m59.38251206s) [upload=123422]: Waiting for error group managing segments... Aug 13 15:52:37.423497026 (118h26m59.382594281s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 15:52:37.423504013 (118h26m59.382601268s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 15:52:37.423508338 (118h26m59.38260559s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 15:52:37.512170488 (118h26m59.471267736s) [upload=123422]: Done uploading segments... Aug 13 15:52:37.512189314 (118h26m59.471286551s) [upload=123422]: Upload finished. err: metaclient: Too Many Requests
Duration: 900.597138ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.............XX.....X.......X....X....X.....................] duration:
2.466177152s
FAIL (2025-08-13 16:18:11 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 16:01:55.740236569 (118h36m17.699333823s) [upload=123579]: Starting upload
Aug 13 16:01:55.740313857 (118h36m17.699411124s) [upload=123579]: Done starting upload
Aug 13 16:01:55.740738444 (118h36m17.699835697s) [upload=123579]: Uploading segments...
Aug 13 16:01:55.740814721 (118h36m17.699911976s) [upload=123579]: Got next segment. Inline: false
Aug 13 16:01:55.740869673 (118h36m17.699966933s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 16:01:55.740876857 (118h36m17.699974112s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 16:01:55.981812059 (118h36m17.940909336s) [seg_pos={0 0}, upload=123579]: Begin upload segment...
Aug 13 16:01:55.981895391 (118h36m17.940992669s) [seg_pos={0 0}, upload=123579]: Done begin upload segment.
Aug 13 16:01:55.981975453 (118h36m17.941072708s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982056793 (118h36m17.941154065s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982487161 (118h36m17.94158441s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982609215 (118h36m17.94170647s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982789408 (118h36m17.941886656s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983072248 (118h36m17.942169496s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983083057 (118h36m17.942180312s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983354911 (118h36m17.942452157s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983514251 (118h36m17.942611518s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983643753 (118h36m17.942740987s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984072147 (118h36m17.943169404s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984099587 (118h36m17.943196843s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984474849 (118h36m17.943572101s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984523663 (118h36m17.94362092s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984999396 (118h36m17.944096654s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985431509 (118h36m17.944528767s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985836559 (118h36m17.944933814s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.986258205 (118h36m17.945355464s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:56.559658395 (118h36m18.518755642s) [upload=123579]: Next returned nil segment
Aug 13 16:01:56.559698013 (118h36m18.518795264s) [upload=123579]: Waiting for error group managing segments...
Aug 13 16:01:56.721763441 (118h36m18.680860673s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.727530195 (118h36m18.686627432s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.728285184 (118h36m18.68738242s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.736592730 (118h36m18.695689969s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.738386040 (118h36m18.697483276s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.739597394 (118h36m18.698694629s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.755620356 (118h36m18.714717595s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.759300012 (118h36m18.718397252s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.768417366 (118h36m18.727514619s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.773802478 (118h36m18.732899731s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.878542305 (118h36m18.83763954s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.914318972 (118h36m18.873416228s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.973490398 (118h36m18.932587643s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980598540 (118h36m18.939695779s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980632061 (118h36m18.939729307s) [seg_pos={0 0}, upload=123579]: Segment reached optimal threshold of 14 pieces.
Aug 13 16:01:56.980949418 (118h36m18.940046652s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981054858 (118h36m18.940152105s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection
Aug 13 16:01:56.981078543 (118h36m18.940175775s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection
Aug 13 16:01:56.981090831 (118h36m18.940188062s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c3M8p1BgTVe9F8XUmwE2F8raje9keFzAiDE5TepKTMFDxdR2Q): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981102502 (118h36m18.940199734s) [seg_pos={0 0}, upload=123579]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 16:01:56.981216904 (118h36m18.940314153s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 16:01:56.981221931 (118h36m18.940319163s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 16:01:57.268808250 (118h36m19.227905483s) [upload=123579]: Done uploading segments...
Aug 13 16:01:57.268833635 (118h36m19.227930881s) [upload=123579]: Upload finished. err: <nil>
Duration: 2.466211022s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
912.945714ms
FAIL (2025-08-13 16:17:44 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 15:52:37.423060541 (118h26m59.382157787s) [upload=123422]: Starting upload Aug 13 15:52:37.423131152 (118h26m59.382228397s) [upload=123422]: Done starting upload Aug 13 15:52:37.423247351 (118h26m59.382344585s) [upload=123422]: Uploading segments... Aug 13 15:52:37.423394744 (118h26m59.382491998s) [upload=123422]: Got next segment. Inline: true Aug 13 15:52:37.423414806 (118h26m59.38251206s) [upload=123422]: Waiting for error group managing segments... Aug 13 15:52:37.423497026 (118h26m59.382594281s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 15:52:37.423504013 (118h26m59.382601268s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 15:52:37.423508338 (118h26m59.38260559s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 15:52:37.512170488 (118h26m59.471267736s) [upload=123422]: Done uploading segments... Aug 13 15:52:37.512189314 (118h26m59.471286551s) [upload=123422]: Upload finished. err: metaclient: Too Many Requests
Duration: 912.980113ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
951.765092ms
FAIL (2025-08-13 16:17:27 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 15:52:37.423060541 (118h26m59.382157787s) [upload=123422]: Starting upload Aug 13 15:52:37.423131152 (118h26m59.382228397s) [upload=123422]: Done starting upload Aug 13 15:52:37.423247351 (118h26m59.382344585s) [upload=123422]: Uploading segments... Aug 13 15:52:37.423394744 (118h26m59.382491998s) [upload=123422]: Got next segment. Inline: true Aug 13 15:52:37.423414806 (118h26m59.38251206s) [upload=123422]: Waiting for error group managing segments... Aug 13 15:52:37.423497026 (118h26m59.382594281s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 15:52:37.423504013 (118h26m59.382601268s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 15:52:37.423508338 (118h26m59.38260559s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 15:52:37.512170488 (118h26m59.471267736s) [upload=123422]: Done uploading segments... Aug 13 15:52:37.512189314 (118h26m59.471286551s) [upload=123422]: Upload finished. err: metaclient: Too Many Requests
Duration: 951.811076ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [..............XX.....X.......X....X....X....................] duration:
2.582833538s
FAIL (2025-08-13 16:17:01 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 16:01:55.740236569 (118h36m17.699333823s) [upload=123579]: Starting upload
Aug 13 16:01:55.740313857 (118h36m17.699411124s) [upload=123579]: Done starting upload
Aug 13 16:01:55.740738444 (118h36m17.699835697s) [upload=123579]: Uploading segments...
Aug 13 16:01:55.740814721 (118h36m17.699911976s) [upload=123579]: Got next segment. Inline: false
Aug 13 16:01:55.740869673 (118h36m17.699966933s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 16:01:55.740876857 (118h36m17.699974112s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 16:01:55.981812059 (118h36m17.940909336s) [seg_pos={0 0}, upload=123579]: Begin upload segment...
Aug 13 16:01:55.981895391 (118h36m17.940992669s) [seg_pos={0 0}, upload=123579]: Done begin upload segment.
Aug 13 16:01:55.981975453 (118h36m17.941072708s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982056793 (118h36m17.941154065s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982487161 (118h36m17.94158441s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982609215 (118h36m17.94170647s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982789408 (118h36m17.941886656s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983072248 (118h36m17.942169496s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983083057 (118h36m17.942180312s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983354911 (118h36m17.942452157s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983514251 (118h36m17.942611518s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983643753 (118h36m17.942740987s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984072147 (118h36m17.943169404s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984099587 (118h36m17.943196843s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984474849 (118h36m17.943572101s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984523663 (118h36m17.94362092s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984999396 (118h36m17.944096654s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985431509 (118h36m17.944528767s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985836559 (118h36m17.944933814s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.986258205 (118h36m17.945355464s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:56.559658395 (118h36m18.518755642s) [upload=123579]: Next returned nil segment
Aug 13 16:01:56.559698013 (118h36m18.518795264s) [upload=123579]: Waiting for error group managing segments...
Aug 13 16:01:56.721763441 (118h36m18.680860673s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.727530195 (118h36m18.686627432s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.728285184 (118h36m18.68738242s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.736592730 (118h36m18.695689969s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.738386040 (118h36m18.697483276s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.739597394 (118h36m18.698694629s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.755620356 (118h36m18.714717595s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.759300012 (118h36m18.718397252s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.768417366 (118h36m18.727514619s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.773802478 (118h36m18.732899731s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.878542305 (118h36m18.83763954s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.914318972 (118h36m18.873416228s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.973490398 (118h36m18.932587643s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980598540 (118h36m18.939695779s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980632061 (118h36m18.939729307s) [seg_pos={0 0}, upload=123579]: Segment reached optimal threshold of 14 pieces.
Aug 13 16:01:56.980949418 (118h36m18.940046652s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981054858 (118h36m18.940152105s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection
Aug 13 16:01:56.981078543 (118h36m18.940175775s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection
Aug 13 16:01:56.981090831 (118h36m18.940188062s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c3M8p1BgTVe9F8XUmwE2F8raje9keFzAiDE5TepKTMFDxdR2Q): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981102502 (118h36m18.940199734s) [seg_pos={0 0}, upload=123579]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 16:01:56.981216904 (118h36m18.940314153s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 16:01:56.981221931 (118h36m18.940319163s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 16:01:57.268808250 (118h36m19.227905483s) [upload=123579]: Done uploading segments...
Aug 13 16:01:57.268833635 (118h36m19.227930881s) [upload=123579]: Upload finished. err: <nil>
Duration: 2.582873518s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
889.740339ms
FAIL (2025-08-13 16:16:33 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 15:52:37.423060541 (118h26m59.382157787s) [upload=123422]: Starting upload Aug 13 15:52:37.423131152 (118h26m59.382228397s) [upload=123422]: Done starting upload Aug 13 15:52:37.423247351 (118h26m59.382344585s) [upload=123422]: Uploading segments... Aug 13 15:52:37.423394744 (118h26m59.382491998s) [upload=123422]: Got next segment. Inline: true Aug 13 15:52:37.423414806 (118h26m59.38251206s) [upload=123422]: Waiting for error group managing segments... Aug 13 15:52:37.423497026 (118h26m59.382594281s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 15:52:37.423504013 (118h26m59.382601268s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 15:52:37.423508338 (118h26m59.38260559s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 15:52:37.512170488 (118h26m59.471267736s) [upload=123422]: Done uploading segments... Aug 13 15:52:37.512189314 (118h26m59.471286551s) [upload=123422]: Upload finished. err: metaclient: Too Many Requests
Duration: 889.779724ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [...............XX.....X.......X....X....X...................] duration:
2.576063318s
FAIL (2025-08-13 16:16:14 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 16:01:55.740236569 (118h36m17.699333823s) [upload=123579]: Starting upload
Aug 13 16:01:55.740313857 (118h36m17.699411124s) [upload=123579]: Done starting upload
Aug 13 16:01:55.740738444 (118h36m17.699835697s) [upload=123579]: Uploading segments...
Aug 13 16:01:55.740814721 (118h36m17.699911976s) [upload=123579]: Got next segment. Inline: false
Aug 13 16:01:55.740869673 (118h36m17.699966933s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 16:01:55.740876857 (118h36m17.699974112s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 16:01:55.981812059 (118h36m17.940909336s) [seg_pos={0 0}, upload=123579]: Begin upload segment...
Aug 13 16:01:55.981895391 (118h36m17.940992669s) [seg_pos={0 0}, upload=123579]: Done begin upload segment.
Aug 13 16:01:55.981975453 (118h36m17.941072708s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982056793 (118h36m17.941154065s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982487161 (118h36m17.94158441s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982609215 (118h36m17.94170647s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982789408 (118h36m17.941886656s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983072248 (118h36m17.942169496s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983083057 (118h36m17.942180312s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983354911 (118h36m17.942452157s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983514251 (118h36m17.942611518s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983643753 (118h36m17.942740987s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984072147 (118h36m17.943169404s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984099587 (118h36m17.943196843s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984474849 (118h36m17.943572101s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984523663 (118h36m17.94362092s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984999396 (118h36m17.944096654s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985431509 (118h36m17.944528767s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985836559 (118h36m17.944933814s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.986258205 (118h36m17.945355464s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:56.559658395 (118h36m18.518755642s) [upload=123579]: Next returned nil segment
Aug 13 16:01:56.559698013 (118h36m18.518795264s) [upload=123579]: Waiting for error group managing segments...
Aug 13 16:01:56.721763441 (118h36m18.680860673s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.727530195 (118h36m18.686627432s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.728285184 (118h36m18.68738242s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.736592730 (118h36m18.695689969s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.738386040 (118h36m18.697483276s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.739597394 (118h36m18.698694629s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.755620356 (118h36m18.714717595s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.759300012 (118h36m18.718397252s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.768417366 (118h36m18.727514619s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.773802478 (118h36m18.732899731s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.878542305 (118h36m18.83763954s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.914318972 (118h36m18.873416228s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.973490398 (118h36m18.932587643s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980598540 (118h36m18.939695779s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980632061 (118h36m18.939729307s) [seg_pos={0 0}, upload=123579]: Segment reached optimal threshold of 14 pieces.
Aug 13 16:01:56.980949418 (118h36m18.940046652s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981054858 (118h36m18.940152105s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection
Aug 13 16:01:56.981078543 (118h36m18.940175775s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection
Aug 13 16:01:56.981090831 (118h36m18.940188062s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c3M8p1BgTVe9F8XUmwE2F8raje9keFzAiDE5TepKTMFDxdR2Q): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981102502 (118h36m18.940199734s) [seg_pos={0 0}, upload=123579]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 16:01:56.981216904 (118h36m18.940314153s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 16:01:56.981221931 (118h36m18.940319163s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 16:01:57.268808250 (118h36m19.227905483s) [upload=123579]: Done uploading segments...
Aug 13 16:01:57.268833635 (118h36m19.227930881s) [upload=123579]: Upload finished. err: <nil>
Duration: 2.576100735s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
862.316116ms
FAIL (2025-08-13 16:15:45 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 15:52:37.423060541 (118h26m59.382157787s) [upload=123422]: Starting upload Aug 13 15:52:37.423131152 (118h26m59.382228397s) [upload=123422]: Done starting upload Aug 13 15:52:37.423247351 (118h26m59.382344585s) [upload=123422]: Uploading segments... Aug 13 15:52:37.423394744 (118h26m59.382491998s) [upload=123422]: Got next segment. Inline: true Aug 13 15:52:37.423414806 (118h26m59.38251206s) [upload=123422]: Waiting for error group managing segments... Aug 13 15:52:37.423497026 (118h26m59.382594281s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 15:52:37.423504013 (118h26m59.382601268s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 15:52:37.423508338 (118h26m59.38260559s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 15:52:37.512170488 (118h26m59.471267736s) [upload=123422]: Done uploading segments... Aug 13 15:52:37.512189314 (118h26m59.471286551s) [upload=123422]: Upload finished. err: metaclient: Too Many Requests
Duration: 862.345165ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [................XX.....X.......X....X....X..................] duration:
2.481641779s
FAIL (2025-08-13 16:15:21 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 16:01:55.740236569 (118h36m17.699333823s) [upload=123579]: Starting upload
Aug 13 16:01:55.740313857 (118h36m17.699411124s) [upload=123579]: Done starting upload
Aug 13 16:01:55.740738444 (118h36m17.699835697s) [upload=123579]: Uploading segments...
Aug 13 16:01:55.740814721 (118h36m17.699911976s) [upload=123579]: Got next segment. Inline: false
Aug 13 16:01:55.740869673 (118h36m17.699966933s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 16:01:55.740876857 (118h36m17.699974112s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 16:01:55.981812059 (118h36m17.940909336s) [seg_pos={0 0}, upload=123579]: Begin upload segment...
Aug 13 16:01:55.981895391 (118h36m17.940992669s) [seg_pos={0 0}, upload=123579]: Done begin upload segment.
Aug 13 16:01:55.981975453 (118h36m17.941072708s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982056793 (118h36m17.941154065s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982487161 (118h36m17.94158441s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982609215 (118h36m17.94170647s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982789408 (118h36m17.941886656s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983072248 (118h36m17.942169496s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983083057 (118h36m17.942180312s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983354911 (118h36m17.942452157s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983514251 (118h36m17.942611518s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983643753 (118h36m17.942740987s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984072147 (118h36m17.943169404s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984099587 (118h36m17.943196843s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984474849 (118h36m17.943572101s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984523663 (118h36m17.94362092s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984999396 (118h36m17.944096654s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985431509 (118h36m17.944528767s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985836559 (118h36m17.944933814s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.986258205 (118h36m17.945355464s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:56.559658395 (118h36m18.518755642s) [upload=123579]: Next returned nil segment
Aug 13 16:01:56.559698013 (118h36m18.518795264s) [upload=123579]: Waiting for error group managing segments...
Aug 13 16:01:56.721763441 (118h36m18.680860673s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.727530195 (118h36m18.686627432s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.728285184 (118h36m18.68738242s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.736592730 (118h36m18.695689969s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.738386040 (118h36m18.697483276s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.739597394 (118h36m18.698694629s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.755620356 (118h36m18.714717595s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.759300012 (118h36m18.718397252s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.768417366 (118h36m18.727514619s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.773802478 (118h36m18.732899731s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.878542305 (118h36m18.83763954s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.914318972 (118h36m18.873416228s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.973490398 (118h36m18.932587643s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980598540 (118h36m18.939695779s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980632061 (118h36m18.939729307s) [seg_pos={0 0}, upload=123579]: Segment reached optimal threshold of 14 pieces.
Aug 13 16:01:56.980949418 (118h36m18.940046652s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981054858 (118h36m18.940152105s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection
Aug 13 16:01:56.981078543 (118h36m18.940175775s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection
Aug 13 16:01:56.981090831 (118h36m18.940188062s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c3M8p1BgTVe9F8XUmwE2F8raje9keFzAiDE5TepKTMFDxdR2Q): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981102502 (118h36m18.940199734s) [seg_pos={0 0}, upload=123579]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 16:01:56.981216904 (118h36m18.940314153s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 16:01:56.981221931 (118h36m18.940319163s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 16:01:57.268808250 (118h36m19.227905483s) [upload=123579]: Done uploading segments...
Aug 13 16:01:57.268833635 (118h36m19.227930881s) [upload=123579]: Upload finished. err: <nil>
Duration: 2.481709819s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.................XX.....X.......X....X....X.................] duration:
2.520015704s
FAIL (2025-08-13 16:14:53 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 16:01:55.740236569 (118h36m17.699333823s) [upload=123579]: Starting upload
Aug 13 16:01:55.740313857 (118h36m17.699411124s) [upload=123579]: Done starting upload
Aug 13 16:01:55.740738444 (118h36m17.699835697s) [upload=123579]: Uploading segments...
Aug 13 16:01:55.740814721 (118h36m17.699911976s) [upload=123579]: Got next segment. Inline: false
Aug 13 16:01:55.740869673 (118h36m17.699966933s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 16:01:55.740876857 (118h36m17.699974112s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 16:01:55.981812059 (118h36m17.940909336s) [seg_pos={0 0}, upload=123579]: Begin upload segment...
Aug 13 16:01:55.981895391 (118h36m17.940992669s) [seg_pos={0 0}, upload=123579]: Done begin upload segment.
Aug 13 16:01:55.981975453 (118h36m17.941072708s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982056793 (118h36m17.941154065s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982487161 (118h36m17.94158441s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982609215 (118h36m17.94170647s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982789408 (118h36m17.941886656s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983072248 (118h36m17.942169496s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983083057 (118h36m17.942180312s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983354911 (118h36m17.942452157s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983514251 (118h36m17.942611518s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983643753 (118h36m17.942740987s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984072147 (118h36m17.943169404s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984099587 (118h36m17.943196843s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984474849 (118h36m17.943572101s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984523663 (118h36m17.94362092s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984999396 (118h36m17.944096654s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985431509 (118h36m17.944528767s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985836559 (118h36m17.944933814s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.986258205 (118h36m17.945355464s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:56.559658395 (118h36m18.518755642s) [upload=123579]: Next returned nil segment
Aug 13 16:01:56.559698013 (118h36m18.518795264s) [upload=123579]: Waiting for error group managing segments...
Aug 13 16:01:56.721763441 (118h36m18.680860673s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.727530195 (118h36m18.686627432s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.728285184 (118h36m18.68738242s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.736592730 (118h36m18.695689969s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.738386040 (118h36m18.697483276s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.739597394 (118h36m18.698694629s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.755620356 (118h36m18.714717595s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.759300012 (118h36m18.718397252s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.768417366 (118h36m18.727514619s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.773802478 (118h36m18.732899731s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.878542305 (118h36m18.83763954s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.914318972 (118h36m18.873416228s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.973490398 (118h36m18.932587643s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980598540 (118h36m18.939695779s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980632061 (118h36m18.939729307s) [seg_pos={0 0}, upload=123579]: Segment reached optimal threshold of 14 pieces.
Aug 13 16:01:56.980949418 (118h36m18.940046652s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981054858 (118h36m18.940152105s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection
Aug 13 16:01:56.981078543 (118h36m18.940175775s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection
Aug 13 16:01:56.981090831 (118h36m18.940188062s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c3M8p1BgTVe9F8XUmwE2F8raje9keFzAiDE5TepKTMFDxdR2Q): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981102502 (118h36m18.940199734s) [seg_pos={0 0}, upload=123579]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 16:01:56.981216904 (118h36m18.940314153s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 16:01:56.981221931 (118h36m18.940319163s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 16:01:57.268808250 (118h36m19.227905483s) [upload=123579]: Done uploading segments...
Aug 13 16:01:57.268833635 (118h36m19.227930881s) [upload=123579]: Upload finished. err: <nil>
Duration: 2.520047658s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
1.147470882s
FAIL (2025-08-13 16:14:53 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 15:52:37.423060541 (118h26m59.382157787s) [upload=123422]: Starting upload Aug 13 15:52:37.423131152 (118h26m59.382228397s) [upload=123422]: Done starting upload Aug 13 15:52:37.423247351 (118h26m59.382344585s) [upload=123422]: Uploading segments... Aug 13 15:52:37.423394744 (118h26m59.382491998s) [upload=123422]: Got next segment. Inline: true Aug 13 15:52:37.423414806 (118h26m59.38251206s) [upload=123422]: Waiting for error group managing segments... Aug 13 15:52:37.423497026 (118h26m59.382594281s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 15:52:37.423504013 (118h26m59.382601268s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 15:52:37.423508338 (118h26m59.38260559s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 15:52:37.512170488 (118h26m59.471267736s) [upload=123422]: Done uploading segments... Aug 13 15:52:37.512189314 (118h26m59.471286551s) [upload=123422]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.147510352s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [..................XX.....X.......X....X....X................] duration:
2.411634536s
FAIL (2025-08-13 16:13:59 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 16:01:55.740236569 (118h36m17.699333823s) [upload=123579]: Starting upload
Aug 13 16:01:55.740313857 (118h36m17.699411124s) [upload=123579]: Done starting upload
Aug 13 16:01:55.740738444 (118h36m17.699835697s) [upload=123579]: Uploading segments...
Aug 13 16:01:55.740814721 (118h36m17.699911976s) [upload=123579]: Got next segment. Inline: false
Aug 13 16:01:55.740869673 (118h36m17.699966933s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 16:01:55.740876857 (118h36m17.699974112s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 16:01:55.981812059 (118h36m17.940909336s) [seg_pos={0 0}, upload=123579]: Begin upload segment...
Aug 13 16:01:55.981895391 (118h36m17.940992669s) [seg_pos={0 0}, upload=123579]: Done begin upload segment.
Aug 13 16:01:55.981975453 (118h36m17.941072708s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982056793 (118h36m17.941154065s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982487161 (118h36m17.94158441s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982609215 (118h36m17.94170647s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982789408 (118h36m17.941886656s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983072248 (118h36m17.942169496s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983083057 (118h36m17.942180312s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983354911 (118h36m17.942452157s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983514251 (118h36m17.942611518s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983643753 (118h36m17.942740987s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984072147 (118h36m17.943169404s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984099587 (118h36m17.943196843s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984474849 (118h36m17.943572101s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984523663 (118h36m17.94362092s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984999396 (118h36m17.944096654s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985431509 (118h36m17.944528767s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985836559 (118h36m17.944933814s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.986258205 (118h36m17.945355464s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:56.559658395 (118h36m18.518755642s) [upload=123579]: Next returned nil segment
Aug 13 16:01:56.559698013 (118h36m18.518795264s) [upload=123579]: Waiting for error group managing segments...
Aug 13 16:01:56.721763441 (118h36m18.680860673s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.727530195 (118h36m18.686627432s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.728285184 (118h36m18.68738242s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.736592730 (118h36m18.695689969s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.738386040 (118h36m18.697483276s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.739597394 (118h36m18.698694629s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.755620356 (118h36m18.714717595s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.759300012 (118h36m18.718397252s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.768417366 (118h36m18.727514619s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.773802478 (118h36m18.732899731s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.878542305 (118h36m18.83763954s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.914318972 (118h36m18.873416228s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.973490398 (118h36m18.932587643s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980598540 (118h36m18.939695779s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980632061 (118h36m18.939729307s) [seg_pos={0 0}, upload=123579]: Segment reached optimal threshold of 14 pieces.
Aug 13 16:01:56.980949418 (118h36m18.940046652s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981054858 (118h36m18.940152105s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection
Aug 13 16:01:56.981078543 (118h36m18.940175775s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection
Aug 13 16:01:56.981090831 (118h36m18.940188062s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c3M8p1BgTVe9F8XUmwE2F8raje9keFzAiDE5TepKTMFDxdR2Q): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981102502 (118h36m18.940199734s) [seg_pos={0 0}, upload=123579]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 16:01:56.981216904 (118h36m18.940314153s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 16:01:56.981221931 (118h36m18.940319163s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 16:01:57.268808250 (118h36m19.227905483s) [upload=123579]: Done uploading segments...
Aug 13 16:01:57.268833635 (118h36m19.227930881s) [upload=123579]: Upload finished. err: <nil>
Duration: 2.411690952s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
848.77727ms
FAIL (2025-08-13 16:13:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 15:52:37.423060541 (118h26m59.382157787s) [upload=123422]: Starting upload Aug 13 15:52:37.423131152 (118h26m59.382228397s) [upload=123422]: Done starting upload Aug 13 15:52:37.423247351 (118h26m59.382344585s) [upload=123422]: Uploading segments... Aug 13 15:52:37.423394744 (118h26m59.382491998s) [upload=123422]: Got next segment. Inline: true Aug 13 15:52:37.423414806 (118h26m59.38251206s) [upload=123422]: Waiting for error group managing segments... Aug 13 15:52:37.423497026 (118h26m59.382594281s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 15:52:37.423504013 (118h26m59.382601268s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 15:52:37.423508338 (118h26m59.38260559s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 15:52:37.512170488 (118h26m59.471267736s) [upload=123422]: Done uploading segments... Aug 13 15:52:37.512189314 (118h26m59.471286551s) [upload=123422]: Upload finished. err: metaclient: Too Many Requests
Duration: 848.830425ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [...................XX.....X.......X....X....X...............] duration:
2.529169501s
FAIL (2025-08-13 16:13:07 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 16:01:55.740236569 (118h36m17.699333823s) [upload=123579]: Starting upload
Aug 13 16:01:55.740313857 (118h36m17.699411124s) [upload=123579]: Done starting upload
Aug 13 16:01:55.740738444 (118h36m17.699835697s) [upload=123579]: Uploading segments...
Aug 13 16:01:55.740814721 (118h36m17.699911976s) [upload=123579]: Got next segment. Inline: false
Aug 13 16:01:55.740869673 (118h36m17.699966933s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 16:01:55.740876857 (118h36m17.699974112s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 16:01:55.981812059 (118h36m17.940909336s) [seg_pos={0 0}, upload=123579]: Begin upload segment...
Aug 13 16:01:55.981895391 (118h36m17.940992669s) [seg_pos={0 0}, upload=123579]: Done begin upload segment.
Aug 13 16:01:55.981975453 (118h36m17.941072708s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982056793 (118h36m17.941154065s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982487161 (118h36m17.94158441s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982609215 (118h36m17.94170647s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982789408 (118h36m17.941886656s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983072248 (118h36m17.942169496s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983083057 (118h36m17.942180312s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983354911 (118h36m17.942452157s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983514251 (118h36m17.942611518s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983643753 (118h36m17.942740987s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984072147 (118h36m17.943169404s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984099587 (118h36m17.943196843s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984474849 (118h36m17.943572101s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984523663 (118h36m17.94362092s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984999396 (118h36m17.944096654s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985431509 (118h36m17.944528767s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985836559 (118h36m17.944933814s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.986258205 (118h36m17.945355464s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:56.559658395 (118h36m18.518755642s) [upload=123579]: Next returned nil segment
Aug 13 16:01:56.559698013 (118h36m18.518795264s) [upload=123579]: Waiting for error group managing segments...
Aug 13 16:01:56.721763441 (118h36m18.680860673s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.727530195 (118h36m18.686627432s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.728285184 (118h36m18.68738242s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.736592730 (118h36m18.695689969s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.738386040 (118h36m18.697483276s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.739597394 (118h36m18.698694629s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.755620356 (118h36m18.714717595s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.759300012 (118h36m18.718397252s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.768417366 (118h36m18.727514619s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.773802478 (118h36m18.732899731s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.878542305 (118h36m18.83763954s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.914318972 (118h36m18.873416228s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.973490398 (118h36m18.932587643s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980598540 (118h36m18.939695779s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980632061 (118h36m18.939729307s) [seg_pos={0 0}, upload=123579]: Segment reached optimal threshold of 14 pieces.
Aug 13 16:01:56.980949418 (118h36m18.940046652s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981054858 (118h36m18.940152105s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection
Aug 13 16:01:56.981078543 (118h36m18.940175775s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection
Aug 13 16:01:56.981090831 (118h36m18.940188062s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c3M8p1BgTVe9F8XUmwE2F8raje9keFzAiDE5TepKTMFDxdR2Q): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981102502 (118h36m18.940199734s) [seg_pos={0 0}, upload=123579]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 16:01:56.981216904 (118h36m18.940314153s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 16:01:56.981221931 (118h36m18.940319163s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 16:01:57.268808250 (118h36m19.227905483s) [upload=123579]: Done uploading segments...
Aug 13 16:01:57.268833635 (118h36m19.227930881s) [upload=123579]: Upload finished. err: <nil>
Duration: 2.529208189s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
890.382669ms
FAIL (2025-08-13 16:12:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 15:52:37.423060541 (118h26m59.382157787s) [upload=123422]: Starting upload Aug 13 15:52:37.423131152 (118h26m59.382228397s) [upload=123422]: Done starting upload Aug 13 15:52:37.423247351 (118h26m59.382344585s) [upload=123422]: Uploading segments... Aug 13 15:52:37.423394744 (118h26m59.382491998s) [upload=123422]: Got next segment. Inline: true Aug 13 15:52:37.423414806 (118h26m59.38251206s) [upload=123422]: Waiting for error group managing segments... Aug 13 15:52:37.423497026 (118h26m59.382594281s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 15:52:37.423504013 (118h26m59.382601268s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 15:52:37.423508338 (118h26m59.38260559s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 15:52:37.512170488 (118h26m59.471267736s) [upload=123422]: Done uploading segments... Aug 13 15:52:37.512189314 (118h26m59.471286551s) [upload=123422]: Upload finished. err: metaclient: Too Many Requests
Duration: 890.411567ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [....................XX.....X.......X....X....X..............] duration:
2.656060937s
FAIL (2025-08-13 16:12:02 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 16:01:55.740236569 (118h36m17.699333823s) [upload=123579]: Starting upload
Aug 13 16:01:55.740313857 (118h36m17.699411124s) [upload=123579]: Done starting upload
Aug 13 16:01:55.740738444 (118h36m17.699835697s) [upload=123579]: Uploading segments...
Aug 13 16:01:55.740814721 (118h36m17.699911976s) [upload=123579]: Got next segment. Inline: false
Aug 13 16:01:55.740869673 (118h36m17.699966933s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 16:01:55.740876857 (118h36m17.699974112s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 16:01:55.981812059 (118h36m17.940909336s) [seg_pos={0 0}, upload=123579]: Begin upload segment...
Aug 13 16:01:55.981895391 (118h36m17.940992669s) [seg_pos={0 0}, upload=123579]: Done begin upload segment.
Aug 13 16:01:55.981975453 (118h36m17.941072708s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982056793 (118h36m17.941154065s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982487161 (118h36m17.94158441s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982609215 (118h36m17.94170647s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982789408 (118h36m17.941886656s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983072248 (118h36m17.942169496s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983083057 (118h36m17.942180312s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983354911 (118h36m17.942452157s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983514251 (118h36m17.942611518s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983643753 (118h36m17.942740987s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984072147 (118h36m17.943169404s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984099587 (118h36m17.943196843s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984474849 (118h36m17.943572101s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984523663 (118h36m17.94362092s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984999396 (118h36m17.944096654s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985431509 (118h36m17.944528767s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985836559 (118h36m17.944933814s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.986258205 (118h36m17.945355464s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:56.559658395 (118h36m18.518755642s) [upload=123579]: Next returned nil segment
Aug 13 16:01:56.559698013 (118h36m18.518795264s) [upload=123579]: Waiting for error group managing segments...
Aug 13 16:01:56.721763441 (118h36m18.680860673s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.727530195 (118h36m18.686627432s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.728285184 (118h36m18.68738242s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.736592730 (118h36m18.695689969s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.738386040 (118h36m18.697483276s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.739597394 (118h36m18.698694629s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.755620356 (118h36m18.714717595s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.759300012 (118h36m18.718397252s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.768417366 (118h36m18.727514619s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.773802478 (118h36m18.732899731s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.878542305 (118h36m18.83763954s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.914318972 (118h36m18.873416228s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.973490398 (118h36m18.932587643s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980598540 (118h36m18.939695779s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980632061 (118h36m18.939729307s) [seg_pos={0 0}, upload=123579]: Segment reached optimal threshold of 14 pieces.
Aug 13 16:01:56.980949418 (118h36m18.940046652s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981054858 (118h36m18.940152105s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection
Aug 13 16:01:56.981078543 (118h36m18.940175775s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection
Aug 13 16:01:56.981090831 (118h36m18.940188062s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c3M8p1BgTVe9F8XUmwE2F8raje9keFzAiDE5TepKTMFDxdR2Q): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981102502 (118h36m18.940199734s) [seg_pos={0 0}, upload=123579]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 16:01:56.981216904 (118h36m18.940314153s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 16:01:56.981221931 (118h36m18.940319163s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 16:01:57.268808250 (118h36m19.227905483s) [upload=123579]: Done uploading segments...
Aug 13 16:01:57.268833635 (118h36m19.227930881s) [upload=123579]: Upload finished. err: <nil>
Duration: 2.656107688s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
912.29543ms
FAIL (2025-08-13 16:11:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 15:52:37.423060541 (118h26m59.382157787s) [upload=123422]: Starting upload Aug 13 15:52:37.423131152 (118h26m59.382228397s) [upload=123422]: Done starting upload Aug 13 15:52:37.423247351 (118h26m59.382344585s) [upload=123422]: Uploading segments... Aug 13 15:52:37.423394744 (118h26m59.382491998s) [upload=123422]: Got next segment. Inline: true Aug 13 15:52:37.423414806 (118h26m59.38251206s) [upload=123422]: Waiting for error group managing segments... Aug 13 15:52:37.423497026 (118h26m59.382594281s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 15:52:37.423504013 (118h26m59.382601268s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 15:52:37.423508338 (118h26m59.38260559s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 15:52:37.512170488 (118h26m59.471267736s) [upload=123422]: Done uploading segments... Aug 13 15:52:37.512189314 (118h26m59.471286551s) [upload=123422]: Upload finished. err: metaclient: Too Many Requests
Duration: 912.35043ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
912.316019ms
FAIL (2025-08-13 16:11:19 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 15:52:37.423060541 (118h26m59.382157787s) [upload=123422]: Starting upload Aug 13 15:52:37.423131152 (118h26m59.382228397s) [upload=123422]: Done starting upload Aug 13 15:52:37.423247351 (118h26m59.382344585s) [upload=123422]: Uploading segments... Aug 13 15:52:37.423394744 (118h26m59.382491998s) [upload=123422]: Got next segment. Inline: true Aug 13 15:52:37.423414806 (118h26m59.38251206s) [upload=123422]: Waiting for error group managing segments... Aug 13 15:52:37.423497026 (118h26m59.382594281s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 15:52:37.423504013 (118h26m59.382601268s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 15:52:37.423508338 (118h26m59.38260559s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 15:52:37.512170488 (118h26m59.471267736s) [upload=123422]: Done uploading segments... Aug 13 15:52:37.512189314 (118h26m59.471286551s) [upload=123422]: Upload finished. err: metaclient: Too Many Requests
Duration: 912.415694ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.....................XX.....X.......X....X....X.............] duration:
2.492042136s
FAIL (2025-08-13 16:11:00 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 16:01:55.740236569 (118h36m17.699333823s) [upload=123579]: Starting upload
Aug 13 16:01:55.740313857 (118h36m17.699411124s) [upload=123579]: Done starting upload
Aug 13 16:01:55.740738444 (118h36m17.699835697s) [upload=123579]: Uploading segments...
Aug 13 16:01:55.740814721 (118h36m17.699911976s) [upload=123579]: Got next segment. Inline: false
Aug 13 16:01:55.740869673 (118h36m17.699966933s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 16:01:55.740876857 (118h36m17.699974112s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 16:01:55.981812059 (118h36m17.940909336s) [seg_pos={0 0}, upload=123579]: Begin upload segment...
Aug 13 16:01:55.981895391 (118h36m17.940992669s) [seg_pos={0 0}, upload=123579]: Done begin upload segment.
Aug 13 16:01:55.981975453 (118h36m17.941072708s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982056793 (118h36m17.941154065s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982487161 (118h36m17.94158441s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982609215 (118h36m17.94170647s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982789408 (118h36m17.941886656s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983072248 (118h36m17.942169496s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983083057 (118h36m17.942180312s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983354911 (118h36m17.942452157s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983514251 (118h36m17.942611518s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983643753 (118h36m17.942740987s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984072147 (118h36m17.943169404s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984099587 (118h36m17.943196843s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984474849 (118h36m17.943572101s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984523663 (118h36m17.94362092s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984999396 (118h36m17.944096654s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985431509 (118h36m17.944528767s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985836559 (118h36m17.944933814s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.986258205 (118h36m17.945355464s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:56.559658395 (118h36m18.518755642s) [upload=123579]: Next returned nil segment
Aug 13 16:01:56.559698013 (118h36m18.518795264s) [upload=123579]: Waiting for error group managing segments...
Aug 13 16:01:56.721763441 (118h36m18.680860673s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.727530195 (118h36m18.686627432s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.728285184 (118h36m18.68738242s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.736592730 (118h36m18.695689969s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.738386040 (118h36m18.697483276s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.739597394 (118h36m18.698694629s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.755620356 (118h36m18.714717595s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.759300012 (118h36m18.718397252s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.768417366 (118h36m18.727514619s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.773802478 (118h36m18.732899731s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.878542305 (118h36m18.83763954s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.914318972 (118h36m18.873416228s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.973490398 (118h36m18.932587643s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980598540 (118h36m18.939695779s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980632061 (118h36m18.939729307s) [seg_pos={0 0}, upload=123579]: Segment reached optimal threshold of 14 pieces.
Aug 13 16:01:56.980949418 (118h36m18.940046652s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981054858 (118h36m18.940152105s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection
Aug 13 16:01:56.981078543 (118h36m18.940175775s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection
Aug 13 16:01:56.981090831 (118h36m18.940188062s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c3M8p1BgTVe9F8XUmwE2F8raje9keFzAiDE5TepKTMFDxdR2Q): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981102502 (118h36m18.940199734s) [seg_pos={0 0}, upload=123579]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 16:01:56.981216904 (118h36m18.940314153s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 16:01:56.981221931 (118h36m18.940319163s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 16:01:57.268808250 (118h36m19.227905483s) [upload=123579]: Done uploading segments...
Aug 13 16:01:57.268833635 (118h36m19.227930881s) [upload=123579]: Upload finished. err: <nil>
Duration: 2.49210945s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [......................XX.....X.......X....X....X............] duration:
2.408662107s
FAIL (2025-08-13 16:10:27 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 16:01:55.740236569 (118h36m17.699333823s) [upload=123579]: Starting upload
Aug 13 16:01:55.740313857 (118h36m17.699411124s) [upload=123579]: Done starting upload
Aug 13 16:01:55.740738444 (118h36m17.699835697s) [upload=123579]: Uploading segments...
Aug 13 16:01:55.740814721 (118h36m17.699911976s) [upload=123579]: Got next segment. Inline: false
Aug 13 16:01:55.740869673 (118h36m17.699966933s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 16:01:55.740876857 (118h36m17.699974112s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 16:01:55.981812059 (118h36m17.940909336s) [seg_pos={0 0}, upload=123579]: Begin upload segment...
Aug 13 16:01:55.981895391 (118h36m17.940992669s) [seg_pos={0 0}, upload=123579]: Done begin upload segment.
Aug 13 16:01:55.981975453 (118h36m17.941072708s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982056793 (118h36m17.941154065s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982487161 (118h36m17.94158441s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982609215 (118h36m17.94170647s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982789408 (118h36m17.941886656s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983072248 (118h36m17.942169496s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983083057 (118h36m17.942180312s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983354911 (118h36m17.942452157s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983514251 (118h36m17.942611518s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983643753 (118h36m17.942740987s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984072147 (118h36m17.943169404s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984099587 (118h36m17.943196843s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984474849 (118h36m17.943572101s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984523663 (118h36m17.94362092s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984999396 (118h36m17.944096654s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985431509 (118h36m17.944528767s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985836559 (118h36m17.944933814s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.986258205 (118h36m17.945355464s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:56.559658395 (118h36m18.518755642s) [upload=123579]: Next returned nil segment
Aug 13 16:01:56.559698013 (118h36m18.518795264s) [upload=123579]: Waiting for error group managing segments...
Aug 13 16:01:56.721763441 (118h36m18.680860673s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.727530195 (118h36m18.686627432s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.728285184 (118h36m18.68738242s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.736592730 (118h36m18.695689969s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.738386040 (118h36m18.697483276s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.739597394 (118h36m18.698694629s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.755620356 (118h36m18.714717595s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.759300012 (118h36m18.718397252s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.768417366 (118h36m18.727514619s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.773802478 (118h36m18.732899731s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.878542305 (118h36m18.83763954s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.914318972 (118h36m18.873416228s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.973490398 (118h36m18.932587643s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980598540 (118h36m18.939695779s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980632061 (118h36m18.939729307s) [seg_pos={0 0}, upload=123579]: Segment reached optimal threshold of 14 pieces.
Aug 13 16:01:56.980949418 (118h36m18.940046652s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981054858 (118h36m18.940152105s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection
Aug 13 16:01:56.981078543 (118h36m18.940175775s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection
Aug 13 16:01:56.981090831 (118h36m18.940188062s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c3M8p1BgTVe9F8XUmwE2F8raje9keFzAiDE5TepKTMFDxdR2Q): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981102502 (118h36m18.940199734s) [seg_pos={0 0}, upload=123579]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 16:01:56.981216904 (118h36m18.940314153s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 16:01:56.981221931 (118h36m18.940319163s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 16:01:57.268808250 (118h36m19.227905483s) [upload=123579]: Done uploading segments...
Aug 13 16:01:57.268833635 (118h36m19.227930881s) [upload=123579]: Upload finished. err: <nil>
Duration: 2.408694606s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
882.263266ms
FAIL (2025-08-13 16:10:05 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 15:52:37.423060541 (118h26m59.382157787s) [upload=123422]: Starting upload Aug 13 15:52:37.423131152 (118h26m59.382228397s) [upload=123422]: Done starting upload Aug 13 15:52:37.423247351 (118h26m59.382344585s) [upload=123422]: Uploading segments... Aug 13 15:52:37.423394744 (118h26m59.382491998s) [upload=123422]: Got next segment. Inline: true Aug 13 15:52:37.423414806 (118h26m59.38251206s) [upload=123422]: Waiting for error group managing segments... Aug 13 15:52:37.423497026 (118h26m59.382594281s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 15:52:37.423504013 (118h26m59.382601268s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 15:52:37.423508338 (118h26m59.38260559s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 15:52:37.512170488 (118h26m59.471267736s) [upload=123422]: Done uploading segments... Aug 13 15:52:37.512189314 (118h26m59.471286551s) [upload=123422]: Upload finished. err: metaclient: Too Many Requests
Duration: 882.29881ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [X......................XX.....X.......X....X....X...........] duration:
2.475371734s
FAIL (2025-08-13 16:09:55 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 16:01:55.740236569 (118h36m17.699333823s) [upload=123579]: Starting upload
Aug 13 16:01:55.740313857 (118h36m17.699411124s) [upload=123579]: Done starting upload
Aug 13 16:01:55.740738444 (118h36m17.699835697s) [upload=123579]: Uploading segments...
Aug 13 16:01:55.740814721 (118h36m17.699911976s) [upload=123579]: Got next segment. Inline: false
Aug 13 16:01:55.740869673 (118h36m17.699966933s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 16:01:55.740876857 (118h36m17.699974112s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 16:01:55.981812059 (118h36m17.940909336s) [seg_pos={0 0}, upload=123579]: Begin upload segment...
Aug 13 16:01:55.981895391 (118h36m17.940992669s) [seg_pos={0 0}, upload=123579]: Done begin upload segment.
Aug 13 16:01:55.981975453 (118h36m17.941072708s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982056793 (118h36m17.941154065s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982487161 (118h36m17.94158441s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982609215 (118h36m17.94170647s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982789408 (118h36m17.941886656s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983072248 (118h36m17.942169496s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983083057 (118h36m17.942180312s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983354911 (118h36m17.942452157s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983514251 (118h36m17.942611518s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983643753 (118h36m17.942740987s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984072147 (118h36m17.943169404s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984099587 (118h36m17.943196843s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984474849 (118h36m17.943572101s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984523663 (118h36m17.94362092s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984999396 (118h36m17.944096654s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985431509 (118h36m17.944528767s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985836559 (118h36m17.944933814s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.986258205 (118h36m17.945355464s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:56.559658395 (118h36m18.518755642s) [upload=123579]: Next returned nil segment
Aug 13 16:01:56.559698013 (118h36m18.518795264s) [upload=123579]: Waiting for error group managing segments...
Aug 13 16:01:56.721763441 (118h36m18.680860673s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.727530195 (118h36m18.686627432s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.728285184 (118h36m18.68738242s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.736592730 (118h36m18.695689969s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.738386040 (118h36m18.697483276s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.739597394 (118h36m18.698694629s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.755620356 (118h36m18.714717595s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.759300012 (118h36m18.718397252s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.768417366 (118h36m18.727514619s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.773802478 (118h36m18.732899731s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.878542305 (118h36m18.83763954s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.914318972 (118h36m18.873416228s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.973490398 (118h36m18.932587643s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980598540 (118h36m18.939695779s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980632061 (118h36m18.939729307s) [seg_pos={0 0}, upload=123579]: Segment reached optimal threshold of 14 pieces.
Aug 13 16:01:56.980949418 (118h36m18.940046652s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981054858 (118h36m18.940152105s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection
Aug 13 16:01:56.981078543 (118h36m18.940175775s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection
Aug 13 16:01:56.981090831 (118h36m18.940188062s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c3M8p1BgTVe9F8XUmwE2F8raje9keFzAiDE5TepKTMFDxdR2Q): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981102502 (118h36m18.940199734s) [seg_pos={0 0}, upload=123579]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 16:01:56.981216904 (118h36m18.940314153s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 16:01:56.981221931 (118h36m18.940319163s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 16:01:57.268808250 (118h36m19.227905483s) [upload=123579]: Done uploading segments...
Aug 13 16:01:57.268833635 (118h36m19.227930881s) [upload=123579]: Upload finished. err: <nil>
Duration: 2.475479057s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
1.266068845s
FAIL (2025-08-13 16:09:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 15:52:37.423060541 (118h26m59.382157787s) [upload=123422]: Starting upload Aug 13 15:52:37.423131152 (118h26m59.382228397s) [upload=123422]: Done starting upload Aug 13 15:52:37.423247351 (118h26m59.382344585s) [upload=123422]: Uploading segments... Aug 13 15:52:37.423394744 (118h26m59.382491998s) [upload=123422]: Got next segment. Inline: true Aug 13 15:52:37.423414806 (118h26m59.38251206s) [upload=123422]: Waiting for error group managing segments... Aug 13 15:52:37.423497026 (118h26m59.382594281s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 15:52:37.423504013 (118h26m59.382601268s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 15:52:37.423508338 (118h26m59.38260559s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 15:52:37.512170488 (118h26m59.471267736s) [upload=123422]: Done uploading segments... Aug 13 15:52:37.512189314 (118h26m59.471286551s) [upload=123422]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.266095072s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
1.087350462s
FAIL (2025-08-13 16:09:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 15:52:37.423060541 (118h26m59.382157787s) [upload=123422]: Starting upload Aug 13 15:52:37.423131152 (118h26m59.382228397s) [upload=123422]: Done starting upload Aug 13 15:52:37.423247351 (118h26m59.382344585s) [upload=123422]: Uploading segments... Aug 13 15:52:37.423394744 (118h26m59.382491998s) [upload=123422]: Got next segment. Inline: true Aug 13 15:52:37.423414806 (118h26m59.38251206s) [upload=123422]: Waiting for error group managing segments... Aug 13 15:52:37.423497026 (118h26m59.382594281s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 15:52:37.423504013 (118h26m59.382601268s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 15:52:37.423508338 (118h26m59.38260559s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 15:52:37.512170488 (118h26m59.471267736s) [upload=123422]: Done uploading segments... Aug 13 15:52:37.512189314 (118h26m59.471286551s) [upload=123422]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.087392704s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [.X......................XX.....X.......X....X....X..........] duration:
2.520455418s
FAIL (2025-08-13 16:08:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 16:01:55.740236569 (118h36m17.699333823s) [upload=123579]: Starting upload
Aug 13 16:01:55.740313857 (118h36m17.699411124s) [upload=123579]: Done starting upload
Aug 13 16:01:55.740738444 (118h36m17.699835697s) [upload=123579]: Uploading segments...
Aug 13 16:01:55.740814721 (118h36m17.699911976s) [upload=123579]: Got next segment. Inline: false
Aug 13 16:01:55.740869673 (118h36m17.699966933s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 16:01:55.740876857 (118h36m17.699974112s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 16:01:55.981812059 (118h36m17.940909336s) [seg_pos={0 0}, upload=123579]: Begin upload segment...
Aug 13 16:01:55.981895391 (118h36m17.940992669s) [seg_pos={0 0}, upload=123579]: Done begin upload segment.
Aug 13 16:01:55.981975453 (118h36m17.941072708s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982056793 (118h36m17.941154065s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982487161 (118h36m17.94158441s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982609215 (118h36m17.94170647s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982789408 (118h36m17.941886656s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983072248 (118h36m17.942169496s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983083057 (118h36m17.942180312s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983354911 (118h36m17.942452157s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983514251 (118h36m17.942611518s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983643753 (118h36m17.942740987s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984072147 (118h36m17.943169404s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984099587 (118h36m17.943196843s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984474849 (118h36m17.943572101s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984523663 (118h36m17.94362092s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984999396 (118h36m17.944096654s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985431509 (118h36m17.944528767s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985836559 (118h36m17.944933814s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.986258205 (118h36m17.945355464s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:56.559658395 (118h36m18.518755642s) [upload=123579]: Next returned nil segment
Aug 13 16:01:56.559698013 (118h36m18.518795264s) [upload=123579]: Waiting for error group managing segments...
Aug 13 16:01:56.721763441 (118h36m18.680860673s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.727530195 (118h36m18.686627432s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.728285184 (118h36m18.68738242s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.736592730 (118h36m18.695689969s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.738386040 (118h36m18.697483276s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.739597394 (118h36m18.698694629s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.755620356 (118h36m18.714717595s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.759300012 (118h36m18.718397252s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.768417366 (118h36m18.727514619s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.773802478 (118h36m18.732899731s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.878542305 (118h36m18.83763954s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.914318972 (118h36m18.873416228s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.973490398 (118h36m18.932587643s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980598540 (118h36m18.939695779s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980632061 (118h36m18.939729307s) [seg_pos={0 0}, upload=123579]: Segment reached optimal threshold of 14 pieces.
Aug 13 16:01:56.980949418 (118h36m18.940046652s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981054858 (118h36m18.940152105s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection
Aug 13 16:01:56.981078543 (118h36m18.940175775s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection
Aug 13 16:01:56.981090831 (118h36m18.940188062s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c3M8p1BgTVe9F8XUmwE2F8raje9keFzAiDE5TepKTMFDxdR2Q): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981102502 (118h36m18.940199734s) [seg_pos={0 0}, upload=123579]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 16:01:56.981216904 (118h36m18.940314153s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 16:01:56.981221931 (118h36m18.940319163s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 16:01:57.268808250 (118h36m19.227905483s) [upload=123579]: Done uploading segments...
Aug 13 16:01:57.268833635 (118h36m19.227930881s) [upload=123579]: Upload finished. err: <nil>
Duration: 2.520503325s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
1.030139697s
FAIL (2025-08-13 16:08:38 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 15:52:37.423060541 (118h26m59.382157787s) [upload=123422]: Starting upload Aug 13 15:52:37.423131152 (118h26m59.382228397s) [upload=123422]: Done starting upload Aug 13 15:52:37.423247351 (118h26m59.382344585s) [upload=123422]: Uploading segments... Aug 13 15:52:37.423394744 (118h26m59.382491998s) [upload=123422]: Got next segment. Inline: true Aug 13 15:52:37.423414806 (118h26m59.38251206s) [upload=123422]: Waiting for error group managing segments... Aug 13 15:52:37.423497026 (118h26m59.382594281s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 15:52:37.423504013 (118h26m59.382601268s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 15:52:37.423508338 (118h26m59.38260559s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 15:52:37.512170488 (118h26m59.471267736s) [upload=123422]: Done uploading segments... Aug 13 15:52:37.512189314 (118h26m59.471286551s) [upload=123422]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.030170108s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [..X......................XX.....X.......X....X....X.........] duration:
3.473461872s
FAIL (2025-08-13 16:08:25 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 16:01:55.740236569 (118h36m17.699333823s) [upload=123579]: Starting upload
Aug 13 16:01:55.740313857 (118h36m17.699411124s) [upload=123579]: Done starting upload
Aug 13 16:01:55.740738444 (118h36m17.699835697s) [upload=123579]: Uploading segments...
Aug 13 16:01:55.740814721 (118h36m17.699911976s) [upload=123579]: Got next segment. Inline: false
Aug 13 16:01:55.740869673 (118h36m17.699966933s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 16:01:55.740876857 (118h36m17.699974112s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 16:01:55.981812059 (118h36m17.940909336s) [seg_pos={0 0}, upload=123579]: Begin upload segment...
Aug 13 16:01:55.981895391 (118h36m17.940992669s) [seg_pos={0 0}, upload=123579]: Done begin upload segment.
Aug 13 16:01:55.981975453 (118h36m17.941072708s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982056793 (118h36m17.941154065s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982487161 (118h36m17.94158441s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982609215 (118h36m17.94170647s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982789408 (118h36m17.941886656s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983072248 (118h36m17.942169496s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983083057 (118h36m17.942180312s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983354911 (118h36m17.942452157s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983514251 (118h36m17.942611518s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983643753 (118h36m17.942740987s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984072147 (118h36m17.943169404s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984099587 (118h36m17.943196843s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984474849 (118h36m17.943572101s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984523663 (118h36m17.94362092s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984999396 (118h36m17.944096654s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985431509 (118h36m17.944528767s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985836559 (118h36m17.944933814s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.986258205 (118h36m17.945355464s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:56.559658395 (118h36m18.518755642s) [upload=123579]: Next returned nil segment
Aug 13 16:01:56.559698013 (118h36m18.518795264s) [upload=123579]: Waiting for error group managing segments...
Aug 13 16:01:56.721763441 (118h36m18.680860673s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.727530195 (118h36m18.686627432s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.728285184 (118h36m18.68738242s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.736592730 (118h36m18.695689969s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.738386040 (118h36m18.697483276s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.739597394 (118h36m18.698694629s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.755620356 (118h36m18.714717595s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.759300012 (118h36m18.718397252s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.768417366 (118h36m18.727514619s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.773802478 (118h36m18.732899731s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.878542305 (118h36m18.83763954s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.914318972 (118h36m18.873416228s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.973490398 (118h36m18.932587643s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980598540 (118h36m18.939695779s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980632061 (118h36m18.939729307s) [seg_pos={0 0}, upload=123579]: Segment reached optimal threshold of 14 pieces.
Aug 13 16:01:56.980949418 (118h36m18.940046652s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981054858 (118h36m18.940152105s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection
Aug 13 16:01:56.981078543 (118h36m18.940175775s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection
Aug 13 16:01:56.981090831 (118h36m18.940188062s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c3M8p1BgTVe9F8XUmwE2F8raje9keFzAiDE5TepKTMFDxdR2Q): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981102502 (118h36m18.940199734s) [seg_pos={0 0}, upload=123579]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 16:01:56.981216904 (118h36m18.940314153s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 16:01:56.981221931 (118h36m18.940319163s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 16:01:57.268808250 (118h36m19.227905483s) [upload=123579]: Done uploading segments...
Aug 13 16:01:57.268833635 (118h36m19.227930881s) [upload=123579]: Upload finished. err: <nil>
Duration: 3.473499623s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
889.623379ms
FAIL (2025-08-13 16:08:13 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 15:52:37.423060541 (118h26m59.382157787s) [upload=123422]: Starting upload Aug 13 15:52:37.423131152 (118h26m59.382228397s) [upload=123422]: Done starting upload Aug 13 15:52:37.423247351 (118h26m59.382344585s) [upload=123422]: Uploading segments... Aug 13 15:52:37.423394744 (118h26m59.382491998s) [upload=123422]: Got next segment. Inline: true Aug 13 15:52:37.423414806 (118h26m59.38251206s) [upload=123422]: Waiting for error group managing segments... Aug 13 15:52:37.423497026 (118h26m59.382594281s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 15:52:37.423504013 (118h26m59.382601268s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 15:52:37.423508338 (118h26m59.38260559s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 15:52:37.512170488 (118h26m59.471267736s) [upload=123422]: Done uploading segments... Aug 13 15:52:37.512189314 (118h26m59.471286551s) [upload=123422]: Upload finished. err: metaclient: Too Many Requests
Duration: 889.649715ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [...X......................XX.....X.......X....X....X........] duration:
2.417940275s
FAIL (2025-08-13 16:07:57 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 16:01:55.740236569 (118h36m17.699333823s) [upload=123579]: Starting upload
Aug 13 16:01:55.740313857 (118h36m17.699411124s) [upload=123579]: Done starting upload
Aug 13 16:01:55.740738444 (118h36m17.699835697s) [upload=123579]: Uploading segments...
Aug 13 16:01:55.740814721 (118h36m17.699911976s) [upload=123579]: Got next segment. Inline: false
Aug 13 16:01:55.740869673 (118h36m17.699966933s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 16:01:55.740876857 (118h36m17.699974112s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 16:01:55.981812059 (118h36m17.940909336s) [seg_pos={0 0}, upload=123579]: Begin upload segment...
Aug 13 16:01:55.981895391 (118h36m17.940992669s) [seg_pos={0 0}, upload=123579]: Done begin upload segment.
Aug 13 16:01:55.981975453 (118h36m17.941072708s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982056793 (118h36m17.941154065s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982487161 (118h36m17.94158441s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982609215 (118h36m17.94170647s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982789408 (118h36m17.941886656s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983072248 (118h36m17.942169496s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983083057 (118h36m17.942180312s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983354911 (118h36m17.942452157s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983514251 (118h36m17.942611518s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983643753 (118h36m17.942740987s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984072147 (118h36m17.943169404s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984099587 (118h36m17.943196843s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984474849 (118h36m17.943572101s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984523663 (118h36m17.94362092s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984999396 (118h36m17.944096654s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985431509 (118h36m17.944528767s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985836559 (118h36m17.944933814s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.986258205 (118h36m17.945355464s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:56.559658395 (118h36m18.518755642s) [upload=123579]: Next returned nil segment
Aug 13 16:01:56.559698013 (118h36m18.518795264s) [upload=123579]: Waiting for error group managing segments...
Aug 13 16:01:56.721763441 (118h36m18.680860673s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.727530195 (118h36m18.686627432s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.728285184 (118h36m18.68738242s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.736592730 (118h36m18.695689969s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.738386040 (118h36m18.697483276s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.739597394 (118h36m18.698694629s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.755620356 (118h36m18.714717595s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.759300012 (118h36m18.718397252s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.768417366 (118h36m18.727514619s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.773802478 (118h36m18.732899731s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.878542305 (118h36m18.83763954s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.914318972 (118h36m18.873416228s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.973490398 (118h36m18.932587643s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980598540 (118h36m18.939695779s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980632061 (118h36m18.939729307s) [seg_pos={0 0}, upload=123579]: Segment reached optimal threshold of 14 pieces.
Aug 13 16:01:56.980949418 (118h36m18.940046652s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981054858 (118h36m18.940152105s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection
Aug 13 16:01:56.981078543 (118h36m18.940175775s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection
Aug 13 16:01:56.981090831 (118h36m18.940188062s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c3M8p1BgTVe9F8XUmwE2F8raje9keFzAiDE5TepKTMFDxdR2Q): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981102502 (118h36m18.940199734s) [seg_pos={0 0}, upload=123579]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 16:01:56.981216904 (118h36m18.940314153s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 16:01:56.981221931 (118h36m18.940319163s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 16:01:57.268808250 (118h36m19.227905483s) [upload=123579]: Done uploading segments...
Aug 13 16:01:57.268833635 (118h36m19.227930881s) [upload=123579]: Upload finished. err: <nil>
Duration: 2.417973497s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
1.123702403s
FAIL (2025-08-13 16:07:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 15:52:37.423060541 (118h26m59.382157787s) [upload=123422]: Starting upload Aug 13 15:52:37.423131152 (118h26m59.382228397s) [upload=123422]: Done starting upload Aug 13 15:52:37.423247351 (118h26m59.382344585s) [upload=123422]: Uploading segments... Aug 13 15:52:37.423394744 (118h26m59.382491998s) [upload=123422]: Got next segment. Inline: true Aug 13 15:52:37.423414806 (118h26m59.38251206s) [upload=123422]: Waiting for error group managing segments... Aug 13 15:52:37.423497026 (118h26m59.382594281s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 15:52:37.423504013 (118h26m59.382601268s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 15:52:37.423508338 (118h26m59.38260559s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 15:52:37.512170488 (118h26m59.471267736s) [upload=123422]: Done uploading segments... Aug 13 15:52:37.512189314 (118h26m59.471286551s) [upload=123422]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.123749403s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [....X......................XX.....X.......X....X....X.......] duration:
2.592978428s
FAIL (2025-08-13 16:07:39 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 16:01:55.740236569 (118h36m17.699333823s) [upload=123579]: Starting upload
Aug 13 16:01:55.740313857 (118h36m17.699411124s) [upload=123579]: Done starting upload
Aug 13 16:01:55.740738444 (118h36m17.699835697s) [upload=123579]: Uploading segments...
Aug 13 16:01:55.740814721 (118h36m17.699911976s) [upload=123579]: Got next segment. Inline: false
Aug 13 16:01:55.740869673 (118h36m17.699966933s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 16:01:55.740876857 (118h36m17.699974112s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 16:01:55.981812059 (118h36m17.940909336s) [seg_pos={0 0}, upload=123579]: Begin upload segment...
Aug 13 16:01:55.981895391 (118h36m17.940992669s) [seg_pos={0 0}, upload=123579]: Done begin upload segment.
Aug 13 16:01:55.981975453 (118h36m17.941072708s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982056793 (118h36m17.941154065s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982487161 (118h36m17.94158441s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982609215 (118h36m17.94170647s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982789408 (118h36m17.941886656s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983072248 (118h36m17.942169496s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983083057 (118h36m17.942180312s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983354911 (118h36m17.942452157s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983514251 (118h36m17.942611518s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983643753 (118h36m17.942740987s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984072147 (118h36m17.943169404s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984099587 (118h36m17.943196843s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984474849 (118h36m17.943572101s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984523663 (118h36m17.94362092s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984999396 (118h36m17.944096654s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985431509 (118h36m17.944528767s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985836559 (118h36m17.944933814s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.986258205 (118h36m17.945355464s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:56.559658395 (118h36m18.518755642s) [upload=123579]: Next returned nil segment
Aug 13 16:01:56.559698013 (118h36m18.518795264s) [upload=123579]: Waiting for error group managing segments...
Aug 13 16:01:56.721763441 (118h36m18.680860673s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.727530195 (118h36m18.686627432s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.728285184 (118h36m18.68738242s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.736592730 (118h36m18.695689969s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.738386040 (118h36m18.697483276s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.739597394 (118h36m18.698694629s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.755620356 (118h36m18.714717595s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.759300012 (118h36m18.718397252s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.768417366 (118h36m18.727514619s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.773802478 (118h36m18.732899731s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.878542305 (118h36m18.83763954s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.914318972 (118h36m18.873416228s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.973490398 (118h36m18.932587643s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980598540 (118h36m18.939695779s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980632061 (118h36m18.939729307s) [seg_pos={0 0}, upload=123579]: Segment reached optimal threshold of 14 pieces.
Aug 13 16:01:56.980949418 (118h36m18.940046652s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981054858 (118h36m18.940152105s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection
Aug 13 16:01:56.981078543 (118h36m18.940175775s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection
Aug 13 16:01:56.981090831 (118h36m18.940188062s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c3M8p1BgTVe9F8XUmwE2F8raje9keFzAiDE5TepKTMFDxdR2Q): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981102502 (118h36m18.940199734s) [seg_pos={0 0}, upload=123579]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 16:01:56.981216904 (118h36m18.940314153s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 16:01:56.981221931 (118h36m18.940319163s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 16:01:57.268808250 (118h36m19.227905483s) [upload=123579]: Done uploading segments...
Aug 13 16:01:57.268833635 (118h36m19.227930881s) [upload=123579]: Upload finished. err: <nil>
Duration: 2.593012696s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
970.490738ms
FAIL (2025-08-13 16:07:21 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 15:52:37.423060541 (118h26m59.382157787s) [upload=123422]: Starting upload Aug 13 15:52:37.423131152 (118h26m59.382228397s) [upload=123422]: Done starting upload Aug 13 15:52:37.423247351 (118h26m59.382344585s) [upload=123422]: Uploading segments... Aug 13 15:52:37.423394744 (118h26m59.382491998s) [upload=123422]: Got next segment. Inline: true Aug 13 15:52:37.423414806 (118h26m59.38251206s) [upload=123422]: Waiting for error group managing segments... Aug 13 15:52:37.423497026 (118h26m59.382594281s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 15:52:37.423504013 (118h26m59.382601268s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 15:52:37.423508338 (118h26m59.38260559s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 15:52:37.512170488 (118h26m59.471267736s) [upload=123422]: Done uploading segments... Aug 13 15:52:37.512189314 (118h26m59.471286551s) [upload=123422]: Upload finished. err: metaclient: Too Many Requests
Duration: 970.520246ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [.....X......................XX.....X.......X....X....X......] duration:
2.704085254s
FAIL (2025-08-13 16:06:41 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 16:01:55.740236569 (118h36m17.699333823s) [upload=123579]: Starting upload
Aug 13 16:01:55.740313857 (118h36m17.699411124s) [upload=123579]: Done starting upload
Aug 13 16:01:55.740738444 (118h36m17.699835697s) [upload=123579]: Uploading segments...
Aug 13 16:01:55.740814721 (118h36m17.699911976s) [upload=123579]: Got next segment. Inline: false
Aug 13 16:01:55.740869673 (118h36m17.699966933s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 16:01:55.740876857 (118h36m17.699974112s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 16:01:55.981812059 (118h36m17.940909336s) [seg_pos={0 0}, upload=123579]: Begin upload segment...
Aug 13 16:01:55.981895391 (118h36m17.940992669s) [seg_pos={0 0}, upload=123579]: Done begin upload segment.
Aug 13 16:01:55.981975453 (118h36m17.941072708s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982056793 (118h36m17.941154065s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982487161 (118h36m17.94158441s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982609215 (118h36m17.94170647s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982789408 (118h36m17.941886656s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983072248 (118h36m17.942169496s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983083057 (118h36m17.942180312s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983354911 (118h36m17.942452157s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983514251 (118h36m17.942611518s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983643753 (118h36m17.942740987s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984072147 (118h36m17.943169404s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984099587 (118h36m17.943196843s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984474849 (118h36m17.943572101s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984523663 (118h36m17.94362092s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984999396 (118h36m17.944096654s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985431509 (118h36m17.944528767s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985836559 (118h36m17.944933814s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.986258205 (118h36m17.945355464s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:56.559658395 (118h36m18.518755642s) [upload=123579]: Next returned nil segment
Aug 13 16:01:56.559698013 (118h36m18.518795264s) [upload=123579]: Waiting for error group managing segments...
Aug 13 16:01:56.721763441 (118h36m18.680860673s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.727530195 (118h36m18.686627432s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.728285184 (118h36m18.68738242s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.736592730 (118h36m18.695689969s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.738386040 (118h36m18.697483276s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.739597394 (118h36m18.698694629s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.755620356 (118h36m18.714717595s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.759300012 (118h36m18.718397252s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.768417366 (118h36m18.727514619s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.773802478 (118h36m18.732899731s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.878542305 (118h36m18.83763954s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.914318972 (118h36m18.873416228s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.973490398 (118h36m18.932587643s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980598540 (118h36m18.939695779s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980632061 (118h36m18.939729307s) [seg_pos={0 0}, upload=123579]: Segment reached optimal threshold of 14 pieces.
Aug 13 16:01:56.980949418 (118h36m18.940046652s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981054858 (118h36m18.940152105s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection
Aug 13 16:01:56.981078543 (118h36m18.940175775s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection
Aug 13 16:01:56.981090831 (118h36m18.940188062s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c3M8p1BgTVe9F8XUmwE2F8raje9keFzAiDE5TepKTMFDxdR2Q): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981102502 (118h36m18.940199734s) [seg_pos={0 0}, upload=123579]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 16:01:56.981216904 (118h36m18.940314153s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 16:01:56.981221931 (118h36m18.940319163s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 16:01:57.268808250 (118h36m19.227905483s) [upload=123579]: Done uploading segments...
Aug 13 16:01:57.268833635 (118h36m19.227930881s) [upload=123579]: Upload finished. err: <nil>
Duration: 2.704125523s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
914.535894ms
FAIL (2025-08-13 16:06:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 15:52:37.423060541 (118h26m59.382157787s) [upload=123422]: Starting upload Aug 13 15:52:37.423131152 (118h26m59.382228397s) [upload=123422]: Done starting upload Aug 13 15:52:37.423247351 (118h26m59.382344585s) [upload=123422]: Uploading segments... Aug 13 15:52:37.423394744 (118h26m59.382491998s) [upload=123422]: Got next segment. Inline: true Aug 13 15:52:37.423414806 (118h26m59.38251206s) [upload=123422]: Waiting for error group managing segments... Aug 13 15:52:37.423497026 (118h26m59.382594281s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 15:52:37.423504013 (118h26m59.382601268s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 15:52:37.423508338 (118h26m59.38260559s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 15:52:37.512170488 (118h26m59.471267736s) [upload=123422]: Done uploading segments... Aug 13 15:52:37.512189314 (118h26m59.471286551s) [upload=123422]: Upload finished. err: metaclient: Too Many Requests
Duration: 914.565363ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [......X......................XX.....X.......X....X....X.....] duration:
2.735826809s
FAIL (2025-08-13 16:05:52 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 16:01:55.740236569 (118h36m17.699333823s) [upload=123579]: Starting upload
Aug 13 16:01:55.740313857 (118h36m17.699411124s) [upload=123579]: Done starting upload
Aug 13 16:01:55.740738444 (118h36m17.699835697s) [upload=123579]: Uploading segments...
Aug 13 16:01:55.740814721 (118h36m17.699911976s) [upload=123579]: Got next segment. Inline: false
Aug 13 16:01:55.740869673 (118h36m17.699966933s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 16:01:55.740876857 (118h36m17.699974112s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 16:01:55.981812059 (118h36m17.940909336s) [seg_pos={0 0}, upload=123579]: Begin upload segment...
Aug 13 16:01:55.981895391 (118h36m17.940992669s) [seg_pos={0 0}, upload=123579]: Done begin upload segment.
Aug 13 16:01:55.981975453 (118h36m17.941072708s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982056793 (118h36m17.941154065s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982487161 (118h36m17.94158441s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982609215 (118h36m17.94170647s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982789408 (118h36m17.941886656s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983072248 (118h36m17.942169496s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983083057 (118h36m17.942180312s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983354911 (118h36m17.942452157s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983514251 (118h36m17.942611518s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983643753 (118h36m17.942740987s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984072147 (118h36m17.943169404s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984099587 (118h36m17.943196843s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984474849 (118h36m17.943572101s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984523663 (118h36m17.94362092s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984999396 (118h36m17.944096654s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985431509 (118h36m17.944528767s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985836559 (118h36m17.944933814s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.986258205 (118h36m17.945355464s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:56.559658395 (118h36m18.518755642s) [upload=123579]: Next returned nil segment
Aug 13 16:01:56.559698013 (118h36m18.518795264s) [upload=123579]: Waiting for error group managing segments...
Aug 13 16:01:56.721763441 (118h36m18.680860673s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.727530195 (118h36m18.686627432s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.728285184 (118h36m18.68738242s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.736592730 (118h36m18.695689969s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.738386040 (118h36m18.697483276s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.739597394 (118h36m18.698694629s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.755620356 (118h36m18.714717595s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.759300012 (118h36m18.718397252s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.768417366 (118h36m18.727514619s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.773802478 (118h36m18.732899731s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.878542305 (118h36m18.83763954s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.914318972 (118h36m18.873416228s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.973490398 (118h36m18.932587643s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980598540 (118h36m18.939695779s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980632061 (118h36m18.939729307s) [seg_pos={0 0}, upload=123579]: Segment reached optimal threshold of 14 pieces.
Aug 13 16:01:56.980949418 (118h36m18.940046652s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981054858 (118h36m18.940152105s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection
Aug 13 16:01:56.981078543 (118h36m18.940175775s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection
Aug 13 16:01:56.981090831 (118h36m18.940188062s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c3M8p1BgTVe9F8XUmwE2F8raje9keFzAiDE5TepKTMFDxdR2Q): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981102502 (118h36m18.940199734s) [seg_pos={0 0}, upload=123579]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 16:01:56.981216904 (118h36m18.940314153s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 16:01:56.981221931 (118h36m18.940319163s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 16:01:57.268808250 (118h36m19.227905483s) [upload=123579]: Done uploading segments...
Aug 13 16:01:57.268833635 (118h36m19.227930881s) [upload=123579]: Upload finished. err: <nil>
Duration: 2.735861567s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
929.270558ms
FAIL (2025-08-13 16:05:41 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 15:52:37.423060541 (118h26m59.382157787s) [upload=123422]: Starting upload Aug 13 15:52:37.423131152 (118h26m59.382228397s) [upload=123422]: Done starting upload Aug 13 15:52:37.423247351 (118h26m59.382344585s) [upload=123422]: Uploading segments... Aug 13 15:52:37.423394744 (118h26m59.382491998s) [upload=123422]: Got next segment. Inline: true Aug 13 15:52:37.423414806 (118h26m59.38251206s) [upload=123422]: Waiting for error group managing segments... Aug 13 15:52:37.423497026 (118h26m59.382594281s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 15:52:37.423504013 (118h26m59.382601268s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 15:52:37.423508338 (118h26m59.38260559s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 15:52:37.512170488 (118h26m59.471267736s) [upload=123422]: Done uploading segments... Aug 13 15:52:37.512189314 (118h26m59.471286551s) [upload=123422]: Upload finished. err: metaclient: Too Many Requests
Duration: 929.301892ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
1.09861273s
FAIL (2025-08-13 16:05:22 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 15:52:37.423060541 (118h26m59.382157787s) [upload=123422]: Starting upload Aug 13 15:52:37.423131152 (118h26m59.382228397s) [upload=123422]: Done starting upload Aug 13 15:52:37.423247351 (118h26m59.382344585s) [upload=123422]: Uploading segments... Aug 13 15:52:37.423394744 (118h26m59.382491998s) [upload=123422]: Got next segment. Inline: true Aug 13 15:52:37.423414806 (118h26m59.38251206s) [upload=123422]: Waiting for error group managing segments... Aug 13 15:52:37.423497026 (118h26m59.382594281s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 15:52:37.423504013 (118h26m59.382601268s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 15:52:37.423508338 (118h26m59.38260559s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 15:52:37.512170488 (118h26m59.471267736s) [upload=123422]: Done uploading segments... Aug 13 15:52:37.512189314 (118h26m59.471286551s) [upload=123422]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.09865935s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [.......X......................XX.....X.......X....X....X....] duration:
2.519227849s
FAIL (2025-08-13 16:04:52 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 16:01:55.740236569 (118h36m17.699333823s) [upload=123579]: Starting upload
Aug 13 16:01:55.740313857 (118h36m17.699411124s) [upload=123579]: Done starting upload
Aug 13 16:01:55.740738444 (118h36m17.699835697s) [upload=123579]: Uploading segments...
Aug 13 16:01:55.740814721 (118h36m17.699911976s) [upload=123579]: Got next segment. Inline: false
Aug 13 16:01:55.740869673 (118h36m17.699966933s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 16:01:55.740876857 (118h36m17.699974112s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 16:01:55.981812059 (118h36m17.940909336s) [seg_pos={0 0}, upload=123579]: Begin upload segment...
Aug 13 16:01:55.981895391 (118h36m17.940992669s) [seg_pos={0 0}, upload=123579]: Done begin upload segment.
Aug 13 16:01:55.981975453 (118h36m17.941072708s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982056793 (118h36m17.941154065s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982487161 (118h36m17.94158441s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982609215 (118h36m17.94170647s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982789408 (118h36m17.941886656s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983072248 (118h36m17.942169496s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983083057 (118h36m17.942180312s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983354911 (118h36m17.942452157s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983514251 (118h36m17.942611518s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983643753 (118h36m17.942740987s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984072147 (118h36m17.943169404s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984099587 (118h36m17.943196843s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984474849 (118h36m17.943572101s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984523663 (118h36m17.94362092s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984999396 (118h36m17.944096654s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985431509 (118h36m17.944528767s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985836559 (118h36m17.944933814s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.986258205 (118h36m17.945355464s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:56.559658395 (118h36m18.518755642s) [upload=123579]: Next returned nil segment
Aug 13 16:01:56.559698013 (118h36m18.518795264s) [upload=123579]: Waiting for error group managing segments...
Aug 13 16:01:56.721763441 (118h36m18.680860673s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.727530195 (118h36m18.686627432s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.728285184 (118h36m18.68738242s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.736592730 (118h36m18.695689969s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.738386040 (118h36m18.697483276s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.739597394 (118h36m18.698694629s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.755620356 (118h36m18.714717595s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.759300012 (118h36m18.718397252s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.768417366 (118h36m18.727514619s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.773802478 (118h36m18.732899731s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.878542305 (118h36m18.83763954s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.914318972 (118h36m18.873416228s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.973490398 (118h36m18.932587643s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980598540 (118h36m18.939695779s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980632061 (118h36m18.939729307s) [seg_pos={0 0}, upload=123579]: Segment reached optimal threshold of 14 pieces.
Aug 13 16:01:56.980949418 (118h36m18.940046652s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981054858 (118h36m18.940152105s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection
Aug 13 16:01:56.981078543 (118h36m18.940175775s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection
Aug 13 16:01:56.981090831 (118h36m18.940188062s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c3M8p1BgTVe9F8XUmwE2F8raje9keFzAiDE5TepKTMFDxdR2Q): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981102502 (118h36m18.940199734s) [seg_pos={0 0}, upload=123579]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 16:01:56.981216904 (118h36m18.940314153s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 16:01:56.981221931 (118h36m18.940319163s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 16:01:57.268808250 (118h36m19.227905483s) [upload=123579]: Done uploading segments...
Aug 13 16:01:57.268833635 (118h36m19.227930881s) [upload=123579]: Upload finished. err: <nil>
Duration: 2.519287327s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
852.602196ms
FAIL (2025-08-13 16:04:49 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 15:52:37.423060541 (118h26m59.382157787s) [upload=123422]: Starting upload Aug 13 15:52:37.423131152 (118h26m59.382228397s) [upload=123422]: Done starting upload Aug 13 15:52:37.423247351 (118h26m59.382344585s) [upload=123422]: Uploading segments... Aug 13 15:52:37.423394744 (118h26m59.382491998s) [upload=123422]: Got next segment. Inline: true Aug 13 15:52:37.423414806 (118h26m59.38251206s) [upload=123422]: Waiting for error group managing segments... Aug 13 15:52:37.423497026 (118h26m59.382594281s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 15:52:37.423504013 (118h26m59.382601268s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 15:52:37.423508338 (118h26m59.38260559s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 15:52:37.512170488 (118h26m59.471267736s) [upload=123422]: Done uploading segments... Aug 13 15:52:37.512189314 (118h26m59.471286551s) [upload=123422]: Upload finished. err: metaclient: Too Many Requests
Duration: 852.634779ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
834.007772ms
FAIL (2025-08-13 16:04:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 15:52:37.423060541 (118h26m59.382157787s) [upload=123422]: Starting upload Aug 13 15:52:37.423131152 (118h26m59.382228397s) [upload=123422]: Done starting upload Aug 13 15:52:37.423247351 (118h26m59.382344585s) [upload=123422]: Uploading segments... Aug 13 15:52:37.423394744 (118h26m59.382491998s) [upload=123422]: Got next segment. Inline: true Aug 13 15:52:37.423414806 (118h26m59.38251206s) [upload=123422]: Waiting for error group managing segments... Aug 13 15:52:37.423497026 (118h26m59.382594281s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 15:52:37.423504013 (118h26m59.382601268s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 15:52:37.423508338 (118h26m59.38260559s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 15:52:37.512170488 (118h26m59.471267736s) [upload=123422]: Done uploading segments... Aug 13 15:52:37.512189314 (118h26m59.471286551s) [upload=123422]: Upload finished. err: metaclient: Too Many Requests
Duration: 834.127306ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [X.......X......................XX.....X.......X....X....X...] duration:
2.416175522s
FAIL (2025-08-13 16:03:50 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 16:01:55.740236569 (118h36m17.699333823s) [upload=123579]: Starting upload
Aug 13 16:01:55.740313857 (118h36m17.699411124s) [upload=123579]: Done starting upload
Aug 13 16:01:55.740738444 (118h36m17.699835697s) [upload=123579]: Uploading segments...
Aug 13 16:01:55.740814721 (118h36m17.699911976s) [upload=123579]: Got next segment. Inline: false
Aug 13 16:01:55.740869673 (118h36m17.699966933s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 16:01:55.740876857 (118h36m17.699974112s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 16:01:55.981812059 (118h36m17.940909336s) [seg_pos={0 0}, upload=123579]: Begin upload segment...
Aug 13 16:01:55.981895391 (118h36m17.940992669s) [seg_pos={0 0}, upload=123579]: Done begin upload segment.
Aug 13 16:01:55.981975453 (118h36m17.941072708s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982056793 (118h36m17.941154065s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982487161 (118h36m17.94158441s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982609215 (118h36m17.94170647s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982789408 (118h36m17.941886656s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983072248 (118h36m17.942169496s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983083057 (118h36m17.942180312s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983354911 (118h36m17.942452157s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983514251 (118h36m17.942611518s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983643753 (118h36m17.942740987s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984072147 (118h36m17.943169404s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984099587 (118h36m17.943196843s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984474849 (118h36m17.943572101s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984523663 (118h36m17.94362092s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984999396 (118h36m17.944096654s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985431509 (118h36m17.944528767s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985836559 (118h36m17.944933814s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.986258205 (118h36m17.945355464s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:56.559658395 (118h36m18.518755642s) [upload=123579]: Next returned nil segment
Aug 13 16:01:56.559698013 (118h36m18.518795264s) [upload=123579]: Waiting for error group managing segments...
Aug 13 16:01:56.721763441 (118h36m18.680860673s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.727530195 (118h36m18.686627432s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.728285184 (118h36m18.68738242s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.736592730 (118h36m18.695689969s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.738386040 (118h36m18.697483276s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.739597394 (118h36m18.698694629s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.755620356 (118h36m18.714717595s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.759300012 (118h36m18.718397252s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.768417366 (118h36m18.727514619s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.773802478 (118h36m18.732899731s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.878542305 (118h36m18.83763954s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.914318972 (118h36m18.873416228s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.973490398 (118h36m18.932587643s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980598540 (118h36m18.939695779s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980632061 (118h36m18.939729307s) [seg_pos={0 0}, upload=123579]: Segment reached optimal threshold of 14 pieces.
Aug 13 16:01:56.980949418 (118h36m18.940046652s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981054858 (118h36m18.940152105s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection
Aug 13 16:01:56.981078543 (118h36m18.940175775s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection
Aug 13 16:01:56.981090831 (118h36m18.940188062s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c3M8p1BgTVe9F8XUmwE2F8raje9keFzAiDE5TepKTMFDxdR2Q): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981102502 (118h36m18.940199734s) [seg_pos={0 0}, upload=123579]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 16:01:56.981216904 (118h36m18.940314153s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 16:01:56.981221931 (118h36m18.940319163s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 16:01:57.268808250 (118h36m19.227905483s) [upload=123579]: Done uploading segments...
Aug 13 16:01:57.268833635 (118h36m19.227930881s) [upload=123579]: Upload finished. err: <nil>
Duration: 2.416214454s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
874.853648ms
FAIL (2025-08-13 16:03:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 15:52:37.423060541 (118h26m59.382157787s) [upload=123422]: Starting upload Aug 13 15:52:37.423131152 (118h26m59.382228397s) [upload=123422]: Done starting upload Aug 13 15:52:37.423247351 (118h26m59.382344585s) [upload=123422]: Uploading segments... Aug 13 15:52:37.423394744 (118h26m59.382491998s) [upload=123422]: Got next segment. Inline: true Aug 13 15:52:37.423414806 (118h26m59.38251206s) [upload=123422]: Waiting for error group managing segments... Aug 13 15:52:37.423497026 (118h26m59.382594281s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 15:52:37.423504013 (118h26m59.382601268s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 15:52:37.423508338 (118h26m59.38260559s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 15:52:37.512170488 (118h26m59.471267736s) [upload=123422]: Done uploading segments... Aug 13 15:52:37.512189314 (118h26m59.471286551s) [upload=123422]: Upload finished. err: metaclient: Too Many Requests
Duration: 874.89048ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [.X.......X......................XX.....X.......X....X....X..] duration:
2.52463985s
FAIL (2025-08-13 16:03:29 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 16:01:55.740236569 (118h36m17.699333823s) [upload=123579]: Starting upload
Aug 13 16:01:55.740313857 (118h36m17.699411124s) [upload=123579]: Done starting upload
Aug 13 16:01:55.740738444 (118h36m17.699835697s) [upload=123579]: Uploading segments...
Aug 13 16:01:55.740814721 (118h36m17.699911976s) [upload=123579]: Got next segment. Inline: false
Aug 13 16:01:55.740869673 (118h36m17.699966933s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 16:01:55.740876857 (118h36m17.699974112s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 16:01:55.981812059 (118h36m17.940909336s) [seg_pos={0 0}, upload=123579]: Begin upload segment...
Aug 13 16:01:55.981895391 (118h36m17.940992669s) [seg_pos={0 0}, upload=123579]: Done begin upload segment.
Aug 13 16:01:55.981975453 (118h36m17.941072708s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982056793 (118h36m17.941154065s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982487161 (118h36m17.94158441s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982609215 (118h36m17.94170647s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982789408 (118h36m17.941886656s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983072248 (118h36m17.942169496s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983083057 (118h36m17.942180312s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983354911 (118h36m17.942452157s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983514251 (118h36m17.942611518s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983643753 (118h36m17.942740987s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984072147 (118h36m17.943169404s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984099587 (118h36m17.943196843s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984474849 (118h36m17.943572101s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984523663 (118h36m17.94362092s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984999396 (118h36m17.944096654s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985431509 (118h36m17.944528767s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985836559 (118h36m17.944933814s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.986258205 (118h36m17.945355464s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:56.559658395 (118h36m18.518755642s) [upload=123579]: Next returned nil segment
Aug 13 16:01:56.559698013 (118h36m18.518795264s) [upload=123579]: Waiting for error group managing segments...
Aug 13 16:01:56.721763441 (118h36m18.680860673s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.727530195 (118h36m18.686627432s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.728285184 (118h36m18.68738242s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.736592730 (118h36m18.695689969s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.738386040 (118h36m18.697483276s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.739597394 (118h36m18.698694629s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.755620356 (118h36m18.714717595s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.759300012 (118h36m18.718397252s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.768417366 (118h36m18.727514619s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.773802478 (118h36m18.732899731s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.878542305 (118h36m18.83763954s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.914318972 (118h36m18.873416228s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.973490398 (118h36m18.932587643s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980598540 (118h36m18.939695779s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980632061 (118h36m18.939729307s) [seg_pos={0 0}, upload=123579]: Segment reached optimal threshold of 14 pieces.
Aug 13 16:01:56.980949418 (118h36m18.940046652s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981054858 (118h36m18.940152105s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection
Aug 13 16:01:56.981078543 (118h36m18.940175775s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection
Aug 13 16:01:56.981090831 (118h36m18.940188062s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c3M8p1BgTVe9F8XUmwE2F8raje9keFzAiDE5TepKTMFDxdR2Q): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981102502 (118h36m18.940199734s) [seg_pos={0 0}, upload=123579]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 16:01:56.981216904 (118h36m18.940314153s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 16:01:56.981221931 (118h36m18.940319163s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 16:01:57.268808250 (118h36m19.227905483s) [upload=123579]: Done uploading segments...
Aug 13 16:01:57.268833635 (118h36m19.227930881s) [upload=123579]: Upload finished. err: <nil>
Duration: 2.5246862s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [..X.......X......................XX.....X.......X....X....X.] duration:
2.486979698s
FAIL (2025-08-13 16:02:38 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 16:01:55.740236569 (118h36m17.699333823s) [upload=123579]: Starting upload
Aug 13 16:01:55.740313857 (118h36m17.699411124s) [upload=123579]: Done starting upload
Aug 13 16:01:55.740738444 (118h36m17.699835697s) [upload=123579]: Uploading segments...
Aug 13 16:01:55.740814721 (118h36m17.699911976s) [upload=123579]: Got next segment. Inline: false
Aug 13 16:01:55.740869673 (118h36m17.699966933s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 16:01:55.740876857 (118h36m17.699974112s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 16:01:55.981812059 (118h36m17.940909336s) [seg_pos={0 0}, upload=123579]: Begin upload segment...
Aug 13 16:01:55.981895391 (118h36m17.940992669s) [seg_pos={0 0}, upload=123579]: Done begin upload segment.
Aug 13 16:01:55.981975453 (118h36m17.941072708s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982056793 (118h36m17.941154065s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982487161 (118h36m17.94158441s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982609215 (118h36m17.94170647s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982789408 (118h36m17.941886656s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983072248 (118h36m17.942169496s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983083057 (118h36m17.942180312s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983354911 (118h36m17.942452157s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983514251 (118h36m17.942611518s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983643753 (118h36m17.942740987s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984072147 (118h36m17.943169404s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984099587 (118h36m17.943196843s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984474849 (118h36m17.943572101s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984523663 (118h36m17.94362092s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984999396 (118h36m17.944096654s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985431509 (118h36m17.944528767s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985836559 (118h36m17.944933814s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.986258205 (118h36m17.945355464s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:56.559658395 (118h36m18.518755642s) [upload=123579]: Next returned nil segment
Aug 13 16:01:56.559698013 (118h36m18.518795264s) [upload=123579]: Waiting for error group managing segments...
Aug 13 16:01:56.721763441 (118h36m18.680860673s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.727530195 (118h36m18.686627432s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.728285184 (118h36m18.68738242s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.736592730 (118h36m18.695689969s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.738386040 (118h36m18.697483276s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.739597394 (118h36m18.698694629s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.755620356 (118h36m18.714717595s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.759300012 (118h36m18.718397252s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.768417366 (118h36m18.727514619s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.773802478 (118h36m18.732899731s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.878542305 (118h36m18.83763954s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.914318972 (118h36m18.873416228s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.973490398 (118h36m18.932587643s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980598540 (118h36m18.939695779s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980632061 (118h36m18.939729307s) [seg_pos={0 0}, upload=123579]: Segment reached optimal threshold of 14 pieces.
Aug 13 16:01:56.980949418 (118h36m18.940046652s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981054858 (118h36m18.940152105s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection
Aug 13 16:01:56.981078543 (118h36m18.940175775s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection
Aug 13 16:01:56.981090831 (118h36m18.940188062s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c3M8p1BgTVe9F8XUmwE2F8raje9keFzAiDE5TepKTMFDxdR2Q): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981102502 (118h36m18.940199734s) [seg_pos={0 0}, upload=123579]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 16:01:56.981216904 (118h36m18.940314153s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 16:01:56.981221931 (118h36m18.940319163s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 16:01:57.268808250 (118h36m19.227905483s) [upload=123579]: Done uploading segments...
Aug 13 16:01:57.268833635 (118h36m19.227930881s) [upload=123579]: Upload finished. err: <nil>
Duration: 2.487039271s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
852.413986ms
FAIL (2025-08-13 16:02:32 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 13 15:52:37.423060541 (118h26m59.382157787s) [upload=123422]: Starting upload Aug 13 15:52:37.423131152 (118h26m59.382228397s) [upload=123422]: Done starting upload Aug 13 15:52:37.423247351 (118h26m59.382344585s) [upload=123422]: Uploading segments... Aug 13 15:52:37.423394744 (118h26m59.382491998s) [upload=123422]: Got next segment. Inline: true Aug 13 15:52:37.423414806 (118h26m59.38251206s) [upload=123422]: Waiting for error group managing segments... Aug 13 15:52:37.423497026 (118h26m59.382594281s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 13 15:52:37.423504013 (118h26m59.382601268s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 13 15:52:37.423508338 (118h26m59.38260559s) [upload=123422]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 13 15:52:37.512170488 (118h26m59.471267736s) [upload=123422]: Done uploading segments... Aug 13 15:52:37.512189314 (118h26m59.471286551s) [upload=123422]: Upload finished. err: metaclient: Too Many Requests
Duration: 852.441291ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [...X.......X......................XX.....X.......X....X....X] duration:
2.023020821s
FAIL (2025-08-13 16:01:57 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 13 16:01:55.740236569 (118h36m17.699333823s) [upload=123579]: Starting upload
Aug 13 16:01:55.740313857 (118h36m17.699411124s) [upload=123579]: Done starting upload
Aug 13 16:01:55.740738444 (118h36m17.699835697s) [upload=123579]: Uploading segments...
Aug 13 16:01:55.740814721 (118h36m17.699911976s) [upload=123579]: Got next segment. Inline: false
Aug 13 16:01:55.740869673 (118h36m17.699966933s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 13 16:01:55.740876857 (118h36m17.699974112s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 13 16:01:55.981812059 (118h36m17.940909336s) [seg_pos={0 0}, upload=123579]: Begin upload segment...
Aug 13 16:01:55.981895391 (118h36m17.940992669s) [seg_pos={0 0}, upload=123579]: Done begin upload segment.
Aug 13 16:01:55.981975453 (118h36m17.941072708s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982056793 (118h36m17.941154065s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982487161 (118h36m17.94158441s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982609215 (118h36m17.94170647s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.982789408 (118h36m17.941886656s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983072248 (118h36m17.942169496s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983083057 (118h36m17.942180312s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983354911 (118h36m17.942452157s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983514251 (118h36m17.942611518s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.983643753 (118h36m17.942740987s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984072147 (118h36m17.943169404s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984099587 (118h36m17.943196843s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984474849 (118h36m17.943572101s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984523663 (118h36m17.94362092s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.984999396 (118h36m17.944096654s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985431509 (118h36m17.944528767s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.985836559 (118h36m17.944933814s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:55.986258205 (118h36m17.945355464s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Uploading piece...
Aug 13 16:01:56.559658395 (118h36m18.518755642s) [upload=123579]: Next returned nil segment
Aug 13 16:01:56.559698013 (118h36m18.518795264s) [upload=123579]: Waiting for error group managing segments...
Aug 13 16:01:56.721763441 (118h36m18.680860673s) [noise=true , address=77.90.31.10:4537 , piece_id=KVJULM65U6URS6JWPMVCG53F6OE5JG3EEWKASJGBUJM5BERV26IA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.727530195 (118h36m18.686627432s) [noise=true , address=104.36.82.46:4503 , piece_id=EKMBTLEPODMRQ4Y4Q57ZPODGLB2RZIEA5KHUVA26DA7MRQYFDZ6A, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.728285184 (118h36m18.68738242s) [noise=true , address=104.36.82.34:4557 , piece_id=4I22EGEVVLTNBJW5TV2MX2HHJNWZSJPTLDUUJVNJOMVWXKNMX4PA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.736592730 (118h36m18.695689969s) [noise=true , address=104.36.82.39:4755 , piece_id=ODPWL7YMR33BFXLIWPAETI2OOBGO7UOPVCQD6P6MLVDFMHQFHATA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.738386040 (118h36m18.697483276s) [noise=true , address=104.36.82.22:4542 , piece_id=Z63VSY2LUMCQ6HVUC66OS24A3RNE7EG4XZI5SAOF43PGDZJJKYLA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.739597394 (118h36m18.698694629s) [noise=true , address=104.36.82.6:4895 , piece_id=CPGWGGAJLNP7YYJBMZR5OBWHLQSMIAXQBQQ3P2AZPZ4OQCSP3TVA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.755620356 (118h36m18.714717595s) [noise=true , address=104.36.82.16:4319 , piece_id=EV2TRA4CWZWLM64AZBONFXF35NEEJVDZU7ANYLMC25P7C4THUNJA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.759300012 (118h36m18.718397252s) [noise=true , address=104.36.82.5:4841 , piece_id=TXDXBG7HIC6UH5WMSUXBFYL73GJDUIDSZLSUPYIIWAB6ULEW22PQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.768417366 (118h36m18.727514619s) [noise=true , address=104.36.82.45:4911 , piece_id=FS7JDMXG5DQH2MB6J53DHTF4VMRIEU6EMCSBI7VISE4RZNODHLVQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.773802478 (118h36m18.732899731s) [noise=true , address=79.127.219.38:4024 , piece_id=YXMZ5MMAYVP4XHP6NU2VCBEAIAJJ4GA4WBMZATYXGHDLM4WEMJUA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.878542305 (118h36m18.83763954s) [noise=true , address=79.127.220.101:4066 , piece_id=RI26VIRUX67HQR2GGDWK5COXBA4QOFKJIBYIXTAI6NHYAM4APS5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.914318972 (118h36m18.873416228s) [noise=true , address=104.36.82.60:4368 , piece_id=626H5TAVSUINZCABX4ZPG624GZC27VTDXWLWJF2LN5HCWPNJUSOQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.973490398 (118h36m18.932587643s) [noise=true , address=79.127.201.215:4346 , piece_id=TZAJGGFUCBUFVH3BJV7BOODYAWG3GCN3OI4RQIZKZBYSA37EE7BA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980598540 (118h36m18.939695779s) [noise=true , address=104.36.82.37:4683 , piece_id=PIIL2UG6JUXQHUTKR6IQY32QUK7DSAXK5BRQZ3FP2F4QITTB4JBA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: <nil>
Aug 13 16:01:56.980632061 (118h36m18.939729307s) [seg_pos={0 0}, upload=123579]: Segment reached optimal threshold of 14 pieces.
Aug 13 16:01:56.980949418 (118h36m18.940046652s) [noise=true , address=66.23.193.175:4555 , piece_id=TEQXXCCV3R2HKENKC44VGXZHWASYOASDAS75WG46SYRATIEH7LWQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QyjnGRYsz48NFF9dV1JYxNR9x4JjD86GE8YxvCGRBNoUuwma8): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981054858 (118h36m18.940152105s) [noise=true , address=66.23.193.175:4559 , piece_id=EQUDDMLHQSBF76X3KWI2WI6SOVS5AZCSJMDCQ3RSGQX2RIQ2TO5Q, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ZedZCGumnM48qSS4jd68SuW45Q5SMqxY4UZvLrBkoWX4i6syp): protocol: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:55816->66.23.193.175:4559: use of closed network connection
Aug 13 16:01:56.981078543 (118h36m18.940175775s) [noise=true , address=64.49.13.140:4516 , piece_id=YSCF7VGBSUZFLZJNSRDDFFAH6Q3GM2QUHIZHTB2YW6U4CCW47PXQ, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122dviPhVkb4TfDr3dSuQ5uXYr7mqYZGyawsfaiDa5CPtyEFi5D): protocol: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection; piecestore: piecestore close: write tcp 139.59.144.22:59196->64.49.13.140:4516: use of closed network connection
Aug 13 16:01:56.981090831 (118h36m18.940188062s) [noise=true , address=156.146.43.225:4442 , piece_id=FWGD4UWXUC4EBWMBFAIVYVGBTR2DGPJ5WA4JNQR7IHKGDTEFJ4SA, seg_pos={0 0}, upload=123579]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1c3M8p1BgTVe9F8XUmwE2F8raje9keFzAiDE5TepKTMFDxdR2Q): protocol: expected piece hash; context canceled; EOF
Aug 13 16:01:56.981102502 (118h36m18.940199734s) [seg_pos={0 0}, upload=123579]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 13 16:01:56.981216904 (118h36m18.940314153s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 13 16:01:56.981221931 (118h36m18.940319163s) [upload=123579]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 13 16:01:57.268808250 (118h36m19.227905483s) [upload=123579]: Done uploading segments...
Aug 13 16:01:57.268833635 (118h36m19.227930881s) [upload=123579]: Upload finished. err: <nil>
Duration: 2.023055567s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|