Persistent TM Store #320

Merged
muellerr merged 109 commits from mueller/pus-15-tm-storage into develop 2023-02-24 19:03:39 +01:00
Owner

FSFW PR/Branch: eive/fsfw#116

FSFW PR/Branch: https://egit.irs.uni-stuttgart.de/eive/fsfw/pulls/116
muellerr added 6 commits 2022-11-11 11:25:35 +01:00
EIVE/eive-obsw/pipeline/head This commit looks good Details
098741ffe6
start adding basic pus 15 components
EIVE/eive-obsw/pipeline/head This commit looks good Details
e897fb63d8
use CSB backend instead
EIVE/eive-obsw/pipeline/head This commit looks good Details
ed76062904
bump fsfw
EIVE/eive-obsw/pipeline/head This commit looks good Details
46a756b1ee
some updates
EIVE/eive-obsw/pipeline/head This commit looks good Details
d5867f104f
continue tm store
EIVE/eive-obsw/pipeline/head This commit looks good Details
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
31093c0d13
bump fsfw
muellerr changed title from TM Store/Backend to WIP: TM Store/Backend 2022-11-11 11:25:41 +01:00
muellerr added 1 commit 2022-11-11 11:26:48 +01:00
EIVE/eive-obsw/pipeline/pr-develop There was a failure building this commit Details
08c225a633
Merge remote-tracking branch 'origin/develop' into mueller/pus-15-tm-storage
muellerr added 1 commit 2022-11-11 11:29:32 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
4ca892e9f3
bump fsfw
muellerr added 1 commit 2022-11-11 11:38:33 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
608632fde3
bump fsfw
muellerr added 1 commit 2022-11-11 11:42:34 +01:00
EIVE/eive-obsw/pipeline/pr-develop There was a failure building this commit Details
8d0c6ebc57
Merge remote-tracking branch 'origin/develop' into mueller/pus-15-tm-storage
muellerr added 1 commit 2022-11-11 11:43:35 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
f60a80f308
fix merge conflict
muellerr added this to the v1.16.0 milestone 2022-11-11 11:44:13 +01:00
muellerr added 1 commit 2022-11-11 15:39:24 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
c599714aea
some sort of filter handling
muellerr modified the milestone from v1.16.0 to v1.17.0 2022-11-18 14:24:55 +01:00
muellerr added 1 commit 2022-11-18 14:30:09 +01:00
EIVE/eive-obsw/pipeline/pr-develop There was a failure building this commit Details
666c7bc77f
Merge remote-tracking branch 'origin/develop' into mueller/pus-15-tm-storage
muellerr added 1 commit 2022-11-24 14:48:56 +01:00
EIVE/eive-obsw/pipeline/pr-develop There was a failure building this commit Details
e3730a9b94
Merge remote-tracking branch 'origin/develop' into mueller/pus-15-tm-storage
muellerr added 1 commit 2022-11-24 15:16:37 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
da98cd77e8
bump fsfw
muellerr added 1 commit 2022-11-28 11:37:13 +01:00
muellerr modified the milestone from v1.17.0 to v1.18.0 2022-11-28 18:30:27 +01:00
muellerr added 1 commit 2022-11-28 18:32:30 +01:00
muellerr modified the milestone from v1.18.0 to v1.19.0 2022-12-01 16:38:45 +01:00
muellerr added 1 commit 2022-12-01 16:40:35 +01:00
muellerr added 1 commit 2022-12-12 09:02:04 +01:00
muellerr added 1 commit 2022-12-12 10:06:28 +01:00
EIVE/eive-obsw/pipeline/pr-develop There was a failure building this commit Details
fba820a1c0
start storage algorithms
muellerr added 1 commit 2022-12-12 14:58:43 +01:00
EIVE/eive-obsw/pipeline/pr-develop There was a failure building this commit Details
c493273a21
oh god sscanf
muellerr added 1 commit 2022-12-12 16:04:26 +01:00
EIVE/eive-obsw/pipeline/pr-develop There was a failure building this commit Details
6f1f92c9d1
i wonder if this even works
muellerr added 1 commit 2022-12-12 16:17:52 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
279697b326
test stamp in filename
muellerr added 1 commit 2022-12-12 16:30:08 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
a9699ad969
this should work
muellerr added 1 commit 2022-12-12 18:18:14 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
293082a7e8
this logic should work
muellerr added 1 commit 2022-12-12 18:26:56 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
ed603f4e48
continued TM store impl
muellerr added 1 commit 2022-12-12 18:42:50 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
1f381d9477
implemented core write
muellerr added 2 commits 2022-12-13 10:08:43 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
04b04ed859
update state as well
muellerr added 1 commit 2022-12-13 13:47:00 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
eddc620307
interval calculation bugfix
muellerr added 1 commit 2022-12-13 14:19:26 +01:00
EIVE/eive-obsw/pipeline/pr-develop There was a failure building this commit Details
3965c08bfb
add misc store
muellerr added 1 commit 2022-12-13 14:26:07 +01:00
EIVE/eive-obsw/pipeline/pr-develop There was a failure building this commit Details
828d791da5
add misc store
muellerr added 1 commit 2022-12-13 14:30:01 +01:00
EIVE/eive-obsw/pipeline/pr-develop There was a failure building this commit Details
fcc9858b66
use new packet store
muellerr added 1 commit 2022-12-13 14:33:06 +01:00
EIVE/eive-obsw/pipeline/pr-develop There was a failure building this commit Details
33ac72de83
check whether SD card is usable
muellerr added 1 commit 2022-12-13 14:38:17 +01:00
EIVE/eive-obsw/pipeline/pr-develop There was a failure building this commit Details
130a3ce727
initialize stores as well
muellerr added 1 commit 2022-12-13 15:24:41 +01:00
EIVE/eive-obsw/pipeline/pr-develop There was a failure building this commit Details
8c10cbe37b
the stores only keep references to the current time
muellerr added 1 commit 2022-12-13 15:33:58 +01:00
EIVE/eive-obsw/pipeline/pr-develop There was a failure building this commit Details
283b897ae7
allow minutely rollover as well
muellerr added 1 commit 2022-12-13 15:35:27 +01:00
EIVE/eive-obsw/pipeline/pr-develop There was a failure building this commit Details
8858084f6e
introduce new second interval
muellerr added 1 commit 2022-12-13 15:43:33 +01:00
EIVE/eive-obsw/pipeline/pr-develop There was a failure building this commit Details
3e17de0127
update clock every 5 minutes
muellerr added 1 commit 2022-12-13 15:56:25 +01:00
EIVE/eive-obsw/pipeline/pr-develop There was a failure building this commit Details
d37f48336b
ok im done
muellerr added 1 commit 2022-12-14 09:53:47 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
9c217ad91e
now hosted should compile again
muellerr added 1 commit 2022-12-14 10:14:48 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
2d72942d47
important bugfix
muellerr added 2 commits 2022-12-14 10:35:36 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
9cea0c50c3
using const char* instead
muellerr added 1 commit 2022-12-14 10:42:08 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
58d6b59b7c
it seems to work now
muellerr added 1 commit 2022-12-14 10:54:13 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
ff9bcd6b14
added remaining missing stores
muellerr added 1 commit 2022-12-14 11:00:07 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
5d67b896aa
improve store init handling, add remaining stores
muellerr added 1 commit 2022-12-14 11:29:28 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
ec02332615
start implementing the PUS Service
muellerr added 1 commit 2022-12-14 13:19:25 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
4d473315fe
allow sending TC requests to funnels
muellerr added 1 commit 2022-12-14 13:51:08 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
5431dfc9bd
basic packet routing
muellerr added 1 commit 2022-12-14 15:09:43 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
62b3e16ac4
add service 2
muellerr added 1 commit 2022-12-14 15:41:05 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
b6522c9fb3
that should do the job
muellerr added 1 commit 2022-12-16 13:26:17 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
bbf0def3ff
add missing dot
muellerr added 1 commit 2022-12-19 13:25:26 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
74f116f2fa
that should be the basic interface
muellerr added 1 commit 2022-12-19 13:56:45 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
c4c1f09f2e
continue request handling
muellerr added 1 commit 2022-12-19 14:00:56 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
b9753dc5ba
added dump command forwarding
muellerr added 1 commit 2022-12-19 14:40:21 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
d9453c3b83
absolutely magnificent
muellerr added 1 commit 2022-12-19 15:23:20 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
29fd2653f1
added TODO with steps
muellerr modified the milestone from v1.19.0 to v1.20.0 2023-01-10 16:25:16 +01:00
muellerr added 1 commit 2023-01-11 09:18:13 +01:00
muellerr added 1 commit 2023-01-11 09:18:17 +01:00
muellerr added 1 commit 2023-01-23 14:22:00 +01:00
muellerr modified the milestone from v1.20.0 to v1.21.0 2023-01-24 12:28:20 +01:00
muellerr modified the milestone from v1.21.0 to v1.22.0 2023-01-26 20:55:10 +01:00
muellerr modified the milestone from v1.22.0 to v1.23.0 2023-01-28 14:59:23 +01:00
muellerr modified the milestone from v1.23.0 to v1.24.0 2023-02-02 17:23:06 +01:00
muellerr modified the milestone from v1.24.0 to v1.25.0 2023-02-03 16:46:24 +01:00
muellerr modified the milestone from v1.25.0 to v1.26.0 2023-02-06 20:21:19 +01:00
muellerr added 1 commit 2023-02-07 10:54:47 +01:00
muellerr added 2 commits 2023-02-07 12:22:43 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
94fee2d429
some more fixes and tweaks
muellerr added 1 commit 2023-02-07 15:21:42 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
d82810d5e7
add dumpFrom method
muellerr modified the milestone from v1.26.0 to v1.27.0 2023-02-08 14:53:30 +01:00
muellerr added 1 commit 2023-02-08 17:43:21 +01:00
muellerr modified the milestone from v1.27.0 to v1.28.0 2023-02-14 14:16:50 +01:00
muellerr added 1 commit 2023-02-14 17:45:30 +01:00
muellerr modified the milestone from v1.28.0 to v1.29.0 2023-02-17 11:19:53 +01:00
muellerr added 1 commit 2023-02-17 11:20:35 +01:00
EIVE/eive-obsw/pipeline/pr-develop There was a failure building this commit Details
12c5a10662
Merge remote-tracking branch 'origin/develop' into mueller/pus-15-tm-storage
muellerr added 1 commit 2023-02-17 11:52:13 +01:00
EIVE/eive-obsw/pipeline/pr-develop Build queued... Details
47e97ff1be
bump fsfw
muellerr added 1 commit 2023-02-17 11:52:29 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
cb6a98b0d2
bump fsfw
muellerr added 2 commits 2023-02-17 13:18:19 +01:00
muellerr added 1 commit 2023-02-17 17:00:13 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
da898a3f16
add CLion config for CMake
muellerr added 1 commit 2023-02-17 17:05:36 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
6f4c81117b
add small clion section
muellerr added 1 commit 2023-02-17 17:32:13 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
5abecd065c
add Q7S run config
muellerr added 1 commit 2023-02-17 18:35:38 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
10a18ba6af
re-run generators
muellerr added 1 commit 2023-02-20 13:34:33 +01:00
muellerr added 1 commit 2023-02-20 13:45:12 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
4fe14b464a
update cmake cfg
muellerr added 1 commit 2023-02-20 15:05:43 +01:00
muellerr added 1 commit 2023-02-20 15:17:35 +01:00
EIVE/eive-obsw/pipeline/pr-develop There was a failure building this commit Details
fd0da7379a
only process on TC request per cycle
muellerr added 1 commit 2023-02-20 15:42:04 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
a3f2219f9b
pass HK and not ok packets as well
muellerr added 1 commit 2023-02-20 16:10:32 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
a7d3f2c3f8
add PUS TM store
muellerr added 1 commit 2023-02-20 16:12:54 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
67e9dc9090
small clang tidy stuff
muellerr added 1 commit 2023-02-20 17:57:15 +01:00
EIVE/eive-obsw/pipeline/pr-develop There was a failure building this commit Details
82c97656f1
clangtidy
muellerr added 1 commit 2023-02-20 20:06:26 +01:00
muellerr added 1 commit 2023-02-21 11:14:49 +01:00
muellerr modified the milestone from v1.29.0 to v1.30.0 2023-02-21 11:30:55 +01:00
muellerr added 4 commits 2023-02-22 13:28:02 +01:00
muellerr added 1 commit 2023-02-22 14:21:24 +01:00
EIVE/eive-obsw/pipeline/pr-develop There was a failure building this commit Details
6c16238cc7
small tweaks
muellerr added 1 commit 2023-02-22 14:27:48 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
2ee70d53d9
more tweaks
muellerr changed title from WIP: TM Store/Backend to WIP: Persistent TM Store 2023-02-22 14:36:38 +01:00
muellerr added 1 commit 2023-02-22 14:49:48 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
8b45786e5d
changelog
muellerr added 1 commit 2023-02-22 15:15:20 +01:00
muellerr added 1 commit 2023-02-22 15:17:04 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
5f6f806b88
update release checklist
muellerr added 1 commit 2023-02-22 15:28:21 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
ee811371c5
make EM build work
muellerr added 1 commit 2023-02-22 15:46:00 +01:00
EIVE/eive-obsw/pipeline/pr-develop There was a failure building this commit Details
9633359db3
spi RTD Polling dummy
muellerr added 1 commit 2023-02-22 18:06:40 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
90c1d45f20
correction for prefix handling on Q7S
muellerr changed title from WIP: Persistent TM Store to Persistent TM Store 2023-02-22 18:23:50 +01:00
muellerr requested review from gaisser 2023-02-22 18:23:58 +01:00
muellerr requested review from meierj 2023-02-22 18:24:03 +01:00
gaisser requested changes 2023-02-22 20:20:16 +01:00
gaisser left a comment
Member

Some things but I don't get some parts of it and its too large to think through everything.

Some things but I don't get some parts of it and its too large to think through everything.
@ -0,0 +14,4 @@
using namespace returnvalue;
PersistentTmStore::PersistentTmStore(object_id_t objectId, const char* baseDir,
Member

I don't get why the stores need a reference to a central time. They can look that up by their own I think. Is it necessary to have all stores working on the exact same time?

I don't get why the stores need a reference to a central time. They can look that up by their own I think. Is it necessary to have all stores working on the exact same time?
Author
Owner

No. I'll probably update the code so each persistent store calls `Clock::getClock_timeval

No. I'll probably update the code so each persistent store calls `Clock::getClock_timeval
muellerr marked this conversation as resolved
@ -0,0 +155,4 @@
}
}
if (currentTv.tv_sec < activeFileTv.tv_sec or
Member

Might be old

Might be old
muellerr marked this conversation as resolved
@ -0,0 +157,4 @@
if (currentTv.tv_sec < activeFileTv.tv_sec or
currentTv.tv_sec - activeFileTv.tv_sec > static_cast<int>(rolloverDiffSeconds)) {
if (file_size(activeFile.value()) + reader.getFullPacketLen() > fileBuf.size()) {
Member

Check position of inner if

Check position of inner if
muellerr marked this conversation as resolved
@ -0,0 +168,4 @@
appendedCounter++;
}
rename(activeFile.value(), rolloverName);
std::ofstream of(activeFile.value(), std::ios::binary);
Member

check close and open of new file

check close and open of new file
muellerr marked this conversation as resolved
@ -0,0 +36,4 @@
SerializeAdapter::deSerialize(objectId, &tcData, &tcDataLen, SerializeIF::Endianness::NETWORK);
auto *frontendIF = ObjectManager::instance()->get<TmStoreFrontendSimpleIF>(*objectId);
if (frontendIF == nullptr) {
return FAILED;
Member

I think there is an Error code for unknown object. (CommandingServiceBase::INVALID_OBJECT)

I think there is an Error code for unknown object. (CommandingServiceBase::INVALID_OBJECT)
muellerr marked this conversation as resolved
muellerr added 1 commit 2023-02-23 15:59:14 +01:00
muellerr modified the milestone from v1.30.0 to v1.32.0 2023-02-23 16:00:04 +01:00
muellerr added 1 commit 2023-02-24 10:18:51 +01:00
muellerr added 1 commit 2023-02-24 16:59:11 +01:00
EIVE/eive-obsw/pipeline/pr-develop There was a failure building this commit Details
1744f1aff0
Merge remote-tracking branch 'origin/develop' into mueller/pus-15-tm-storage
muellerr added 2 commits 2023-02-24 18:15:23 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
cbb6a45407
remove newline
muellerr added 1 commit 2023-02-24 18:17:20 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
aae4d019e7
bugfix
muellerr added 1 commit 2023-02-24 18:19:24 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
66b4fc6294
use correct retval
muellerr added 1 commit 2023-02-24 18:41:54 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
13f2f39325
improve backup file handling
muellerr added 1 commit 2023-02-24 18:56:34 +01:00
EIVE/eive-obsw/pipeline/pr-develop This commit looks good Details
be3c778fee
bugfix
muellerr added 1 commit 2023-02-24 18:59:49 +01:00
EIVE/eive-obsw/pipeline/pr-develop Build started... Details
9501d0802f
changelog
muellerr added 1 commit 2023-02-24 19:02:40 +01:00
EIVE/eive-obsw/pipeline/pr-develop Build started... Details
746f288f1e
bump fsfw
muellerr merged commit a245966793 into develop 2023-02-24 19:03:39 +01:00
muellerr deleted branch mueller/pus-15-tm-storage 2023-02-24 19:03:40 +01:00
Sign in to join this conversation.
No description provided.