Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

📌 DB Solr Sync Auditing Log #848

Open
nickumia-reisys opened this issue Mar 3, 2023 · 5 comments
Open

📌 DB Solr Sync Auditing Log #848

nickumia-reisys opened this issue Mar 3, 2023 · 5 comments
Labels
audit O&M

Comments

@nickumia-reisys
Copy link
Contributor

nickumia-reisys commented Mar 3, 2023 •
edited by btylerburton

Workflow with Issue: 4 - Automated CKAN Jobs
Job being auditied: ckan-auto-command
CKAN Command (in question): ckan geodatagov db-solr-sync
CKAN Command Schedule: 0 3 * * *
Cloud.gov Environment: prod
Total Execution Time: 526

Last Commit: af8ff82
Number of times run: 1
Last run by: nickumia-reisys
Github Action Run: https://github.com/GSA/catalog.data.gov/actions/runs/9410956098
@nickumia-reisys nickumia-reisys added the bug Something isn't working label Mar 3, 2023
@nickumia-reisys nickumia-reisys self-assigned this Mar 3, 2023
@nickumia-reisys nickumia-reisys mentioned this issue Mar 3, 2023
Merged
@nickumia-reisys nickumia-reisys added audit and removed bug Something isn't working labels Mar 3, 2023
@nickumia-reisys
Copy link
Contributor Author

nickumia-reisys commented Mar 6, 2023 •
edited by FuhuXia

March 2023 
gantt
    title Mismatched Datasets per day (prod-only)
    dateFormat HH:mm
    axisFormat %H:%M
    section 3/4/2023
    104                      :a1, 00:00, 8m
    23(staging)          :after a1, 1m
    section 3/5/2023
    104                      :a2, 00:00, 8m
    section 3/6/2023
    58                        :a3, 00:00, 8m
    section 3/7/2023
    101                     :a4, 00:00, 8.25m
    section 3/8/2023
    101                       :a4, 00:00, 494s
    section 3/9/2023
    15853                    :a4, 00:00, 2254s
    section 3/10/2023
    13355                    :a4, 00:00, 1799s
    section 3/12/2023
    481                       :a4, 00:00, 510s
    section 3/13/2023
    30472                   :a4, 00:00, 2949s
    section 3/14/2023
    7511                    :a4, 00:00, 1114s
    section 3/15/2023
    527                     :a4, 00:00, 516s
    section 3/23/2023
    2747                     :a4, 00:00, 762s
    section 3/24/2023
    2747                     :a4, 00:00, 740s
    section 3/27/2023
    4072                     :a4, 00:00, 863s
    section 3/29/2023
    4131                     :a4, 00:00, 871s
    section 3/30/2023
    4131                     :a4, 00:00, 864s
    section 3/31/2023
    33507                     :a4, 00:00, 3570s
April 2023 
gantt
    title Mismatched Datasets per day (prod-only)
    dateFormat HH:mm
    axisFormat %H:%M
    section 4/03/2023
    4698                     :a4, 00:00, 913s
    section 4/04/2023
    4698                     :a4, 00:00, 911s
    section 4/05/2023
    4698                     :a4, 00:00, 925s
    section 4/06/2023
    4697                     :a4, 00:00, 829s
    section 4/07/2023
    10628                     :a4, 00:00, 1220s
    section 4/08/2023
    33322 updated (4 removed)   :a4, 00:00, 3406s
    section 4/09/2023
    5617                      :a4, 00:00, 858s
    section 4/10/2023
    5061                      :a4, 00:00, 799s
    section 4/11/2023
    5063                       :a4, 00:00, 832s
    section 4/12/2023
    5063                       :a4, 00:00, 889s
    section 4/13/2023
    5063                       :a4, 00:00, 837s
May 2023 
gantt
    title Mismatched Datasets per day (prod-only)
    dateFormat HH:mm
    axisFormat %H:%M
    section 5/09/2023
    8251                      :a4, 00:00, 1062s
    section 5/10/2023
    8251                     :a4, 00:00, 1015s
    section 5/11/2023
    8251                     :a4, 00:00, 1100s
    section 5/15/2023
    8805                      :a4, 00:00, 1129s
    section 5/16/2023
    8734                       :a4, 00:00, 1134s
    section 5/17/2023
    8734                       :a4, 00:00, 1111s
    section 5/18/2023
    8734                        :a4, 00:00, 1629s
    section 5/19/2023
    8688                         :a4, 00:00, 1693s
    section 5/23/2023
    6860                         :a4, 00:00, 1429s
    section 5/24/2023
    6850                         :a4, 00:00, 1443s
    section 5/25/2023
    6848                         :a4, 00:00, 1410s
    section 5/26/2023
    6892                         :a4, 00:00, 1444s
    section 5/30/2023
    8409                         :a4, 00:00, 2921s
    section 5/31/2023
    8291                         :a4, 00:00, 1647s
June 2023 
gantt
    title Mismatched Datasets per day (prod-only)
    dateFormat HH:mm
    axisFormat %H:%M
    section 6/1/2023
    8188                     :a4, 00:00, 1547s
    section 6/2/2023
    23911                      :a4, 00:00, 4234s
    section 6/20/2023
    11099                      :a4, 00:00, 3551s
    section 6/21/2023
    11099                      :a4, 00:00, 3621s
    section 6/22/2023
    8485                       :a4, 00:00, 39m
    section 6/26/2023
    925                       :a4, 00:00, 756s
    section 6/27/2023
    0                       :a4, 00:00, 456s
    section 6/28/2023
    100                       :a4, 00:00, 506s
    section 6/29/2023
    0                       :a4, 00:00, 461s
    section 6/30/2023
    100                       :a4, 00:00, 488s
July 2023 
gantt
    title Mismatched Datasets per day (prod-only)
    dateFormat HH:mm
    axisFormat %H:%M
    section 7/3/2023
    0 (removed) | 100 (updated) | 2324 (manual)                     :a4, 00:00, 525s
    section 7/4/2023
    0 (removed) | 100 (updated) | 2324 (manual)                     :a4, 00:00, 502s
    section 7/5/2023
    0 (removed) | 0 (updated) | 0 (manual)                     :a4, 00:00, 463s
    section 7/6/2023
    0 (removed) | 100 (updated) | 0 (manual)                     :a4, 00:00, 492s
    section 7/10/2023
    1 (removed) | 1166 (updated) | 3603 (manual)                     :a4, 00:00, 893s
    section 7/11/2023
    0 (removed) | 100 (updated) | 123 (manual)                     :a4, 00:00, 505s
    section 7/12/2023
    0 (removed) | 100 (updated) | 123 (manual)                     :a4, 00:00, 495s
    section 7/13/2023
    0 (removed) | 0 (updated) | 123 (manual)                     :a4, 00:00, 486s
    section 7/14/2023
    0 (removed) | 100 (updated) | 123 (manual)                     :a4, 00:00, 489s
    section 7/26/2023
    0 (removed) | 100 (updated) | 2344 (manual)                     :a4, 00:00, 522s
    section 7/27/2023
    81 (removed) | 271 (updated) | 221 (manual)                     :a4, 00:00, 649s
    section 7/31/2023
    0 (removed) | 99 (updated) | 1912 (manual)                     :a4, 00:00, 547s
August2023 
gantt
    title Mismatched Datasets per day (prod-only)
    dateFormat HH:mm
    axisFormat %H:%M
    section 8/1/2023
    0 (removed) | 96 (updated) | 1912 (manual)                     :a4, 00:00, 558s
    section 8/2/2023
    0 (removed) | 99 (updated) | 1912 (manual)                     :a4, 00:00, 547s
    section 8/3/2023
    45 (removed) | 312 (updated) | 225 (manual)                     :a4, 00:00, 744s
    section 8/4/2023
    0 (removed) | 2719 (updated) | 330 (manual)                     :a4, 00:00, 1294s
    section 8/7/2023
    5 (removed) | 1102 (updated) | 1422 (manual)                     :a4, 00:00, 907s
    section 8/8/2023
    0 (removed) | 1574 (updated) | 1422 (manual)                     :a4, 00:00, 989s
    section 8/9/2023
    0 (removed) | 101 (updated) | 1422 (manual)                     :a4, 00:00, 557s
    section 8/10/2023
    0 (removed) | 42 (updated) | 1422 (manual)                     :a4, 00:00, 536s
    section 8/11/2023
    56 (removed) | 40 (updated) | 1451 (manual)                     :a4, 00:00, 570s
    section 8/22/2023
    0 (removed) | 18 (updated) | 5306 (manual)                      :a4, 00:00, 529s
    section 8/23/2023
    0 (removed) | 19 (updated) | 5306 (manual)                      :a4, 00:00, 517s
    section 8/24/2023
    82 (removed) | 156 (updated) | 5306 (manual)                      :a4, 00:00, 774s
    section 8/27/2023
    18 (removed) | 677 (updated) | 1154 (manual)                      :a4, 00:00, 976s
    section 8/28/2023
    0 (removed) | 34 (updated) | 1154 (manual)                      :a4, 00:00, 518s
    section 8/29/2023
    0 (removed) | 25 (updated) | 2828 (manual)                      :a4, 00:00, 513s
    section 8/30/2023
    0 (removed) | 0 (updated) | 1156 (manual)                      :a4, 00:00, 508s
    section 8/31/2023
    36 (removed) | 2166 (updated) | 216 (manual)                      :a4, 00:00, 1760s
September 2023 
gantt
    title Mismatched Datasets per day (prod-only)
    dateFormat HH:mm
    axisFormat %H:%M
    section 9/11/2023
    0 (removed) | 24 (updated) | 216 (manual)                     :a4, 00:00, 511s
    section 9/13/2023
    0 (removed) | 0 (updated) | 216 (manual)                     :a4, 00:00, 518s
    section 9/14/2023
    0 (removed) | 24 (updated) | 216 (manual)                     :a4, 00:00, 496s
    section 9/19/2023
    0 (removed) | 24 (updated) | 223 (manual)                     :a4, 00:00, 506s
    section 9/20/2023
    0 (removed) | 610 (updated) | 225 (manual)                     :a4, 00:00, 670s
    section 9/21/2023
    0 (removed) | 37 (updated) | 225 (manual)                     :a4, 00:00, 490s
    section 9/22/2023
    0 (removed) | 34 (updated) | 225 (manual)                     :a4, 00:00, 491s
    section 9/25/2023
    0 (removed) | 152 (updated) | 225 (manual)                     :a4, 00:00, 529s
    section 9/26/2023
    0 (removed) | 3 (updated) | 225 (manual)                     :a4, 00:00, 514s
    section 9/27/2023
    0 (removed) | 2 (updated) | 225 (manual)                     :a4, 00:00, 492s
    section 9/28/2023
    0 (removed) | 2 (updated) | 226 (manual)                     :a4, 00:00, 484s
    section 9/29/2023
    0 (removed) | 1 (updated) | 232 (manual)                     :a4, 00:00, 486s
October 2023 
gantt
    title Mismatched Datasets per day (prod-only)
    dateFormat HH:mm
    axisFormat %H:%M
    section 10/02/2023
    32 (removed) | 4671 (updated) | 472 (manual)                     :a4, 00:00, 2097s
    section 10/03/2023
    0 (removed) | 17070 (updated) | 1961 (manual)                     :a4, 00:00, 3792s
    section 10/04/2023
    9 (removed) | 6312 (updated) | 1964 (manual)                     :a4, 00:00, 3033s
    section 10/05/2023
    0 (removed) | 3829 (updated) | 1964 (manual)                     :a4, 00:00, 1374s
    section 10/06/2023
    9 (removed) | 707 (updated) | 1964 (manual)                     :a4, 00:00, 641s
    section 10/16/2023
    0 (removed) | 9667 (updated) | 5578 (manual)                     :a4, 00:00, 1241s
    section 10/19/2023
    0 (removed) | 64 (updated) | 140 (manual)                     :a4, 00:00, 518s
    section 10/20/2023
    0 (removed) | 42 (updated) | 140 (manual)                     :a4, 00:00, 520s
    section 10/23/2023
    0 (removed) | 1173 (updated) | 186 (manual)                     :a4, 00:00, 588s
    section 10/27/2023
    87 (removed) | 880 (updated) | 225 (manual)                     :a4, 00:00, 826s
November 2023 
gantt
    title Mismatched Datasets per day (prod-only)
    dateFormat HH:mm
    axisFormat %H:%M
    section 11/20/2023
    0 (removed) | 4341 (updated) | 247 (manual)                     :a4, 00:00, 985s
    section 11/21/2023
    0 (removed) | 2435 (updated) | 243 (manual)                     :a4, 00:00, 657s
    section 11/22/2023
    0 (removed) | 1984 (updated) | 243 (manual)                     :a4, 00:00, 769s
    section 11/24/2023
    0 (removed) | 853 (updated) | 243 (manual)                     :a4, 00:00, 588s
    section 11/27/2023
    0 (removed) | 4123 (updated) | 252 (manual)                     :a4, 00:00, 988s
    section 11/29/2023
    0 (removed) | 2483 (updated) | 252 (manual)                     :a4, 00:00, 713s
    section 11/30/2023
    2 (removed) | 1794 (updated) | 252 (manual)                     :a4, 00:00, 566s
December 2023 
gantt
    title Mismatched Datasets per day (prod-only)
    dateFormat HH:mm
    axisFormat %H:%M
    section 12/01/2023
    0 (removed) | 1608 (updated) | 252 (manual)                     :a4, 00:00, 835s
    section 12/07/2023
    0 (removed) | 0 (updated) | 0 (manual)                     :a4, 00:00, 558s
    section 12/11/2023
    0 (removed) | 0 (updated) | 58 (manual)                     :a4, 00:00, 517s
    section 12/12/2023
    0 (removed) | 1 (updated) | 535 (manual)                     :a4, 00:00, 530s
    section 12/26/2023
    0 (removed) | 593 (updated) | 64 (manual)                     :a4, 00:00, 677s
January 2024 
gantt
    title Mismatched Datasets per day (prod-only)
    dateFormat HH:mm
    axisFormat %H:%M
    section 01/04/2024
    0 (removed) | 0 (updated) | 55 (manual)                     :a4, 00:00, 543s
    section 01/08/2024
    0 (removed) | 0 (updated) | 190 (manual)                     :a4, 00:00, 625s
    section 01/12/2024
    0 (removed) | 1 (updated) | 190 (manual)                     :a4, 00:00, 590s
    section 01/16/2024
    0 (removed) | 6203 (updated) | 247 (manual)             :a4, 00:00, 2427s
February 2024 
gantt
    title Mismatched Datasets per day (prod-only)
    dateFormat HH:mm
    axisFormat %H:%M
    section 02/06/2024
    0 (removed) | 0 (updated) | 279 (manual)                     :a4, 00:00, 594s
    section 02/09/2024
    0 (removed) | 1977 (updated) | 279 (manual)                     :a4, 00:00, 1139s
    section 02/13/2024
    0 (removed) | 0 (updated) | 280 (manual)                     :a4, 00:00, 623s
    section 02/20/2024
    0 (removed) | 0 (updated) | 299 (manual)                     :a4, 00:00, 574s
March 2024 
gantt
    title Mismatched Datasets per day (prod-only)
    dateFormat HH:mm
    axisFormat %H:%M
    section 03/04/2024
    0 (removed) | 0 (updated) | 924 (manual)                     :a4, 00:00, 576s
    section 03/06/2024
    0 (removed) | 1 (updated) | 0 (manual)                     :a4, 00:00, 591s
    section 03/08/2024
    0 (removed) | 5 (updated) | 1 (manual)                     :a4, 00:00, 575s
    section 03/18/2024
    0 (removed) | 0 (updated) | 333 (manual)                     :a4, 00:00, 531s
    section 03/20/2024
    0 (removed) | 0 (updated) | 333 (manual)                     :a4, 00:00, 531s
    section 03/22/2024
    0 (removed) | 1 (updated) | 333 (manual)                     :a4, 00:00, 537s
    section 03/26/2024
    0 (removed) | 0 (updated) | 333 (manual)                     :a4, 00:00, 534s
April 2024 
gantt
    title Mismatched Datasets per day (prod-only)
    dateFormat HH:mm
    axisFormat %H:%M
    section 04/03/2024
    0 (removed) | 0 (updated) | 2474 (manual)                     :a4, 00:00, 520s
    section 04/23/2024
    0 (removed) | 0 (updated) | 429 (manual)                     :a4, 00:00, 520s
    section 04/25/2024
    0 (removed) | 0 (updated) | 429 (manual)                     :a4, 00:00, 555s
    section 04/29/2024
    0 (removed) | 0 (updated) | 429 (manual)                     :a4, 00:00, 534s
May 2024 
gantt
    title Mismatched Datasets per day (prod-only)
    dateFormat HH:mm
    axisFormat %H:%M
    section 05/02/2024
    0 (removed) | 0 (updated) | 431 (manual)                     :a4, 00:00, 525s
    section 05/03/2024
    4 (removed) | 2 (updated) | 431 (manual)                     :a4, 00:00, 539s
June 2024 
gantt
    title Mismatched Datasets per day (prod-only)
    dateFormat HH:mm
    axisFormat %H:%M
    section 06/05/2024
    0 (removed) | 69 (updated) | 978 (manual)                     :a4, 00:00, 555s
    section 06/07/2024
    0 (removed) | 0 (updated) | 978 (manual)                     :a4, 00:00, 526s

This was referenced Mar 6, 2023
Closed
Closed
@nickumia-reisys nickumia-reisys removed their assignment Mar 20, 2023
@btylerburton btylerburton mentioned this issue Mar 21, 2023
Closed
15 tasks
@nickumia-reisys nickumia-reisys mentioned this issue Mar 30, 2023
Closed
15 tasks
@hkdctol hkdctol mentioned this issue Apr 7, 2023
Closed
15 tasks
@nickumia-reisys nickumia-reisys mentioned this issue Apr 14, 2023
Closed
10 tasks
@hkdctol hkdctol mentioned this issue Apr 21, 2023
Closed
10 tasks
@hkdctol hkdctol mentioned this issue May 1, 2023
Closed
10 tasks
@nickumia-reisys nickumia-reisys mentioned this issue May 8, 2023
Closed
10 tasks
@hkdctol hkdctol mentioned this issue May 12, 2023
Closed
10 tasks
@nickumia-reisys nickumia-reisys mentioned this issue May 19, 2023
Closed
10 tasks
@Jin-Sun-tts Jin-Sun-tts mentioned this issue May 30, 2023
Closed
10 tasks
@hkdctol hkdctol added the O&M label Jun 1, 2023
@hkdctol
Copy link

hkdctol commented Jun 1, 2023

@FuhuXia will review and create issue.

@FuhuXia FuhuXia mentioned this issue Jun 5, 2023
Closed
10 tasks
@robert-bryson robert-bryson mentioned this issue Jun 12, 2023
Closed
10 tasks
@FuhuXia FuhuXia mentioned this issue Jun 14, 2023
Closed
@nickumia-reisys nickumia-reisys mentioned this issue Jun 20, 2023
Closed
10 tasks
@nickumia-reisys
Copy link
Contributor Author

Not sure why db-solr-sync errored out on 6/22, but maybe cloud.gov needed to terminate the task for some reason? I think it was mostly finished doing what it needed to do. It's just weird..

image

@hkdctol hkdctol closed this as completed Jun 22, 2023
@hkdctol hkdctol mentioned this issue Jun 23, 2023
Closed
10 tasks
@hkdctol hkdctol mentioned this issue Nov 22, 2023
Open
10 tasks
@hkdctol hkdctol mentioned this issue Dec 1, 2023
Closed
10 tasks
@rshewitt rshewitt mentioned this issue Dec 11, 2023
Open
11 tasks
@hkdctol hkdctol mentioned this issue Dec 15, 2023
Closed
12 tasks
This was referenced Dec 26, 2023
Closed
Open
@hkdctol hkdctol mentioned this issue Jan 5, 2024
Closed
12 tasks
@FuhuXia FuhuXia mentioned this issue Jan 15, 2024
Closed
12 tasks
@hkdctol hkdctol mentioned this issue Jan 19, 2024
Closed
12 tasks
@btylerburton btylerburton mentioned this issue Jan 31, 2024
Open
12 tasks
@Jin-Sun-tts Jin-Sun-tts mentioned this issue Feb 5, 2024
Closed
12 tasks
@gujral-rei gujral-rei mentioned this issue Feb 5, 2024
Open
12 tasks
@hkdctol hkdctol mentioned this issue Feb 12, 2024
Closed
12 tasks
@rshewitt rshewitt mentioned this issue Feb 20, 2024
Open
12 tasks
@robert-bryson robert-bryson mentioned this issue Feb 26, 2024
Closed
12 tasks
@Jin-Sun-tts Jin-Sun-tts mentioned this issue Mar 4, 2024
Closed
12 tasks
This was referenced Mar 11, 2024
Closed
Closed
@hkdctol hkdctol mentioned this issue Mar 18, 2024
Closed
12 tasks
@Jin-Sun-tts Jin-Sun-tts mentioned this issue Mar 25, 2024
Open
12 tasks
@hkdctol hkdctol mentioned this issue Mar 28, 2024
Closed
12 tasks
@rshewitt rshewitt mentioned this issue Apr 8, 2024
Closed
12 tasks
@hkdctol hkdctol mentioned this issue Apr 15, 2024
Closed
13 tasks
@Jin-Sun-tts Jin-Sun-tts mentioned this issue Apr 22, 2024
Open
13 tasks
@FuhuXia FuhuXia mentioned this issue Apr 29, 2024
Closed
13 tasks
@hkdctol hkdctol mentioned this issue May 3, 2024
Open
13 tasks
This was referenced May 10, 2024
Closed
Closed
@rshewitt rshewitt mentioned this issue May 28, 2024
Closed
13 tasks
@FuhuXia FuhuXia mentioned this issue Jun 3, 2024
Open
14 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
audit O&M
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@FuhuXia @hkdctol @nickumia-reisys