Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

duplicate data items #21

Open
fgregg opened this issue Nov 5, 2018 · 5 comments
Open

duplicate data items #21

fgregg opened this issue Nov 5, 2018 · 5 comments
Assignees
@jonquandt
Labels
Investigating

Comments

@fgregg
Copy link

fgregg commented Nov 5, 2018

Hi all,

This is probably not an API issue, but there are a number packages that seem to have duplicate information.

Below is a list of the ones I've found.

[['https://api.govinfo.gov/packages/CHRG-114shrg31304/mods',
  'https://api.govinfo.gov/packages/CHRG-114shrg79104795/mods'],
 ['https://api.govinfo.gov/packages/CHRG-111hhrg54476/mods',
  'https://api.govinfo.gov/packages/CHRG-111hhrg55059/mods'],
 ['https://api.govinfo.gov/packages/CHRG-111shrg48284/mods',
  'https://api.govinfo.gov/packages/CHRG-111shrg79104342/mods'],
 ['https://api.govinfo.gov/packages/CHRG-111shrg48308/mods',
  'https://api.govinfo.gov/packages/CHRG-111shrg89104354/mods'],
 ['https://api.govinfo.gov/packages/CHRG-111shrg89104347/mods',
  'https://api.govinfo.gov/packages/CHRG-111shrg89104346/mods'],
 ['https://api.govinfo.gov/packages/CHRG-111shrg48296/mods',
  'https://api.govinfo.gov/packages/CHRG-111shrg89104359/mods'],
 ['https://api.govinfo.gov/packages/CHRG-111shrg48293/mods',
  'https://api.govinfo.gov/packages/CHRG-111shrg89104362/mods'],
 ['https://api.govinfo.gov/packages/CHRG-111shrg48317/mods',
  'https://api.govinfo.gov/packages/CHRG-111shrg89104372/mods'],
 ['https://api.govinfo.gov/packages/CHRG-111shrg54980/mods',
  'https://api.govinfo.gov/packages/CHRG-111shrg89104384/mods'],
 ['https://api.govinfo.gov/packages/CHRG-111shrg54956/mods',
  'https://api.govinfo.gov/packages/CHRG-111shrg99104391/mods'],
 ['https://api.govinfo.gov/packages/CHRG-111shrg54965/mods',
  'https://api.govinfo.gov/packages/CHRG-111shrg99104390/mods'],
 ['https://api.govinfo.gov/packages/CHRG-111shrg54968/mods',
  'https://api.govinfo.gov/packages/CHRG-111shrg99104387/mods'],
 ['https://api.govinfo.gov/packages/CHRG-111shrg54971/mods',
  'https://api.govinfo.gov/packages/CHRG-111shrg99104392/mods'],
 ['https://api.govinfo.gov/packages/CHRG-111shrg54974/mods',
  'https://api.govinfo.gov/packages/CHRG-111shrg99104413/mods'],
 ['https://api.govinfo.gov/packages/CHRG-111shrg54986/mods',
  'https://api.govinfo.gov/packages/CHRG-111shrg99104406/mods'],
 ['https://api.govinfo.gov/packages/CHRG-111shrg48302/mods',
  'https://api.govinfo.gov/packages/CHRG-111shrg99104411/mods'],
 ['https://api.govinfo.gov/packages/CHRG-111shrg48305/mods',
  'https://api.govinfo.gov/packages/CHRG-111shrg99104412/mods'],
 ['https://api.govinfo.gov/packages/CHRG-111shrg54989/mods',
  'https://api.govinfo.gov/packages/CHRG-111shrg99104419/mods'],
 ['https://api.govinfo.gov/packages/CHRG-112hhrg65734/mods',
  'https://api.govinfo.gov/packages/CHRG-112hhrg66317/mods'],
 ['https://api.govinfo.gov/packages/CHRG-112hhrg73291/mods',
  'https://api.govinfo.gov/packages/CHRG-112jhrg73291/mods'],
 ['https://api.govinfo.gov/packages/CHRG-112shrg19104454/mods',
  'https://api.govinfo.gov/packages/CHRG-112shrg19104469/mods'],
 ['https://api.govinfo.gov/packages/CHRG-112shrg39104526/mods',
  'https://api.govinfo.gov/packages/CHRG-112shrg39104525/mods'],
 ['https://api.govinfo.gov/packages/CHRG-112shrg19104447/mods',
  'https://api.govinfo.gov/packages/CHRG-112shrg64600/mods'],
 ['https://api.govinfo.gov/packages/CHRG-112shrg29104481/mods',
  'https://api.govinfo.gov/packages/CHRG-112shrg64588/mods'],
 ['https://api.govinfo.gov/packages/CHRG-112shrg19104449/mods',
  'https://api.govinfo.gov/packages/CHRG-112shrg64603/mods'],
 ['https://api.govinfo.gov/packages/CHRG-112shrg19104448/mods',
  'https://api.govinfo.gov/packages/CHRG-112shrg64606/mods'],
 ['https://api.govinfo.gov/packages/CHRG-112shrg19104470/mods',
  'https://api.govinfo.gov/packages/CHRG-112shrg64597/mods'],
 ['https://api.govinfo.gov/packages/CHRG-112shrg19104453/mods',
  'https://api.govinfo.gov/packages/CHRG-112shrg64618/mods'],
 ['https://api.govinfo.gov/packages/CHRG-112shrg19104466/mods',
  'https://api.govinfo.gov/packages/CHRG-112shrg64609/mods'],
 ['https://api.govinfo.gov/packages/CHRG-112shrg19104450/mods',
  'https://api.govinfo.gov/packages/CHRG-112shrg64612/mods'],
 ['https://api.govinfo.gov/packages/CHRG-112shrg29104477/mods',
  'https://api.govinfo.gov/packages/CHRG-112shrg64621/mods'],
 ['https://api.govinfo.gov/packages/CHRG-112shrg39104544/mods',
  'https://api.govinfo.gov/packages/CHRG-112shrg72302/mods'],
 ['https://api.govinfo.gov/packages/CHRG-112shrg29104523/mods',
  'https://api.govinfo.gov/packages/CHRG-112shrg72311/mods'],
 ['https://api.govinfo.gov/packages/CHRG-112shrg29104503/mods',
  'https://api.govinfo.gov/packages/CHRG-112shrg72308/mods'],
 ['https://api.govinfo.gov/packages/CHRG-112shrg29104516/mods',
  'https://api.govinfo.gov/packages/CHRG-112shrg72334/mods'],
 ['https://api.govinfo.gov/packages/CHRG-112shrg29104490/mods',
  'https://api.govinfo.gov/packages/CHRG-112shrg72333/mods'],
 ['https://api.govinfo.gov/packages/CHRG-112shrg39104524/mods',
  'https://api.govinfo.gov/packages/CHRG-112shrg72317/mods'],
 ['https://api.govinfo.gov/packages/CHRG-112shrg29104498/mods',
  'https://api.govinfo.gov/packages/CHRG-112shrg72332/mods'],
 ['https://api.govinfo.gov/packages/CHRG-112shrg29104494/mods',
  'https://api.govinfo.gov/packages/CHRG-112shrg72336/mods'],
 ['https://api.govinfo.gov/packages/CHRG-112shrg39104546/mods',
  'https://api.govinfo.gov/packages/CHRG-112shrg72337/mods'],
 ['https://api.govinfo.gov/packages/CHRG-113shrg39104568/mods',
  'https://api.govinfo.gov/packages/CHRG-113shrg78042/mods'],
 ['https://api.govinfo.gov/packages/CHRG-113shrg24504/mods',
  'https://api.govinfo.gov/packages/CHRG-113shrg69104725/mods'],
 ['https://api.govinfo.gov/packages/CHRG-113shrg39104527/mods',
  'https://api.govinfo.gov/packages/CHRG-113shrg78060/mods'],
 ['https://api.govinfo.gov/packages/CHRG-113shrg39104555/mods',
  'https://api.govinfo.gov/packages/CHRG-113shrg78075/mods'],
 ['https://api.govinfo.gov/packages/CHRG-113shrg49104585/mods',
  'https://api.govinfo.gov/packages/CHRG-113shrg87215/mods'],
 ['https://api.govinfo.gov/packages/CHRG-113shrg59104647/mods',
  'https://api.govinfo.gov/packages/CHRG-113shrg87249/mods'],
 ['https://api.govinfo.gov/packages/CHRG-113shrg49104586/mods',
  'https://api.govinfo.gov/packages/CHRG-113shrg87250/mods'],
 ['https://api.govinfo.gov/packages/CHRG-113shrg49104609/mods',
  'https://api.govinfo.gov/packages/CHRG-113shrg87254/mods'],
 ['https://api.govinfo.gov/packages/CHRG-114jhrg22555/mods',
  'https://api.govinfo.gov/packages/CHRG-114shrg22555/mods'],
 ['https://api.govinfo.gov/packages/CHRG-114shrg24506/mods',
  'https://api.govinfo.gov/packages/CHRG-114shrg69104668/mods'],
 ['https://api.govinfo.gov/packages/CHRG-114shrg27171/mods',
  'https://api.govinfo.gov/packages/CHRG-114shrg69104746/mods'],
 ['https://api.govinfo.gov/packages/CHRG-114shrg59104628/mods',
  'https://api.govinfo.gov/packages/CHRG-114shrg93127/mods'],
 ['https://api.govinfo.gov/packages/CHRG-114shrg69104691/mods',
  'https://api.govinfo.gov/packages/CHRG-114shrg93112/mods'],
 ['https://api.govinfo.gov/packages/CHRG-114hhrg94494/mods',
  'https://api.govinfo.gov/packages/CHRG-114shrg98593/mods'],
 ['https://api.govinfo.gov/packages/CHRG-114shrg69104718/mods',
  'https://api.govinfo.gov/packages/CHRG-114shrg98771/mods'],
 ['https://api.govinfo.gov/packages/CHRG-114shrg69104744/mods',
  'https://api.govinfo.gov/packages/CHRG-114shrg98759/mods'],
 ['https://api.govinfo.gov/packages/CHRG-110shrg69104262/mods',
  'https://api.govinfo.gov/packages/CHRG-110shrg33929/mods'],
 ['https://api.govinfo.gov/packages/CHRG-110shrg79104332/mods',
  'https://api.govinfo.gov/packages/CHRG-110shrg41260/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg2910446/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg85926/mods'],
 ['https://api.govinfo.gov/packages/CHRG-105hhrg50804/mods',
  'https://api.govinfo.gov/packages/CHRG-105hhrg54586/mods'],
 ['https://api.govinfo.gov/packages/CHRG-109hhrg20750/mods',
  'https://api.govinfo.gov/packages/CHRG-109hhrg27000/mods'],
 ['https://api.govinfo.gov/packages/CHRG-106jhrg67455/mods',
  'https://api.govinfo.gov/packages/CHRG-106jhrg64389/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg92167/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg2910469/mods'],
 ['https://api.govinfo.gov/packages/CHRG-110shrg79104312/mods',
  'https://api.govinfo.gov/packages/CHRG-110shrg41242/mods'],
 ['https://api.govinfo.gov/packages/CHRG-110shrg79104324/mods',
  'https://api.govinfo.gov/packages/CHRG-110shrg41248/mods'],
 ['https://api.govinfo.gov/packages/CHRG-109shrg49104169/mods',
  'https://api.govinfo.gov/packages/CHRG-109shrg99863/mods'],
 ['https://api.govinfo.gov/packages/CHRG-107hhrg82131/mods',
  'https://api.govinfo.gov/packages/CHRG-107hhrg80036/mods'],
 ['https://api.govinfo.gov/packages/CHRG-109shrg49104167/mods',
  'https://api.govinfo.gov/packages/CHRG-109shrg99866/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg92134/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg2910486/mods'],
 ['https://api.govinfo.gov/packages/CHRG-105hhrg97577/mods',
  'https://api.govinfo.gov/packages/CHRG-105hhrg52520/mods'],
 ['https://api.govinfo.gov/packages/CHRG-109hhrg27150/mods',
  'https://api.govinfo.gov/packages/CHRG-109hhrg23926/mods'],
 ['https://api.govinfo.gov/packages/CHRG-109hhrg23038/mods',
  'https://api.govinfo.gov/packages/CHRG-109hhrg20323/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg2910466/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg85917/mods'],
 ['https://api.govinfo.gov/packages/CHRG-106hhrg64703/mods',
  'https://api.govinfo.gov/packages/CHRG-106hhrg64702/mods'],
 ['https://api.govinfo.gov/packages/CHRG-110shrg79104329/mods',
  'https://api.govinfo.gov/packages/CHRG-110shrg41269/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg1910409/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg85914/mods'],
 ['https://api.govinfo.gov/packages/CHRG-107hhrg83027/mods',
  'https://api.govinfo.gov/packages/CHRG-107hhrg80034/mods',
  'https://api.govinfo.gov/packages/CHRG-107hhrg77905/mods',
  'https://api.govinfo.gov/packages/CHRG-107hhrg81196/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg2910435/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg85908/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg91493/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg91434/mods'],
 ['https://api.govinfo.gov/packages/CHRG-107shrg83485/mods',
  'https://api.govinfo.gov/packages/CHRG-107shrg86375/mods'],
 ['https://api.govinfo.gov/packages/CHRG-105hhrg48166/mods',
  'https://api.govinfo.gov/packages/CHRG-105hhrg48145/mods'],
 ['https://api.govinfo.gov/packages/CHRG-110shrg59104236/mods',
  'https://api.govinfo.gov/packages/CHRG-110shrg33932/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg2910465/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg85923/mods'],
 ['https://api.govinfo.gov/packages/CHRG-110shrg59104239/mods',
  'https://api.govinfo.gov/packages/CHRG-110shrg33908/mods'],
 ['https://api.govinfo.gov/packages/CHRG-110hhrg40733/mods',
  'https://api.govinfo.gov/packages/CHRG-110hhrg49982/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg2910485/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg39104123/mods'],
 ['https://api.govinfo.gov/packages/CHRG-109hhrg26759/mods',
  'https://api.govinfo.gov/packages/CHRG-109hhrg30817/mods'],
 ['https://api.govinfo.gov/packages/CHRG-106hhrg66213/mods',
  'https://api.govinfo.gov/packages/CHRG-106hhrg65393/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg85920/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg2910458/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108hhrg87944/mods',
  'https://api.govinfo.gov/packages/CHRG-108hhrg87943/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg39104113/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg92164/mods'],
 ['https://api.govinfo.gov/packages/CHRG-110hhrg42280/mods',
  'https://api.govinfo.gov/packages/CHRG-110hhrg42883/mods'],
 ['https://api.govinfo.gov/packages/CHRG-107shrg83050/mods',
  'https://api.govinfo.gov/packages/CHRG-107shrg81313/mods'],
 ['https://api.govinfo.gov/packages/CHRG-107hhrg73222/mods',
  'https://api.govinfo.gov/packages/CHRG-107hhrg73203/mods'],
 ['https://api.govinfo.gov/packages/CHRG-104hhrg25630/mods',
  'https://api.govinfo.gov/packages/CHRG-104hhrg24935/mods'],
 ['https://api.govinfo.gov/packages/CHRG-110hhrg40305/mods',
  'https://api.govinfo.gov/packages/CHRG-110hhrg46780/mods'],
 ['https://api.govinfo.gov/packages/CHRG-109shrg39104133/mods',
  'https://api.govinfo.gov/packages/CHRG-109shrg99860/mods'],
 ['https://api.govinfo.gov/packages/CHRG-109hhrg24090/mods',
  'https://api.govinfo.gov/packages/CHRG-109hhrg28103/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg1910421/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg85938/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg92155/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg2910489/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg22833/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg21980/mods'],
 ['https://api.govinfo.gov/packages/CHRG-110shrg69104266/mods',
  'https://api.govinfo.gov/packages/CHRG-110shrg33914/mods'],
 ['https://api.govinfo.gov/packages/CHRG-110jhrg42170/mods',
  'https://api.govinfo.gov/packages/CHRG-110jhrg46059/mods'],
 ['https://api.govinfo.gov/packages/CHRG-110shrg69104290/mods',
  'https://api.govinfo.gov/packages/CHRG-110shrg33923/mods'],
 ['https://api.govinfo.gov/packages/CHRG-107hhrg72230/mods',
  'https://api.govinfo.gov/packages/CHRG-107hhrg72330/mods'],
 ['https://api.govinfo.gov/packages/CHRG-110shrg79104318/mods',
  'https://api.govinfo.gov/packages/CHRG-110shrg41266/mods'],
 ['https://api.govinfo.gov/packages/CHRG-109shrg49104156/mods',
  'https://api.govinfo.gov/packages/CHRG-109shrg99848/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg92143/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg2910468/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg2910470/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg92158/mods'],
 ['https://api.govinfo.gov/packages/CHRG-105shrg51102/mods',
  'https://api.govinfo.gov/packages/CHRG-105shrg56570/mods'],
 ['https://api.govinfo.gov/packages/CHRG-109shrg24291/mods',
  'https://api.govinfo.gov/packages/CHRG-109shrg21017/mods'],
 ['https://api.govinfo.gov/packages/CHRG-105hhrg40796/mods',
  'https://api.govinfo.gov/packages/CHRG-105hhrg40908/mods'],
 ['https://api.govinfo.gov/packages/CHRG-110hhrg41809/mods',
  'https://api.govinfo.gov/packages/CHRG-110hhrg38229/mods'],
 ['https://api.govinfo.gov/packages/CHRG-109hhrg28909/mods',
  'https://api.govinfo.gov/packages/CHRG-109hhrg30548/mods'],
 ['https://api.govinfo.gov/packages/CHRG-110shrg79104327/mods',
  'https://api.govinfo.gov/packages/CHRG-110shrg41251/mods'],
 ['https://api.govinfo.gov/packages/CHRG-110hhrg41984/mods',
  'https://api.govinfo.gov/packages/CHRG-110hhrg46057/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg89477/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg89465/mods'],
 ['https://api.govinfo.gov/packages/CHRG-109shrg99875/mods',
  'https://api.govinfo.gov/packages/CHRG-109shrg49104179/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg2910490/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg92152/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg39104130/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg92146/mods'],
 ['https://api.govinfo.gov/packages/CHRG-107hhrg80044/mods',
  'https://api.govinfo.gov/packages/CHRG-107hhrg80040/mods'],
 ['https://api.govinfo.gov/packages/CHRG-109shrg99878/mods',
  'https://api.govinfo.gov/packages/CHRG-109shrg49104176/mods'],
 ['https://api.govinfo.gov/packages/CHRG-110shrg47095/mods',
  'https://api.govinfo.gov/packages/CHRG-110shrg45221/mods'],
 ['https://api.govinfo.gov/packages/CHRG-110hhrg45233/mods',
  'https://api.govinfo.gov/packages/CHRG-110hhrg44748/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg85935/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg2910427/mods'],
 ['https://api.govinfo.gov/packages/CHRG-107hhrg80852/mods',
  'https://api.govinfo.gov/packages/CHRG-107hhrg80851/mods',
  'https://api.govinfo.gov/packages/CHRG-107hhrg80840/mods'],
 ['https://api.govinfo.gov/packages/CHRG-105shrg51563/mods',
  'https://api.govinfo.gov/packages/CHRG-105shrg56572/mods'],
 ['https://api.govinfo.gov/packages/CHRG-109shrg20474/mods',
  'https://api.govinfo.gov/packages/CHRG-109shrg21799/mods'],
 ['https://api.govinfo.gov/packages/CHRG-110shrg69104281/mods',
  'https://api.govinfo.gov/packages/CHRG-110shrg33935/mods'],
 ['https://api.govinfo.gov/packages/CHRG-106hhrg67557/mods',
  'https://api.govinfo.gov/packages/CHRG-106hhrg67558/mods'],
 ['https://api.govinfo.gov/packages/CHRG-109shrg99881/mods',
  'https://api.govinfo.gov/packages/CHRG-109shrg39104146/mods'],
 ['https://api.govinfo.gov/packages/CHRG-110shrg69104268/mods',
  'https://api.govinfo.gov/packages/CHRG-110shrg33917/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg2910483/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg92131/mods'],
 ['https://api.govinfo.gov/packages/CHRG-109shrg99869/mods',
  'https://api.govinfo.gov/packages/CHRG-109shrg49104171/mods'],
 ['https://api.govinfo.gov/packages/CHRG-109shrg27641/mods',
  'https://api.govinfo.gov/packages/CHRG-109shrg21820/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg2910459/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg85941/mods'],
 ['https://api.govinfo.gov/packages/CHRG-105shrg56565/mods',
  'https://api.govinfo.gov/packages/CHRG-105shrg50653/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg39104111/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg92140/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg39104107/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg92161/mods'],
 ['https://api.govinfo.gov/packages/CHRG-107shrg81606/mods',
  'https://api.govinfo.gov/packages/CHRG-107shrg79994/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108hhrg92796/mods',
  'https://api.govinfo.gov/packages/CHRG-108hhrg92797/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg85929/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg2910445/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg86911/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg89611/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg89354/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg89535/mods'],
 ['https://api.govinfo.gov/packages/CHRG-109hhrg22985/mods',
  'https://api.govinfo.gov/packages/CHRG-109hhrg28129/mods'],
 ['https://api.govinfo.gov/packages/CHRG-109hhrg24401/mods',
  'https://api.govinfo.gov/packages/CHRG-109hhrg28102/mods'],
 ['https://api.govinfo.gov/packages/CHRG-111shrg79104339/mods',
  'https://api.govinfo.gov/packages/CHRG-111shrg48290/mods'],
 ['https://api.govinfo.gov/packages/CHRG-112shrg19104445/mods',
  'https://api.govinfo.gov/packages/CHRG-112shrg64594/mods'],
 ['https://api.govinfo.gov/packages/CHRG-115shrg24401/mods',
  'https://api.govinfo.gov/packages/CHRG-115shrg24930/mods'],
 ['https://api.govinfo.gov/packages/CHRG-109shrg49104194/mods',
  'https://api.govinfo.gov/packages/CHRG-109shrg27147/mods'],
 ['https://api.govinfo.gov/packages/CHRG-109shrg59104231/mods',
  'https://api.govinfo.gov/packages/CHRG-109shrg27927/mods'],
 ['https://api.govinfo.gov/packages/CHRG-109shrg59104210/mods',
  'https://api.govinfo.gov/packages/CHRG-109shrg27534/mods'],
 ['https://api.govinfo.gov/packages/CHRG-109shrg59104230/mods',
  'https://api.govinfo.gov/packages/CHRG-109shrg27360/mods'],
 ['https://api.govinfo.gov/packages/CHRG-109shrg49104196/mods',
  'https://api.govinfo.gov/packages/CHRG-109shrg27113/mods'],
 ['https://api.govinfo.gov/packages/CHRG-109shrg59104218/mods',
  'https://api.govinfo.gov/packages/CHRG-109shrg27572/mods'],
 ['https://api.govinfo.gov/packages/CHRG-109shrg59104224/mods',
  'https://api.govinfo.gov/packages/CHRG-109shrg26550/mods']]
@jonquandt jonquandt self-assigned this Nov 5, 2018
@jonquandt
Copy link
Member

@fgregg For appropriations hearings, the committees tend to publish portions of the hearings as they are completed, and then the final hearing are usually compiled, printed, and added to the repository at the request of the Committee.

packages with 8 digits after hrg are the in-process version, while the ones with 5 digits and larger mods are the final.

You can also see the difference by comparing the two different pdf files:

https://www.govinfo.gov/content/pkg/CHRG-114shrg79104795/pdf/CHRG-114shrg79104795.pdf

https://www.govinfo.gov/content/pkg/CHRG-114shrg31304/pdf/CHRG-114shrg31304.pdf

@fgregg
Copy link
Author

fgregg commented Nov 5, 2018

Thanks, @jonquandt

Usually, but not always? There are cases where there in-process packages but not final packages?

@jonquandt
Copy link
Member

@fgregg -- There could be some time between the in-process and final packages. Publication of hearings is the purview of the committee.

@fgregg
Copy link
Author

fgregg commented Nov 5, 2018 •
edited

@jonquandt thanks so much for explaining about the in-process packages. Here are apparent duplicates that do not fit the in-process, final version pattern.

['https://api.govinfo.gov/packages/CHRG-111hhrg54476/mods',
  'https://api.govinfo.gov/packages/CHRG-111hhrg55059/mods'],
 ['https://api.govinfo.gov/packages/CHRG-112hhrg65734/mods',
  'https://api.govinfo.gov/packages/CHRG-112hhrg66317/mods'],
 ['https://api.govinfo.gov/packages/CHRG-112hhrg73291/mods',
  'https://api.govinfo.gov/packages/CHRG-112jhrg73291/mods'],
 ['https://api.govinfo.gov/packages/CHRG-114jhrg22555/mods',
  'https://api.govinfo.gov/packages/CHRG-114shrg22555/mods'],
 ['https://api.govinfo.gov/packages/CHRG-114hhrg94494/mods',
  'https://api.govinfo.gov/packages/CHRG-114shrg98593/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg2910446/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg85926/mods'],
 ['https://api.govinfo.gov/packages/CHRG-105hhrg50804/mods',
  'https://api.govinfo.gov/packages/CHRG-105hhrg54586/mods'],
 ['https://api.govinfo.gov/packages/CHRG-109hhrg20750/mods',
  'https://api.govinfo.gov/packages/CHRG-109hhrg27000/mods'],
 ['https://api.govinfo.gov/packages/CHRG-106jhrg67455/mods',
  'https://api.govinfo.gov/packages/CHRG-106jhrg64389/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg92167/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg2910469/mods'],
 ['https://api.govinfo.gov/packages/CHRG-107hhrg82131/mods',
  'https://api.govinfo.gov/packages/CHRG-107hhrg80036/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg92134/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg2910486/mods'],
 ['https://api.govinfo.gov/packages/CHRG-105hhrg97577/mods',
  'https://api.govinfo.gov/packages/CHRG-105hhrg52520/mods'],
 ['https://api.govinfo.gov/packages/CHRG-109hhrg27150/mods',
  'https://api.govinfo.gov/packages/CHRG-109hhrg23926/mods'],
 ['https://api.govinfo.gov/packages/CHRG-109hhrg23038/mods',
  'https://api.govinfo.gov/packages/CHRG-109hhrg20323/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg2910466/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg85917/mods'],
 ['https://api.govinfo.gov/packages/CHRG-106hhrg64703/mods',
  'https://api.govinfo.gov/packages/CHRG-106hhrg64702/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg1910409/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg85914/mods'],
 ['https://api.govinfo.gov/packages/CHRG-107hhrg83027/mods',
  'https://api.govinfo.gov/packages/CHRG-107hhrg80034/mods',
  'https://api.govinfo.gov/packages/CHRG-107hhrg77905/mods',
  'https://api.govinfo.gov/packages/CHRG-107hhrg81196/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg2910435/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg85908/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg91493/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg91434/mods'],
 ['https://api.govinfo.gov/packages/CHRG-107shrg83485/mods',
  'https://api.govinfo.gov/packages/CHRG-107shrg86375/mods'],
 ['https://api.govinfo.gov/packages/CHRG-105hhrg48166/mods',
  'https://api.govinfo.gov/packages/CHRG-105hhrg48145/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg2910465/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg85923/mods'],
 ['https://api.govinfo.gov/packages/CHRG-110hhrg40733/mods',
  'https://api.govinfo.gov/packages/CHRG-110hhrg49982/mods'],
 ['https://api.govinfo.gov/packages/CHRG-109hhrg26759/mods',
  'https://api.govinfo.gov/packages/CHRG-109hhrg30817/mods'],
 ['https://api.govinfo.gov/packages/CHRG-106hhrg66213/mods',
  'https://api.govinfo.gov/packages/CHRG-106hhrg65393/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg85920/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg2910458/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108hhrg87944/mods',
  'https://api.govinfo.gov/packages/CHRG-108hhrg87943/mods'],
 ['https://api.govinfo.gov/packages/CHRG-110hhrg42280/mods',
  'https://api.govinfo.gov/packages/CHRG-110hhrg42883/mods'],
 ['https://api.govinfo.gov/packages/CHRG-107shrg83050/mods',
  'https://api.govinfo.gov/packages/CHRG-107shrg81313/mods'],
 ['https://api.govinfo.gov/packages/CHRG-107hhrg73222/mods',
  'https://api.govinfo.gov/packages/CHRG-107hhrg73203/mods'],
 ['https://api.govinfo.gov/packages/CHRG-104hhrg25630/mods',
  'https://api.govinfo.gov/packages/CHRG-104hhrg24935/mods'],
 ['https://api.govinfo.gov/packages/CHRG-110hhrg40305/mods',
  'https://api.govinfo.gov/packages/CHRG-110hhrg46780/mods'],
 ['https://api.govinfo.gov/packages/CHRG-109hhrg24090/mods',
  'https://api.govinfo.gov/packages/CHRG-109hhrg28103/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg1910421/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg85938/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg92155/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg2910489/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg22833/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg21980/mods'],
 ['https://api.govinfo.gov/packages/CHRG-110jhrg42170/mods',
  'https://api.govinfo.gov/packages/CHRG-110jhrg46059/mods'],
 ['https://api.govinfo.gov/packages/CHRG-107hhrg72230/mods',
  'https://api.govinfo.gov/packages/CHRG-107hhrg72330/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg92143/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg2910468/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg2910470/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg92158/mods'],
 ['https://api.govinfo.gov/packages/CHRG-105shrg51102/mods',
  'https://api.govinfo.gov/packages/CHRG-105shrg56570/mods'],
 ['https://api.govinfo.gov/packages/CHRG-109shrg24291/mods',
  'https://api.govinfo.gov/packages/CHRG-109shrg21017/mods'],
 ['https://api.govinfo.gov/packages/CHRG-105hhrg40796/mods',
  'https://api.govinfo.gov/packages/CHRG-105hhrg40908/mods'],
 ['https://api.govinfo.gov/packages/CHRG-110hhrg41809/mods',
  'https://api.govinfo.gov/packages/CHRG-110hhrg38229/mods'],
 ['https://api.govinfo.gov/packages/CHRG-109hhrg28909/mods',
  'https://api.govinfo.gov/packages/CHRG-109hhrg30548/mods'],
 ['https://api.govinfo.gov/packages/CHRG-110hhrg41984/mods',
  'https://api.govinfo.gov/packages/CHRG-110hhrg46057/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg89477/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg89465/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg2910490/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg92152/mods'],
 ['https://api.govinfo.gov/packages/CHRG-107hhrg80044/mods',
  'https://api.govinfo.gov/packages/CHRG-107hhrg80040/mods'],
 ['https://api.govinfo.gov/packages/CHRG-110shrg47095/mods',
  'https://api.govinfo.gov/packages/CHRG-110shrg45221/mods'],
 ['https://api.govinfo.gov/packages/CHRG-110hhrg45233/mods',
  'https://api.govinfo.gov/packages/CHRG-110hhrg44748/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg85935/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg2910427/mods'],
 ['https://api.govinfo.gov/packages/CHRG-107hhrg80852/mods',
  'https://api.govinfo.gov/packages/CHRG-107hhrg80851/mods',
  'https://api.govinfo.gov/packages/CHRG-107hhrg80840/mods'],
 ['https://api.govinfo.gov/packages/CHRG-105shrg51563/mods',
  'https://api.govinfo.gov/packages/CHRG-105shrg56572/mods'],
 ['https://api.govinfo.gov/packages/CHRG-109shrg20474/mods',
  'https://api.govinfo.gov/packages/CHRG-109shrg21799/mods'],
 ['https://api.govinfo.gov/packages/CHRG-106hhrg67557/mods',
  'https://api.govinfo.gov/packages/CHRG-106hhrg67558/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg2910483/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg92131/mods'],
 ['https://api.govinfo.gov/packages/CHRG-109shrg27641/mods',
  'https://api.govinfo.gov/packages/CHRG-109shrg21820/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg2910459/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg85941/mods'],
 ['https://api.govinfo.gov/packages/CHRG-105shrg56565/mods',
  'https://api.govinfo.gov/packages/CHRG-105shrg50653/mods'],
 ['https://api.govinfo.gov/packages/CHRG-107shrg81606/mods',
  'https://api.govinfo.gov/packages/CHRG-107shrg79994/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108hhrg92796/mods',
  'https://api.govinfo.gov/packages/CHRG-108hhrg92797/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg85929/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg2910445/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg86911/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg89611/mods'],
 ['https://api.govinfo.gov/packages/CHRG-108shrg89354/mods',
  'https://api.govinfo.gov/packages/CHRG-108shrg89535/mods'],
 ['https://api.govinfo.gov/packages/CHRG-109hhrg22985/mods',
  'https://api.govinfo.gov/packages/CHRG-109hhrg28129/mods'],
 ['https://api.govinfo.gov/packages/CHRG-109hhrg24401/mods',
  'https://api.govinfo.gov/packages/CHRG-109hhrg28102/mods'],
 ['https://api.govinfo.gov/packages/CHRG-115shrg24401/mods',
  'https://api.govinfo.gov/packages/CHRG-115shrg24930/mods']]

@jonquandt
Copy link
Member

@fgregg - thanks for reporting this. We're reviewing the packages to see the best way to handle these. It requires a little bit of digging in each case.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@jonquandt jonquandt

Labels
Investigating
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@fgregg @jonquandt