Source attribution - Cannot replicate results

[sipity19]

Hi, thanks for the excellent work and the repo.

I am trying to reproduce source attribution results and they are way off compared to the examples shown (latest code as of today, Python 3.6, TF: 1.14).

Here is the output:

PROMPT: I lost 10 lbs! Feeling great!
Opinion ppl = 7838085.469916
Saving ppl = 8658611.615714
Computing ppl = 9161400.253798
Christianity ppl = 10172833.834745
Atheism ppl = 10350098.451882
Running ppl = 10403580.706156
Alone ppl = 11119213.425172
Learned ppl = 11263169.519745
Technologies ppl = 12187119.740056
Writing ppl = 12252740.863067
Gaming ppl = 12253390.865345
Feminism ppl = 12437969.044667
Reviews ppl = 13661436.482837
Pregnancy ppl = 13992615.567019
Joke ppl = 14022243.095921
News ppl = 14023055.50813
Links ppl = 14075548.933406
Extract ppl = 14372111.018515
Weight ppl = 14397816.182828
Finance ppl = 14426339.298529
Science ppl = 14654990.248358
multilingual ppl = 14767164.940384
Teenage ppl = 15467406.959808
Confession ppl = 15501308.365051
Human ppl = 15518181.476559
Horror ppl = 15740049.270127
Explain ppl = 16131210.730993
Tip ppl = 16331210.283522
Ask ppl = 17031437.611569
Legal ppl = 17403731.516289
Movies ppl = 17786306.96164
Confessions ppl = 18019996.685144
Joker ppl = 18124624.211604
Funny ppl = 18202771.265786
Diet ppl = 18498217.492736
Support ppl = 18553833.460151
Notion ppl = 18581621.05071
Relationship ppl = 18842370.157416
Wikipedia ppl = 19387620.223168
...

Diet is way down there and the magnitudes are several orders higher. Any idea what's going on here?

Thanks!