You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
if col.name == 'timestamp':
# Convert bigint to timestamp type if necessary
if str(col.type) == 'BIGINT':
# Pandas uses nanosecond resolution integer timestamps.
# Presto expects second resolution values in from_unixtime.
# Must divide values by 1e9 to go from nanoseconds to seconds.
cols.append(sa.func.from_unixtime(col / 1e9).label('timestamp'))
else:
cols.append(col)
Describe the bug
When the glue crawler is populating the athena tables, it is casting the timestamp as a
bigint
It used to cast it as a 'timestamp', which is more useful as we don't have to convert back.
To Reproduce
Steps to reproduce the behavior:
Expected behavior
I'd like the glue crawler to case the time variables as timestamps, not bigints
Platform (please complete the following information):
Additional context
Add any other context about the problem here.
The text was updated successfully, but these errors were encountered: