Error running the Rnighlights code

[tiamiyu99]

Hi,

Thank you for creating this wonderful package. I had a problem when running the code. Please find below, I'd appreciate your support in resolving it.

#load libraries
library(Rnightlights)
library(lubridate)
library(reshape2)

setwd(".")

getCtryNlData("KEN", "KEN_adm0", "VIIRS.Y",
nlPeriods = nlRange("2015", "2016"),
nlStats = "sum",
ignoreMissing=FALSE)

#The results below is what I then see

Error in if (!file.exists(ntLtsPageLocalName) || file.size(ntLtsPageLocalName) == :
missing value where TRUE/FALSE needed

Once again, thank you.

[JMejuto]

Hi,

I am having exactly the same issue, thank you in advance.

[chrisvwn]

Hi,

Apologies for the late response. Please post the code that you are running.

[JMejuto]

Hi, @chrisvwn!

just the example from the web:

library(Rnightlights)
library(lubridate)
library(reshape2)

#(Optional performance enhancement if you have aria2c and gdal installed)
pkgOptions(downloadMethod = "aria", cropMaskMethod = "gdal", extractMethod = "gdal", deleteTiles = TRUE)

#Optional performance enhancement. If extractMethod="rast" you can specify the number of
#CPU cores to use in parallel
#pkgOptions(extractMethod = "rast", numCores=4)

ctry <- "TUR" #replace to run for any other country

#download and process monthly VIIRS stats at the highest admin level
highestAdmLevelStats <- getCtryNlData(ctryCode = ctry,
admLevel = "highest",
nlType = "VIIRS.M",
nlPeriods = nlRange("201401", "201412"),
nlStats = list("sum",na.rm=TRUE),
ignoreMissing=FALSE)

#Optionally plot the data
library(ggplot2)
library(plotly)

#melt the stats into key-value format for easy multi-line plotting with ggplot2
highestAdmLevelStats <- melt(highestAdmLevelStats,
id.vars = grep("NL_", names(highestAdmLevelStats),
invert=TRUE),
variable.name = "nlPeriod",
value.name = "radiancesum")

#extract date from the NL col names
highestAdmLevelStats$nlPeriod <- substr(highestAdmLevelStats$nlPeriod, 12, 17)

#format period as date
highestAdmLevelStats$nlPeriod <- ymd(paste0(substr(highestAdmLevelStats$nlPeriod, 1,4),
"-",substr(highestAdmLevelStats$nlPeriod, 5,6), "-01"))

#plot 2nd admin level sums for the year
g <- ggplot(data = highestAdmLevelStats,
aes(x=nlPeriod, y=radiancesum,
color=highestAdmLevelStats[[2]])) +
scale_x_date(date_breaks = "1 month", date_labels = "%Y-%m")+
geom_line()+geom_point() + labs(color = names(highestAdmLevelStats)[2]) +
xlab("Month") +
ylab("Sum of Radiances") +
ggtitle(paste0(unique(names(highestAdmLevelStats)[2]), " sum of radiances for ", ctry))

print(g)

#quick conversion to interactive map with plotly
ggplotly(g)

[chrisvwn]

Okay. Which version of Rnightlights do you have?

[JMejuto]

Rnightlights version 0.3.0.0

[anoopwcc]

Dear Chris,
I run the following code
library(Rnightlights)
library(lubridate)
library(reshape2)
ctry <- "IND" #replace to run for any other country
highestAdmLevelStats <- getCtryNlData(ctryCode = ctry,
admLevel = "highest",
nlType = "VIIRS.M",
nlPeriods = nlRange("201401", "201405","VIIRS.M"),
nlStats = list("sum",na.rm=TRUE),
ignoreMissing=FALSE)

and I am getting the following error message. I have the latest version of nightlight and updated versions of all the package.
Any help from your side is highly appreciated

processing missing data: IND:VIIRS.M:VCMCFG:avg_rade9:201401:sum, VIIRS.M:VCMCFG:avg_rade9:201402:sum, VIIRS.M:VCMCFG:avg_rade9:201403:sum, VIIRS.M:VCMCFG:avg_rade9:201404:sum, VIIRS.M:VCMCFG:avg_rade9:201405:sum. This may take a while.
Note: Set 'ignoreMissing=TRUE' to return only data found or
'ignoreMissing=NULL' to return NULL if not all the data is found
2021-09-03 16:57:09: **** START PROCESSING: ctryCodes=IND, admLevels=list(IND = "gadm36_IND_1"), nlTypes=VIIRS.M, configNames=VCMCFG, extensions=avg_rade9, multiTileStrategy=all, multiTileMergeFun=mean, removeGasFlaresMethod=VTM, nlPeriods=c("201401", "201402", "201403", "201404", "201405"), nlStats=list(list("sum", na.rm = TRUE)), custPolyPath=NULL, gadmVersion=3.6, gadmPolyType=shpZip, downloadMethod=auto, cropMaskMethod=rast, extractMethod=rast****
2021-09-03 16:57:09: Downloading country polygons ...
| | 0%2021-09-03 16:57:09: Downloading polygon: IND
2021-09-03 16:57:09: Downloading ctry poly: IND
2021-09-03 16:57:09: Downloading ctry shpZip: IND
2021-09-03 16:57:09: Polygon dir for IND:3.6 already exists
|===============================================================================================================| 100%
2021-09-03 16:57:09: Downloading country polygons ... DONE
2021-09-03 16:57:09: **** PROCESSING nlType:VIIRS.M | configName: VCMCFG | extension: avg_rade9 | nlPeriod:201401****
2021-09-03 16:57:09: Checking tiles required for VIIRS.M 201401
2021-09-03 16:57:09: IND: Stats missing. Adding tiles
2021-09-03 16:57:09: numTiles: 1, Required tiles: 75N060E
2021-09-03 16:57:09: Downloading tile (1/1): 2014013
2021-09-03 16:57:11: Download token expired. Refresh token expired. Requesting new
[1] "The request failed with status code: 401"
[1] "The error is: unauthorized_client" "The error is: Invalid client secret"
Cache-Control X-XSS-Protection Pragma
"no-store" "1; mode=block" "no-cache"
X-Frame-Options Referrer-Policy Date
"SAMEORIGIN" "no-referrer" "Fri, 03 Sep 2021 11:27:12 GMT"
Connection Strict-Transport-Security X-Content-Type-Options
"keep-alive" "max-age=31536000; includeSubDomains" "nosniff"
Content-Type Content-Length status
"application/json" "75" "401"
statusMessage
"Unauthorized"
[1] "Please ensure the username and password saved can login on the EOG site"
trying URL 'https://eogdata.mines.edu/wwwdata/viirs_products/dnb_composites/v10//201401/vcmcfg/SVDNB_npp_20140101-20140131_75N060E_vcmcfg_v10_c201506171538.tgz'
Error in utils::download.file(url = ntLtsFileUrl, destfile = ntLtsZipLocalNamePathVIIRS, :
cannot open URL 'https://eogdata.mines.edu/wwwdata/viirs_products/dnb_composites/v10//201401/vcmcfg/SVDNB_npp_20140101-20140131_75N060E_vcmcfg_v10_c201506171538.tgz'
In addition: Warning message:
In utils::download.file(url = ntLtsFileUrl, destfile = ntLtsZipLocalNamePathVIIRS, :
cannot open URL 'https://eogdata.mines.edu/wwwdata/viirs_products/dnb_composites/v10//201401/vcmcfg/SVDNB_npp_20140101-20140131_75N060E_vcmcfg_v10_c201506171538.tgz': HTTP status was '401 Unauthorized'

[amtantravahi]

I'm having the same issue as the person above, but I have ensured my login credentials are correct. Any idea what is causing it not to register?

[chrisvwn]

Hi,

So the package has not been maintained for a while and I guess there have been changes upstream. I may not be able to update the package any time soon. Please see if you can find an alternative for your use.

[amtantravahi]

Okay, no worries. Thanks for letting us know! All the best.