SkyProbe Data Access
In December 2023, direct, queryable, access to the SkyProbe data archive was discontinued as a result of changes to CFHT's computing infrastructure and security policies. This has been replaced with downloadable CSV files which contain blocks of historical SkyProbe data, and public access to live SkyProbe data, which can be used to construct external data repositories.
Current Raw Data
The CFHT public weather server has SkyProbe data available. The data published on the public weather server is the "latest value" and automatically updates as new data come in. Data from SkyProbe is created once per minute (60-second intervals). CFHT recommends that users who desire an updating display of real-time SkyProbe values during nighttime operations, should setup an automatic query or webscraper on weather server page, querying once per minute for the latest SkyProbe data.
Link to the CFHT Public Weather Server
SkyProbe data is listed at the bottom of the weather server page in five separate fields:
- SkyprobeTime: Time of observation (UTC)
- SkyprobeExtinction: SkyProbe extinction measurement
- SkyprobeScatter: Scatter of measurement
- SkyprobeAirmass: Telescope position airmass at time of measurement
- SkyprobeStarCount: Number of stars used to determine the measurement
Current SkyProbe data is only available when CFHT is open and performing science operations. When not operating, the weather server page will display "invalid" in these fields.
Sample data, as displayed on the weather server page during science operations:
SkyprobeTime = 2024/02/13,07:42:53 # Time of last SkyProbe Update (GMT)
SkyprobeExtinction = 0.0730 # SkyProbe Extinction
SkyprobeScatter = 0.0060 # SkyProbe scatter
SkyprobeAirmass = 1.2620 # SkyProbe airmass
SkyprobeStarCount = 577 # SkyProbe star count
As an example:
SkyprobeTime (UTC) |
2024/02/13,07:42:53 (Monday, February 12, 2024, 21:42:53 HST) |
SkyprobeExtinction |
0.0730 magnitudes |
SkyprobeScatter |
0.0060 magnitudes |
SkyprobeAirmass |
AM 1.2620 |
SkyprobeStarCount |
577 stars |
This data is unfiltered, and may contain erroneous or spurious data points. Additionally, there is a small, but variable, zero-point offset to the extinction measurement.
This varies based on sky conditions, instrument cleanliness (dust on the lens), and telescope airmass. For simplicity's sake, CFHT staff usually assume an average offset of +0.03.
Using this assumption, the "true" value for the extinction measurement displayed above would be 0.0430.
Historical Raw Data
Select the desired year or semester below to download a CSV file that contains the SkyProbe data from that period. Data from the current year will be added in early January of the following year. Semester data is added after each semester*. Data prior to 2010 is not available in this format. Contact the CFHT QSO Team if you have questions.
For visualized plots by night, use the Historical Graph Tool. These plots go back to 2001.
Each full year file is approximately 10MB. Semester files are approximately 5MB.
*'A' semesters run from February 1 to July 31. Data will be added in early August. 'B' semesters run from August 1 to January 31 of the following year. Data will be added in early February.
As is standard in CSV files, this data is provided as a list of comma-separated elements, with each row being an individual SkyProbe archival record. There are six elements per row. They are:
- Time of database record creation (HST)
- Time of observation (UTC)
- SkyProbe extinction measurement
- Scatter of measurement
- Telescope position airmass at time of measurement
- Number of stars used to determine the measurement
Sample data, as listed in the CSV files:
2020-08-06.03:00:07,"2020/08/06, 12:59:57",0.0870,0.0070,1.1890,405
2020-08-06.03:01:06,"2020/08/06, 13:00:57",0.0680,0.0060,1.1910,390
2020-08-06.03:02:06,"2020/08/06, 13:01:57",0.0690,0.0070,1.1930,376
2020-08-06.03:03:06,"2020/08/06, 13:02:57",0.0690,0.0070,1.1950,370
Using the top row as an example:
Time of database record creation (HST) |
2020-08-06.03:00:07 (Thursday, August 6, 2020, 03:00:07 HST) |
Time of observation (UTC) |
"2020/08/06, 12:59:57" (Thursday, August 6, 2020, 02:59:57 HST) |
SkyProbe extinction measurement |
0.0870 magnitudes |
Scatter of measurement |
0.0070 magnitudes |
Telescope position |
AM 1.1890 |
Number of stars |
405 stars |
This data is unfiltered, and may contain erroneous or spurious data points. Additionally, there is a small, but variable, zero-point offset to the extinction measurement.
This varies based on sky conditions, instrument cleanliness (dust on the lens), and telescope airmass. For simplicity's sake, CFHT staff usually assume an average offset of +0.03.
Using this assumption, the "true" value for the extinction measurement displayed above would be 0.0570.
Note that there are gaps in the data (reasons will vary). Contact the QSO Team if you have further questions.
|