Live programming @ University of Washington
Public
Edited
Nov 22, 2023
Atlas Obscura scraping
user = Inputs.text({value:'kevbot'})
user_places = {
var regex = /AtlasObscura\.user_profile\s*=\s*({[\s\S]*?\}\}\]\}\});/;
// Find the match
var match = text.match(regex);
// Initialize obj as null
var obj = null;
// Check if there was a match and parse the JSON
if (match && match[1]) {
try {
// The JSON object string is in match[1]
obj = JSON.parse(match[1]);
} catch (e) {
console.error("Parsing error:", e);
}
}
return obj.user.places
}
url = `https://www.atlasobscura.com/users/${user.value}?view=passport`
fetch(url) // rip, CORS cross origin resource sharing (avoids cross-site scripting attacks)
import {fetchp} from '@tomlarkworthy/fetchp' // NOTE notebook must be published/link-shared for this to run
fetchp
response = fetchp(url)
response.status
text = response.text() // empty?
baz = 42
html`${text}`
places = ['australia', 'japan', 'germany']
(await fetchp(`https://www.atlasobscura.com/things-to-do/australia`)).status
result = Promise.all(places.map(async p => ((await fetchp(`https://www.atlasobscura.com/things-to-do/${p}`)).text())))
Purpose-built for displays of data
Observable is your go-to platform for exploring data and creating expressive data visualizations. Use reactive JavaScript notebooks for prototyping and a collaborative canvas for visual data exploration and dashboard creation.
