Skip to content

About

Personal site, and a static searchable rebuild of Nebraska's state contracts database — 740,000+ public spending records, scraped from the state's own filings.

Topics

Resources

Stars

0 stars

Watchers

0 watching

Forks

Repository files navigation

diepjustin.github.io

Justin Diep's personal site, and the reporting project that grew out of it. Live at diepjustin.github.io.

Justin is a journalism, advertising/PR and broadcasting-media production student at the University of Nebraska–Lincoln.


Nebraska State Contracts

diepjustin.github.io/ne-contracts

The state publishes its contracts and purchase orders one record at a time, behind a search form. This scrapes them and rebuilds the lot as a single page you can search, filter and sort in the browser.

Records 743,899
Entities — every state agency, board and commission, plus all nine University of Nebraska and Nebraska State College campuses 92
Records carrying the state's own description of the work 551,018
Records asked what documents they publish 741,852
Records publishing more than one document 37,609

Everything on the page is the state's own words. Descriptions are lifted from the filings verbatim — never rewritten, never summarised — and where one could not be read the page says so rather than leaving a blank to be misread.

The whole thing is static: no server, no database, no API. The payload is packed into binary columns so 743,899 rows can be filtered on a keystroke, with link tokens and descriptions fetched only for the rows someone actually opens.

ne-contracts's own README is the real documentation — what the data does and does not cover, how the scraper and payload work, the guard rails around re-running it, and a long list of things that went wrong and what they cost. Read it before changing anything there. (It's a separate repo now — see below.)

Before quoting it

The scraper reproduces the state's records faithfully, including their errors. This is not a complete record of state spending: by the state's own FAQ the database excludes several agencies' contracts entirely, and only documents active on or after 1 January 2014 are in it at all. The full list of gaps, quirks and known bad values is in that folder's README.


The rest of the repo

Everything below is the portfolio itself and lives in this repo.

index.html the homepage — about, awards, featured work, photography, video, projects, contact form
404.html custom not-found page
assets/, photos/JPEG/ profile photo, résumé, publication logos (assets/logos/), and the photography on the homepage (photos/JPEG/thumbs/ holds the grid-size copies)
serve.py local preview server for the homepage
main-in-ballot-search/ a small standalone lookup page

Plain HTML and CSS, hand-written, with no framework and no build step. GitHub Pages publishes from the Publish to Pages workflow rather than from the branch, though there's nothing left here to build — the workflow just stages and deploys the checkout.

The data projects

Each of these used to be a folder in this repo and is now its own GitHub repo, still under diepjustin, publishing at the same diepjustin.github.io/<name>/ path it always had:

ne-contracts the contracts scraper and site, above
ne-connect one search box across contracts, campaign finance and lobbying, joined at build time
ne-campaign-finance scraper and normalizer for the NADC's campaign-finance extracts
ne-lobbying scraper for the Legislature's lobbyist reports, feeding ne-connect
ne-ice where ICE arrests the people held in Nebraska's detention facilities
ne-betting prediction-market activity on Nebraska football (Kalshi, Polymarket)
salary-search University of Nebraska salary search
unl-events-calender UNL events, ranked by major, refreshed nightly by a workflow

Each has its own README (or MAINTAINING.md) that is the source of truth for that project: data caveats, how to run it, and what is unfinished.


Public records used here come from the Nebraska Department of Administrative Services and are published under Neb. Rev. Stat. § 84-602.04. Code is MIT licensed — see ne-contracts's LICENSE.

About

Personal site, and a static searchable rebuild of Nebraska's state contracts database — 740,000+ public spending records, scraped from the state's own filings.

Topics

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Used by

Contributors

Languages