Issues

• deploy to Google Cloud Run

  enhancement
  simonsdave/cloudfeaster#63 · Filter by author simonsdave opened on Sep 8, 2024

• move code all in spider.py to __init__.py

  enhancementusability
  simonsdave/cloudfeaster#62 · Filter by author simonsdave opened on Dec 30, 2021 · v1.0

• need process to ensure using current rev of Alpine for runtime-lite docker image

  enhancementprivacysecurity
  simonsdave/cloudfeaster#61 · Filter by author simonsdave opened on Dec 22, 2021 · Future

• structure crawl responses so easy to determine crawl arg, site vs infrastructure errors

  enhancement
  simonsdave/cloudfeaster#60 · Filter by author simonsdave opened on Jan 27, 2021 · v1.1

• SpiderCrawler() should validate crawl args using spider metadata

  enhancement
  simonsdave/cloudfeaster#59 · Filter by author simonsdave opened on Jan 27, 2021 · v1.0

• install-chromedriver.sh should not use apk to install chromedriver

  bug
  simonsdave/cloudfeaster#58 · Filter by author simonsdave opened on Jan 15, 2021 · v1.1

• runtime docker image builds should use docker multi-stage builds

  optimization
  simonsdave/cloudfeaster#57 · Filter by author simonsdave opened on Jan 10, 2021 · v1.0

• spider metadata should include jsonschema for crawl results

  enhancement
  simonsdave/cloudfeaster#53 · Filter by author simonsdave opened on Jan 1, 2021 · v1.0

• eliminate warning message in CircleCI logs

  bugprivacy
  simonsdave/cloudfeaster#45 · Filter by author simonsdave opened on Nov 16, 2020 · v1.0

• cloudfeaster/dev_env/README.md needs rewrite

  docs
  simonsdave/cloudfeaster#42 · Filter by author simonsdave opened on Dec 18, 2019 · v1.0

• spider args can appear in spider logs - how can these be masked out?

  privacy
  simonsdave/cloudfeaster#40 · Filter by author simonsdave opened on Nov 30, 2019 · v1.1

• DRY up Circle CI config generated by generate-circleci-config.py

  optimization
  simonsdave/cloudfeaster#39 · Filter by author simonsdave opened on Jun 3, 2019 · Future

• add support for document & image OCR

  enhancement
  simonsdave/cloudfeaster#38 · Filter by author simonsdave opened on Jun 2, 2019 · Future

• run generate-circleci-config.py on latest released branch not master

  bugquestion
  simonsdave/cloudfeaster#37 · Filter by author simonsdave opened on May 23, 2019 · Future

• update dev-env docs for accuracy

  docs
  simonsdave/cloudfeaster#34 · Filter by author simonsdave opened on Apr 28, 2019 · v1.0

• generated docker image should be published under cloudfeaster dockerhub profile

  todo
  simonsdave/cloudfeaster#33 · Filter by author simonsdave opened on Apr 28, 2019 · v1.0

• move this repo to cloudfeaster org

  todo
  simonsdave/cloudfeaster#32 · Filter by author simonsdave opened on Apr 28, 2019 · v1.0

• spider_authors.md needs lots of attention

  docs
  simonsdave/cloudfeaster#31 · Filter by author simonsdave opened on Apr 28, 2019 · v1.0

• integrate BrowserMob Proxy to generate HAR files

  enhancement
  simonsdave/cloudfeaster#30 · Filter by author simonsdave opened on Mar 3, 2019 · Future

• spider metadata jsonschema should include version number

  enhancement
  simonsdave/cloudfeaster#23 · Filter by author simonsdave opened on Mar 3, 2018 · v1.0

• Need an approach for handling CAPTCHAs

  enhancement
  simonsdave/cloudfeaster#13 · Filter by author simonsdave opened on Dec 22, 2017 · Future