Welcome to EnviroDIY, a community for do-it-yourself environmental science and monitoring. EnviroDIY is part of WikiWatershed, a web toolkit designed to help citizens, conservation practitioners, municipal decision-makers, researchers, educators, and students advance knowledge and stewardship of fresh water. New to EnviroDIY? Start here

Publish to AWS?

Home Forums Mayfly Data Logger Publish to AWS?

Viewing 1 reply thread
  • Author
    Posts
    • #15654
      dan@wachusett
      Participant

      Hey EnviroDIY,

      I am researching the use of AWS buckets as an alternative data endpoint for Mayfly logger output. Has anyone out there already tried doing this?

      After some preliminary research it seems like that I would have to do the following steps:

      1. Create my AWS bucket
      2. Set up a new publisher script for logging to AWS as the endpoint
      3. Set up AWS SDK to read the data stream and write it to a file in the bucket

      If anyone else has interest in this or prior experience please let me know.

      Thanks,
      Dan

    • #15656
      neilh
      Participant

      Its often seems simple, but the practical side of it can be complex – like if certificates are needed.  AWS can scale, but that requires a lot of layers. As I understand it AWS dices and slices the options and the bills are a big surprise.

      In software design the question that comes up is, what’s the functionality that is desired? How do you break the functionality into small layers.  What currently works, and what is needed.

      Does it have to be AWS or can it be something else?

      https://thingspeak.com/  Can do data collection, and then my experience is the API can pull it off pretty easily.  I did this with an experimental  http://azonde.org/pm2/LiveRainGauge3.htm

      The code is in the browser, not that I really follow how it all works!!  and also here https://github.com/neilh10/thingspeakmultichannel-highcharts

      The thingspeak costs are pretty well defined.

      For the Mayfly which ever way you look at data collection, then reliably pushing data to the endpoint is also needed, which  I’ve got in my sensors, and its on my list to PR but haven’t got there yet.  https://github.com/EnviroDIY/ModularSensors/issues/194

       

Viewing 1 reply thread
  • You must be logged in to reply to this topic.