Yeah, but remember that data is live and it’s currently night time in the UK! (I think average solar is pretty liw in the UK though- something like 5%)
Yeah, but remember that data is live and it’s currently night time in the UK! (I think average solar is pretty liw in the UK though- something like 5%)
We need to do a lot more still, but the fact that the UKs energy generation is 20% of the CO2 emmisions per MW that it was just 10 years ago, despite a very conservative government, is pretty awesome.
(20% figure from this page which has sone cool data and visualisations on it:https://grid.iamkate.com/ data is all sourced from the UK’s National Energy Operator)
I feel like in a lot of ways, most languages are great candidates for this, for lots of different reasons!
Buuuuut, Rust’s compilation can be pretty resource intensive, so if you’re actually developing on limited hardware:
Then there’s the fact that it’s a home server, so always on, meaning you actually have generous resources in some ways, because any available CPU is kinda just there to use so:
And then why not go whole hog into the world of experimental languages:
And then we’re forgetting about:
But that doesn’t factor in:
Plus:
Edit: My actual serious answer is that Rust + Rocket would be great fun if you’re interested in learning something new, and you’d get very optimised code. If you just want it to use less memory that java and don’t want to spend too much time learning new things then python is probably fine and very quick to learn. Go is a nice halfway point.
Well yes, but how is that any different from putting batteries in your wind farm?
This is a cool diagram, but I think it makes it look like you can’t combine stuff. Obviously solar and wind in a lot of cases just plugged straight into batteries for storage.
On the flippy floppy, hydropower can do both, but in completely different ways. If you build a dam, you can’t generate electricity, and if you build a turbine, you can’t store it.
I don’t know what my point overall is. I guess just that energy is complicated, and there probably isn’t a “one size fits all” fix.
I’m a data engineer, use parquet all the time and absolutely love love love it as a format!
arrow (a data format) + parquet, is particularly powerful, and lets you:
Only read the columns you need (with a csv your computer has to parse all the data even if afterwards you discard all but one column)
Use metadata to only read relevant files. This is particularly cool abd probably needs some unpacking. Say you’re reading 10 files, but only want data where “column-a” is greater than 5. Parquet can look at file headers at run time, and figure out if a file doesn’t have any column-a values over five. And therefore, never have to read it!.
Have data in an unambigious format that can be read by multiple programming languages. Since CSV is text, anything reading it will look at a value like “2022-04-05” and say “oh, this text looks like dates, let’s see what happens if I read it as dates”. Parquet contains actual data type information, so it will always be read consistently.
If you’re handling a lot of data, this kind of stuff can wind up making a huge difference.
This is so true!
I think people are so in love with the idea of “innovation” because secretly we all just know that it means “easy-fix” and that sounds a lot better than “hard work”.
Oh nice! I didn’t know about it- thanks for the link
I’m a data engineer, and have seen an ungodly ammount of 200-but-actually-no-stuff-is-broken errors and it’s the bane of my life!
We have generic code to handle pulling in api data, and transforming it. It’s obviously check the status code, but any time an API implements this we have to choose between:
if not response.ok or "actually no there's an error really" in response.content
logicEvery time you ignore protocols and invent your own, you are making everyone sad.
Will take recommendations of support groups I can join for victims of terrible apis.
Take a look at retropi, which is more or less what you’re talking about!
Depending what you’re wanting to get out the project:
Anywag, I’ll stop being a shill now and just give you the link: https://retropie.org.uk/
I lile this a lot. This reminds me a lot of KQL (a microsoft query language that’s used for a bunch if azure logging).
I use a lot of python pandas/dask- I’ve definitely got used to viewing a table as a series of operations to perform rather than the kind of declarative queries you get in SQL.
At what point is it no longer SQL? If we’re changing fundamental stuff, I’d love a way of writing loops or if statements that isn’t painful too.
Ah Marginalia is absolutely awesome! I feel like modern search is almost an extension of website names now, so if I want to find netflix but don’t know it’s website, I might search for “netflix”. Marginalia is actually a cool way to find new stuff- like you can search “bike maintenance” and find cool blog posts about that topic.
I honestly can’t remember if that’s something google and the like used to do, but doesn’t now, or if they never did. Either way, I love it!
This is such a good attitude! I cut all meat out of my diet a long time ago, and when I mention it, people often say something like “I’d love to but I couldn’t commit to never having meat again”.
You don’t have to! It’s amazing if you do, but you’re still gonna make a sizable impact on the cause you care about if you reduce your intake.
It’s odd that people don’t have this with other issues, the idea of “reducing purchases of disposable plastic” or “buying fairtrade more” make total sense to people, but food is still often cashed out in these “all or nothing” terms.