Justin Mason's Weblog Posts
“Framework for Internal Navigation and Discovery” — track device locations using active or passive (wifi-based) scan methods within a house or office, then trigger Home Assistant automation based on device locations — e.g. turning on or off heating in specific rooms, etc.
Wow, this was tragic! “A Google engineer discovered this bug on 12 November, which caused us to declare an internal high-priority incident because of the latent risk to production systems. After analyzing the bug, we froze a part of our configuration system to make the likelihood of the race condition even lower. Since the race condition had existed in the fleet for several months already, the team believed that this extra step made the risk even lower. Thus the team believed the lowest-risk path […] was to roll out fixes in a controlled manner as opposed to a same-day emergency patch. […] Gradual rollouts of both patches started on Monday, 15 November, and patch B completed rollout by that evening. On Tuesday, 16 November, as the patch A rollout was within 30 minutes of completing, the race condition did manifest in an unpatched cluster, and the outage started.”
Risk compensation does occur in very narrow and specific circumstances, but all the studies purporting to show that it is a widespread, predictable outcome of any safety regulation have failed to replicate. […] Risk compensation and health-and-safety panic are both part of a safety nihilism campaign that serves big business’s deregulatory agenda, and the cruel moralizing of right wing religious maniacs, the traditional turkeys-voting-for-Christmas coalition. But risk compensation is especially salient in these covid days, where it’s being used to fight rapid testing (“encourages risky behavior”).
“Right-clicker-mentality is a value we should all aspire to.” fantastic
Donncha O Caoimh’s lengthy and detailed blog post about his exploits in archiving his old Commodore 64 disk collection. I’ve tracked down a few disks of my own from my teenage years, must see if I can find out what’s on them…
After controlling for a range of health and socioeconomic factors, including hypertension, education, and housing values, they found that relatively fewer older people in counties with newly improved air quality developed dementia compared with counties without recent changes. Overall, evidence linked the federal regulation to nearly 182,000 fewer people with dementia in 2013.
We are so screwed. 40% of the IPCC authors responded to Nature’s anonymous survey: 60% of respondents believe that Earth will warm by 3 degrees C by 2100. 7% believe that we will hit 4 degrees C — that’s an uninhabitable planet. 82% said they expect to see catastrophic impacts of climate change in their lifetimes.
lots of modelling and projections for Ireland’s path to meeting our sustainability goals of carbon reduction
“Remove objects, people, text and defects from any picture – 100% free”. Content-aware fill in a web app (via Waxy)
Good news for biogas feasability here: ‘This report seeks to provide scientific analysis and real-world data on the key questions and knowledge gaps concerning the sustainability of an Irish agricultural-led biomethane industry. The core aim of this report is to assess whether Ireland can develop an environmentally sustainable biomethane industry without creating unintended negative consequences. […] This report provides evidence that the development of a sustainable biomethane industry in Ireland is technically feasible and so long as it is developed in a co-ordinated manner, can avoid any negative unintended consequences. As such, a number of proven methodologies have been provided to drive the rollout of a biomethane industry whilst ensuring continued agricultural productivity and improved environmental sustainability.’
3D-printable gadget to hide a Tile under a bottle cage mount on a bike
German RaspberryPi/Pimoroni web shop — handy for avoiding all those Brexit import fees
This is extremely cool! “a word-finding query engine for developers. You can use it in your apps to find words that match a given set of constraints and that are likely in a given context. You can specify a wide variety of constraints on meaning, spelling, sound, and vocabulary in your queries, in any combination. Applications use the API for a wide range of features, including autocomplete on text input fields, search relevancy ranking, assistive writing apps, word games, and more.” (via Rob Manuel)
This paper from a school in Belgium is really worrying, given Ireland’s approach to schools and COVID-19. “Despite the implementation of several mitigation measures, the incidence of COVID-19 among children attending primary school in this study was comparable to that observed among teachers and parents. Transmission tree reconstruction suggests that most transmission events originated from within the school.”
Question: What is the possible role of children in SARS-CoV-2 transmission? Findings: This cohort study including 63 children and 118 adults found no significant difference between the number of children and the number of adults testing positive for SARS-CoV-2 infection during the study period; children were asymptomatic significantly more often compared with adults (46% vs 13%). In addition, a reconstruction of the outbreak showed that most transmission events originated from within the school. Meaning: These results suggest that children may play a larger role in the transmission of SARS-CoV-2 than previously assumed.
What a great term for what the Tories are up to in the UK: “Facing chaos and needing a scapegoat, the Tories seek an endless fight with Europe” —
Frost is well aware of the futility of his demands – indeed, it is the whole point of his Lisbon performance. Instead of declaring victory, accepting the EU’s munificent offers and turning down the heat in Northern Ireland, he and Johnson prefer to make an impossible demand so that they can blame the EU for rejecting it. They are, as the South Belfast MP, Claire Hanna, has put it, “mining for grievance”.
well, this is a little disappointing; even recent JVMs perform poorly in hotspots when Optional values are in use. Even nulls are not too good. tl;dr: primitives with “magic values” where needed are faster.
Wow, this is incredible!
We found that the fruit fly olfactory circuit evolved a variant of a Bloom filter to assess the novelty of odors. Compared with a traditional Bloom filter, the fly adjusts novelty responses based on two additional features: the similarity of an odor to previously experienced odors and the time elapsed since the odor was last experienced. We elaborate and validate a framework to predict novelty responses of fruit flies to given pairs of odors. We also translate insights from the fly circuit to develop a class of distance- and time-sensitive Bloom filters that outperform prior filters when evaluated on several biological and computational datasets. Overall, our work illuminates the algorithmic basis of an important neurobiological problem and offers strategies for novelty detection in computational systems.
Overall, I think the expiration of the Let’s Encrypt CA certificates went really quite well, largely due to the work Let’s Encrypt did around arranging for a new cross-signed chain to be available beyond the expiration of the IdenTrust root. That said, there were far more issues in areas we didn’t anticipate. Modern devices, all the way through to latest versions of iOS and macOS hit issues when connecting to servers that had a misconfigured certificate chain and quite serious issues from huge companies like Google and Microsoft in their cloud products that could no longer validate certificate chains was surprising to say the least. In all, I think this just highlights something that many of us that work in this space have known for some time, that TLS/PKI are complex and fragile systems that often go overlooked for long periods of time because they ‘just work’ most of the time. [….] One thing that’s certain is that this event is coming again. Over the next few years we’re going to see a wide selection of Root Certificates expiring for all of the major CAs and we’re likely to keep experiencing the exact same issues unless something changes in the wider ecosystem.
This is a good article on FB’s disastrous situation, which would be bad enough were it not endangering our societies. Despite warnings from Google and others, they switched their engagement optimization tactics to rely heavily on machine learning, which (as noted elsewhere) devolves into a situation where it’s thoroughly inscrutable:
It developed an internal tool known as FBLearner Flow that made it easy for engineers without machine learning experience to develop whatever models they needed at their disposal. By one data point, it was already in use by more than a quarter of Facebook’s engineering team in 2016. Many of the current and former Facebook employees I’ve spoken to say that this is part of why Facebook can’t seem to get a handle on what it serves up to users in the news feed. Different teams can have competing objectives, and the system has grown so complex and unwieldy that no one can keep track anymore of all of its different components. […] “64% of all extremist group joins are due to our recommendation tools,” the presentation said, predominantly thanks to the models behind the “Groups You Should Join” and “Discover” features. […] These phenomena are far worse in regions that don’t speak English because of Facebook’s uneven coverage of different languages. […] When the war in Tigray[, Ethiopia] first broke out in November, [AI ethics researcher Timnit] Gebru saw the platform flounder to get a handle on the flurry of misinformation. […] When fake news, hate speech, and even death threats aren’t moderated out, they are then scraped as training data to build the next generation of [language models]. And those models, parroting back what they’re trained on, end up regurgitating these toxic linguistic patterns on the internet.”What. A. Mess.
‘A community-contributed collection of software-related incident reports’ — this looks like it’ll be a great resource.
Looks like this is disinformation produced by an Aston-Martin-affiliated lobbyist/PR company — the true figure is 18,000 miles
A report commissioned by Wind Energy Ireland in June 2021 — key findings:
Reducing power sector CO2 emissions in Ireland from around 9 million tonnes today to a target of less than 2 million tonnes of CO2 per year is very achievable by 2030, using the approach currently underway to achieve the ‘70 by 30’ target, and implementing more of existing and proven technologies; The current Programme for Government renewable capacity targets of 8.2 GW of onshore wind and 5 GW of offshore wind by 2030 should be maintained, with an additional target of 5 GW of solar PV. This target can be achieved at a lower cost to the end consumer in Ireland, compared to delivery of the less ambitious ‘70 by 30’ target. A zero-carbon power system is possible by 2030 and represents an achievable target in the 2030s.
At the simplest level, [wanghong] means “internet famous,” referring in its earliest iterations to viral personalities or social media influencers. The word has since mutated, expanding and venn-diagramming with a particular hipster aesthetic, strands of urban design and kinds of tech platform architecture.
tl;dr: the item size limit, the pagination page size limit for query and scans; and the partition throughput limits (which bit me earlier this year).
I remember seeing discussion of aerosol and airborne transmission of SARS-CoV-2 observed in Asia, right back at the start of 2020. This paper is right; the WHO in particular were careful to write this off as incorrect, and tell people that it was transmitted mainly via droplets, which we now know was a massive failure.
Scientific and policy bodies’ failure to acknowledge and act on the evidence base for airborne transmission of SARS-CoV-2 in a timely way is both a mystery and a scandal. In this study, we applied theories from Bourdieu to address the question, “How was a partial and partisan scientific account of SARS-CoV-2 transmission constructed and maintained, leading to widespread imposition of infection control policies which de-emphasised airborne transmission?”. […] Results: Political and policy actors at international, national, and regional level aligned — predominantly though not invariably — with medical scientific orthodoxy which promoted the droplet theory of transmission and considered aerosol transmission unproven or of doubtful relevance. This dominant scientific sub-field centred around the clinical discipline of infectious disease control, in which leading actors were hospital clinicians aligned with the evidence-based medicine movement. Aerosol scientists — typically, chemists, and engineers — representing the heterodoxy were systematically excluded from key decision-making networks and committees. Dominant discourses defined these scientists’ ideas and methodologies as weak, their empirical findings as untrustworthy or insignificant, and their contributions to debate as unhelpful.
Via David Roberts: “Microsoft is trying to go carbon-negative. Its recent RFP solicited bids for 154 million tonnes of negative emissions; of those, only *2 million tonnes* met its criteria for real, permanent CO2 removal. It has written up its challenges in Nature.” “We write as a team composed of Microsoft staff working on the company’s carbon-negative programme, and research scientists who analyse carbon reduction and removal strategies. We highlight three ‘bugs’ in the current system: inconsistent definitions of net zero, poor measurement and accounting of carbon, and an immature market in CO2 removal and offsets. These challenges need to be overcome if the world is to reach net zero by mid-century.”
Some good points:
A project whose goal is to plant a certain number of trees is particularly vulnerable to failure because its counting the wrong thing. If the goal is to absorb emissions, we should count the carbon, not the trees. A few small large absorb more carbon than a bunch of little trees. When we plant trees with carbon uptake or forest restoration as a goal, we don’t try to maximize the number of trees. We try to maximize long-term carbon uptake, and this might actually mean planting fewer trees up front.
Amazon’s new “Full HD 15.6″ smart display for family organisation with Alexa”. I’ve built something similar (though much more basic) for our home using an e-Paper display and a Raspberry Pi, so I’m interested. My take: it looks very busy, heavy on the Alexa lock-in, would omit lots of useful data sources (like Home Assistant), and of course the spyware factor is a biggie — although on that note it’s interesting that there’s a prominent “mic/camera off” switch…
IKEA-branded CR2032 batteries last about 70% as long as Duracell or Energizer, or 50% if your devices turn off at 2.7V
Holy shit this is dystopian.
All of the largest companies in the world are today powered by a covert crowd of the system’s castoffs. Platforms have found amid those struggling to stay afloat in informal work — or else barely clinging onto a life in formal employment — a desperate mass to be tempted with the promise of a better life. Such a promise, however, is broken as soon as it is made; the petty services of the informal sector resemble little more than a blueprint for the microtasks of big tech, without offering anything in the way of rights, routine, role, security, or a future.
wow this is complex. Vitess playing a key part
“VR Productivity in (or above) a WFA world” —
This week, I’ll spend 40–50 hours in Virtual Reality (Immersed), like I did last week and every (work) week for the last 2½ years. […] Yes, really: 8–10 hours a day strapped in.Basically, it’s using an Oculus Quest 2 to render multiple desktop displays from a laptop into a huge, full-visible-range virtual world:
The resolution of these very large displays is surprisingly average—1080p (Reference, Communication) and 4k (Main). This makes the dot pitch unimpressive by the numbers, though still more than twenty-five times that of a roadside billboard display. Higher resolutions are available, but this is my calculated trade-off between pixel parity (more on that below), computer performance, and latency. Applications are tuned for readability and crispness, emphasizing information density over anti-aliasing or smoothness.The article sounds fairly solid, with good tips on how to make a VR headset suitable for constant daily use.
‘a variable-length code compression used to store arbitrarily large integers in a small number of bytes.’
This is a staggering stat: “19 of Facebook’s top 20 pages for American Christians in 2019 were run by troll farms in Kosovo and Macedonia, internal documents leaked to MIT Technology Review reveal […] funded by the Russian Internet Research Agency.” (via Charlie Stross)
“If you ever wondered why Google had 8 different chat products, all killed within 3 years, but not before multiple Staff, Sr Staff, Sr PM, Principal PM, Sr EM, Director promotions were done off the back of the impact & complexity of these projects. This is exactly why.”
The CRAC Lab at UCC notes: ‘The use of gas stoves produces nitrogen dioxide which is associated with asthma — this meta-analysis provides quantitative evidence that, in children, gas cooking increases the risk of asthma and indoor NO2 increases the risk of current wheeze.’
Handy to explore what 3G/4G/5G coverage a particular rural spot in Ireland may get
Data-driven results from the UK ZOE symptom survey!
Currently, the most common COVID-19 symptoms in people who have been fully vaccinated […] are: Runny nose, Headache, Sneezing, Sore throat, Loss of smell (anosmia)And “loss of smell (anosmia) or loss of taste is still one of the most important predictors of testing positive for COVID-19 rather than a regular cold”.
“Dear Google Cloud: Your Deprecation Policy is Killing You”:
This lack of a support culture, combined with a “let’s break it in the name of making it prettier” deprecation treadmill, is alienating their developers. And that’s not a good thing if you want to build a long-lived platform. Google, wake the fuck up. It’s 2020. You are still losing. It’s time to take a hard look in the mirror and answer for yourselves whether you really want to be in the Cloud business. If you do, then stop breaking shit. You guys are rich. We developers are not. So when it comes to shouldering the burden of compatibility, you need to pay for it. Not us.This is absolutely correct — API deprecation is a lovely thing when you’re the one doing the deprecating, but it’s a disaster for the user experience, and sometimes that should be the most important thing.
Nice, simple way to collapse long log streams into collapsable/hidable sections, from BuildKite
In-kernel memcache based on eBPF (via Brendan Gregg):
BMC (BPF Memory Cache) is an in-kernel cache for memcached. It enables runtime, crash-safe extension of the Linux kernel to process specific memcached requests before the execution of the standard network stack. BMC does not require modification of neither the Linux kernel nor the memcached application. Running memcached with BMC improves throughput by up to 18x compared to the vanilla memcached application.
I’ve always suspected some bullshit like this — Apple devices (Macs and iPhones) expect a specific non-standard wifi setting. If you’ve noticed Apple devices falling off the network and taking a long time (many seconds) to rejoin, where devices with other OSes do not have the same problem, this may be the cause. tl;dr: the DTIM (delivery traffic indication message) setting, which defaults to 1 in a standards-compliant AP, is expected to be set to 3 by Apple devices, in order to improve battery life. Source: https://twitter.com/revolutionwifi/status/725489216768106496 (“Apple engineers have strongly suggested a DTIM of 3.”)
How best can scientists push back against [science denialists]? There is a range of evidence-based strategies. These include: “Public inoculation”–warning people about the risk of being misled and drawing attention to who is pushing the contentious information and their financial competing interests; Highlighting scientific consensus; and Mapping the institutional networks who are pushing controversial information and then using political and legal strategies to counter them. For physicians, scientists, and public health officials to be effective countering efforts like the [Great Barrington declaration], it will be absolutely critical for them to realize that they are not dealing with an orthodox scientific debate based on sound data and evidence, but a well-funded sophisticated science denialist campaign based on ideological and corporate interests.