#trusted data

[garymdm]

Combine Data Quality and Data Observability for Trusted Data

Combining data quality and observability is a powerful approach to ensure data integrity. While data quality focuses on the accuracy and consistency of the data itself, data observability ensures the reliability of the systems that manage it. When combined, these two elements create a powerful foundation for trustworthy data. How Does Combining Data Quality and Observability Improve Trust in…

[misfitmiska]

Accommodations.

[tansytansy]

oyasumi

[bumblingbabooshka]

Tuvok is not as autistic coded in-narrative compared to what I've seen of Spock or T'Pol where they're othered heavily by those around them and have themes and arcs about struggling/striving to fit in BUT I do think he provides the vital autistic representation of not really angsting about your differences from other people because you're too busy and unaware and then even when you ARE made aware you mostly just think 'glad that's not me'. I think it's vital to have that sort of totally unbothered rep. I love that Tuvok is completely satisfied and proud of being Vulcan, doesn't long to experience emotion or struggle with a desire to express himself in a way his crewmates will understand, to be closer to them. I love that he has a long time and close friend that respects who he is and doesn't try to change him and that how close they are isn't framed as being in spite of his Vulcan nature. I love that being Vulcan isn't framed as a hindrance to him, like a roadblock to living a full and rich life. He has a wife and four kids and is a devoted husband and father. He's getting into gay horror scenarios. Tuvok was born on autism planet and he's thriving.

[ghurab-alzilal]

Damian: So you're going on a mission with Zatanna to the Middle East, right?

Raven: Yes, we leave tomorrow.

Damian: Well, there are some words you should memorize and use them with anyone you meet, okay? Repeat after me "ladaya sadiq."

Raven: La-dayaaa sa-diq?... Ladaya sadiq. What does it mean?

Damian: That's not the important thing, but don't forget to tell everyone there, you understand? All the lives around you could depend on it.

Raven: I understand, thanks for the advice, see you in a few days.

*The next day somewhere in the Middle East during a fight with some ifrites *

Raven, shouting out : LADAYA SADIQ!!!

An Imamah who went to help them : I'm happy for you but I don't think these demons really care if you have a boyfriend or not.

Raven: That's what it means?!

Imamah: *nods *

Raven, visibly upset : Well trust me, when I get my hands on him I'll stop having one.

[mostly-natm]

Lore keeps a baby (out of spite).

[mostlysignssomeportents]

Palantir’s NHS-stealing Big Lie

I'm on tour with my new, nationally bestselling novel The Bezzle! Catch me in TUCSON (Mar 9-10), then SAN FRANCISCO (Mar 13), Anaheim, and more!

Capitalism's Big Lie in four words: "There is no alternative." Looters use this lie for cover, insisting that they're hard-nosed grownups living in the reality of human nature, incentives, and facts (which don't care about your feelings).

The point of "there is no alternative" is to extinguish the innovative imagination. "There is no alternative" is really "stop trying to think of alternatives, dammit." But there are always alternatives, and the only reason to demand that they be excluded from consideration is that these alternatives are manifestly superior to the looter's supposed inevitability.

Right now, there's an attempt underway to loot the NHS, the UK's single most beloved institution. The NHS has been under sustained assault for decades – budget cuts, overt and stealth privatisation, etc. But one of its crown jewels has been stubbournly resistant to being auctioned off: patient data. Not that HMG hasn't repeatedly tried to flog patient data – it's just that the public won't stand for it:

https://www.theguardian.com/society/2023/nov/21/nhs-data-platform-may-be-undermined-by-lack-of-public-trust-warn-campaigners

Patients – quite reasonably – do not trust the private sector to handle their sensitive medical records.

Now, this presents a real conundrum, because NHS patient data, taken as a whole, holds untold medical insights. The UK is a large and diverse country and those records in aggregate can help researchers understand the efficacy of various medicines and other interventions. Leaving that data inert and unanalysed will cost lives: in the UK, and all over the world.

For years, the stock answer to "how do we do science on NHS records without violating patient privacy?" has been "just anonymise the data." The claim is that if you replace patient names with random numbers, you can release the data to research partners without compromising patient privacy, because no one will be able to turn those numbers back into names.

It would be great if this were true, but it isn't. In theory and in practice, it is surprisingly easy to "re-identify" individuals in anonymous data-sets. To take an obvious example: we know which two dates former PM Tony Blair was given a specific treatment for a cardiac emergency, because this happened while he was in office. We also know Blair's date of birth. Check any trove of NHS data that records a person who matches those three facts and you've found Tony Blair – and all the private data contained alongside those public facts is now in the public domain, forever.

Not everyone has Tony Blair's reidentification hooks, but everyone has data in some kind of database, and those databases are continually being breached, leaked or intentionally released. A breach from a taxi service like Addison-Lee or Uber, or from Transport for London, will reveal the journeys that immediately preceded each prescription at each clinic or hospital in an "anonymous" NHS dataset, which can then be cross-referenced to databases of home addresses and workplaces. In an eyeblink, millions of Britons' records of receiving treatment for STIs or cancer can be connected with named individuals – again, forever.

Re-identification attacks are now considered inevitable; security researchers have made a sport out of seeing how little additional information they need to re-identify individuals in anonymised data-sets. A surprising number of people in any large data-set can be re-identified based on a single characteristic in the data-set.

Given all this, anonymous NHS data releases should have been ruled out years ago. Instead, NHS records are to be handed over to the US military surveillance company Palantir, a notorious human-rights abuser and supplier to the world's most disgusting authoritarian regimes. Palantir – founded by the far-right Trump bagman Peter Thiel – takes its name from the evil wizard Sauron's all-seeing orb in Lord of the Rings ("Sauron, are we the baddies?"):

https://pluralistic.net/2022/10/01/the-palantir-will-see-you-now/#public-private-partnership

The argument for turning over Britons' most sensitive personal data to an offshore war-crimes company is "there is no alternative." The UK needs the medical insights in those NHS records, and this is the only way to get at them.

As with every instance of "there is no alternative," this turns out to be a lie. What's more, the alternative is vastly superior to this chumocratic sell-out, was Made in Britain, and is the envy of medical researchers the world 'round. That alternative is "trusted research environments." In a new article for the Good Law Project, I describe these nigh-miraculous tools for privacy-preserving, best-of-breed medical research:

https://goodlawproject.org/cory-doctorow-health-data-it-isnt-just-palantir-or-bust/

At the outset of the covid pandemic Oxford's Ben Goldacre and his colleagues set out to perform realtime analysis of the data flooding into NHS trusts up and down the country, in order to learn more about this new disease. To do so, they created Opensafely, an open-source database that was tied into each NHS trust's own patient record systems:

https://timharford.com/2022/07/how-to-save-more-lives-and-avoid-a-privacy-apocalypse/

Opensafely has its own database query language, built on SQL, but tailored to medical research. Researchers write programs in this language to extract aggregate data from each NHS trust's servers, posing medical questions of the data without ever directly touching it. These programs are published in advance on a git server, and are preflighted on synthetic NHS data on a test server. Once the program is approved, it is sent to the main Opensafely server, which then farms out parts of the query to each NHS trust, packages up the results, and publishes them to a public repository.

This is better than "the best of both worlds." This public scientific process, with peer review and disclosure built in, allows for frequent, complex analysis of NHS data without giving a single third party access to a a single patient record, ever. Opensafely was wildly successful: in just months, Opensafely collaborators published sixty blockbuster papers in Nature – science that shaped the world's response to the pandemic.

Opensafely was so successful that the Secretary of State for Health and Social Care commissioned a review of the programme with an eye to expanding it to serve as the nation's default way of conducting research on medical data:

https://www.gov.uk/government/publications/better-broader-safer-using-health-data-for-research-and-analysis/better-broader-safer-using-health-data-for-research-and-analysis

This approach is cheaper, safer, and more effective than handing hundreds of millions of pounds to Palantir and hoping they will manage the impossible: anonymising data well enough that it is never re-identified. Trusted Research Environments have been endorsed by national associations of doctors and researchers as the superior alternative to giving the NHS's data to Peter Thiel or any other sharp operator seeking a public contract.

As a lifelong privacy campaigner, I find this approach nothing short of inspiring. I would love for there to be a way for publishers and researchers to glean privacy-preserving insights from public library checkouts (such a system would prove an important counter to Amazon's proprietary god's-eye view of reading habits); or BBC podcasts or streaming video viewership.

You see, there is an alternative. We don't have to choose between science and privacy, or the public interest and private gain. There's always an alternative – if there wasn't, the other side wouldn't have to continuously repeat the lie that no alternative is possible.

Name your price for 18 of my DRM-free ebooks and support the Electronic Frontier Foundation with the Humble Cory Doctorow Bundle.

If you'd like an essay-formatted version of this post to read or share, here's a link to it on pluralistic.net, my surveillance-free, ad-free, tracker-free blog:

https://pluralistic.net/2024/03/08/the-fire-of-orodruin/#are-we-the-baddies

Image: Gage Skidmore (modified) https://commons.m.wikimedia.org/wiki/File:Peter_Thiel_(51876933345).jpg

CC BY-SA 2.0 https://creativecommons.org/licenses/by-sa/2.0/deed.en

[heertohbadisadhai]

adding citations to a document is so annoying like do you not trust me with shit? am i not credible enough for you?

[nostalgebraist]

Someone asked me about that "Utility Engineering" AI safety paper a few days ago and I impulse-deleted the ask because I didn't feel like answering it at the time, but more recently I got nerd-sniped and ended up reproducing/extending the paper, ending up pretty skeptical of it.

If you're curious, here's the resulting effortpost

[freelyhauntedduck]

I keep getting ads for period tracking apps and I cannot stress this enough, if you live in the USA, please don’t use them. If you can avoid it, please don’t download these.

It is becoming increasingly unsafe to have XX chromosomes and have a menstrual cycle in this country but one thing you can do is avoid using these apps.

Please, use a calendar and track them by hand, but do not trust this kind of data to an app right now.

[garymdm]

Trustworthy Data: The Bedrock of Sound Decisions

In our final instalment of the series on the priorities of Chief Data Officers (CDOs), we’ll explore the importance of trustworthy data and the steps that CDOs must take to ensure data integrity and reliability. In today’s data-driven world, information is king. But not just any information – we need trustworthy data. As Chief Data Officers (CDOs), we understand the critical role this plays:…

[lethality-of-dual-strike]

"I would hug you, but I do not have human arms or warmth."

[gideonisms]

Please check your covid info sources omg. Just read a post that said the vaccine does not prevent you from getting covid, only from getting bad symptoms. The truth is it Can prevent it but does not Always. According to 5 sources I googled immediately after reading the post. come on guys

[salvadorbonaparte]

I have to use AI for one assignment this year but I feel like such a technophobe being the only anti AI person in my cohort

[polkaraton]

We gotta talk about the end of this video from one of Steven Ogg's Q&A sessions.

He speaks of two scenes that didn't make it into the game; The Sharmoota Job, which we knew about, and a "super intense" scene of Trevor and Michael bawling their eyes out?? What?!

Rockstar, release the crybaby cut!!!

[vaspider]

The company said its systems were not breached and that attackers gathered the data by guessing the login credentials of a group of users and then scraping more people’s information from a feature known as DNA Relatives. Users opt into sharing their information through DNA Relatives for others to see. 

...

The full picture of why the data was stolen, how much more the attackers have, and whether it is actually focused entirely on Ashkenazim is still unclear.

...

Callow notes that the situation raises broader questions about keeping sensitive genetic information safe and the risks of making it available in services that are designed like social networks to facilitate sharing.

...

“This incident really highlights the risks associated with DNA databases,” Callow says. “The fact that accounts had reportedly opted into the ‘DNA Relatives’ feature is particularly concerning as it could potentially result in extremely sensitive information becoming public.”

Yeah, so, don't reuse passwords, and be careful what kind of information you share purposefully or opt in to passively sharing.

Jesus fucking Christ.