#biggest data

[nitor-infotech]

In today's data-driven world, seamless data integration and processing are crucial for informed decision-making. Matillion, a robust ETL (Extract, Transform, Load) tool, has gained popularity for its ability to streamline these processes.

In this blog, you will learn how it efficiently moves and transforms data from various sources to cloud data warehouses, making data management easier. Apart from this, you'll also get a brief understanding of its constraints and best practices for transforming large datasets.

By understanding these aspects, you can maximize your business capabilities and drive forward excellently. 

[sophiebaybey]

Not to preach to the choir but I wonder if people generally realize that AI models like ChatGPT aren't, like, sifting through documented information when you ask it particular questions. If you ask it a question, it's not sifting through relevant documentation to find your answer, it is using an intensely inefficient method of guesswork that has just gone through so many repeated cycles that it usually, sometimes, can say the right thing when prompted. It is effectively a program that simulates monkeys on a typewriter at a mass scale until it finds sets of words that the user says "yes, that's right" to enough times. I feel like if it was explained in this less flattering way to investors it wouldn't be nearly as funded as it is lmao. It is objectively an extremely impressive technology given what it has managed to accomplish with such a roundabout and brain-dead method of getting there, but it's also a roundabout, brain-dead method of getting there. It is inefficient, pure and simple.

[religiousboyq]

The Biggest Data Breach in History: Safeguarding Our Digital Fortresses

In today’s fast-paced digital age, where information is the new currency, ensuring the security of our data has become paramount. Data breaches, unfortunately, have become an all-too-common occurrence, leaving individuals and organizations vulnerable to a myriad of threats. But what happens when a data breach reaches unprecedented proportions? This article delves into the world of data breaches, with a particular focus on the “biggest data breach in history,” exploring its implications and the lessons we can learn from it.

[rythyme]

Introducing the Thai Drama AO3 Trends Dashboard! (Beta) 🇹🇭

Over the last several weeks or so I've been building an auto-scraping setup to get AO3 stats on Thai Drama fandoms. Now I finally have it ready to share out!

Take a look if you're interested and let me know what you think :)

(More details and process info under the cut.)

Main Features

This dashboard pulls in data about the quantity of Thai Drama fics over time.

Using filters, it allows you to break that data down by drama, fandom size, air date, and a select number of MyDramaList tags.

You can also see which fandoms have had the most new fics added on a weekly basis, plus the growth as a percentage of the total.

My hope is that this will make it easier to compare Thai Drama fandoms as a collective and pick out trends that otherwise might be difficult to see in an all-AO3 dataset.

Process

Okay -- now for the crunchy stuff...

Scraping 🔎

Welcome to the most over-complicated Google Sheets spreadsheet ever made.

I used Google Sheets formulas to scrape certain info from each Thai Drama tag, and then I wrote some app scripts to refresh the data once a day. There are 5 second breaks between the refreshes for each fandom to avoid overwhelming AO3's servers.

Archiving 📁

Once all the data is scraped, it gets transferred to a different Archive spreadsheet that feeds directly into the data dashboard. The dashboard will update automatically when new data is added to the spreadsheet, so I don't have to do anything manually.

Show Metadata 📊

I decided to be extra and use a (currently unofficial) MyDramaList API to pull in data about each show, such as the year it came out and the MDL tags associated with it. Fun! I might pull in even more info in the future if the mood strikes me.

Bonus - Pan-Fandom AO3 Search

Do you ever find it a bit tedious to have like, 15 different tabs open for the shows you're currently reading fic for?

While making this dash, I also put together this insane URL that basically serves as a "feed" for any and all new Thai drama fics. You can check it out here! It could be useful if you like checking for new fics in multiple fandoms at once. :)

Other Notes

Consider this dashboard the "beta" version -- please let me know if you notice anything that looks off. Also let me know if there are any fandoms missing! Thanks for checking it out!

The inspiration for this dashboard came from @ao3-anonymous 's AO3 Fandom Trend Analysis Dashboard, which I used as a jumping off point for my own data dash. Please give them some love <3

[psybrepunk]

Sorry

And probably a good time for this gentle reminder: ANY MINORS GET TF OFF MY BLOG THIS IS AN 18+ ANDROIDFUCKING SPACE THANX

[imjustalazycat]

Chapter 1

Page 16/22

Next

Previous

Cover

[destinationtoast]

Toastystats data dump: size of all fandom tags on AO3 (Feb 2025)

I told someone over in the fandom data projects community that I'd share data on the size of fandom tags on AO3; then it occurred to me that perhaps other folks might also want this spreadsheet.

(It sometimes takes a sec for the data to load in Google Sheets, because there's a lot of data. If anyone can't get it to load lmk, and I can share CSV files instead.)

Here's a graph of how many fandom tags are in each of the media categories that AO3 uses:

A few notes about this data below the cut:

This data comes from the category lists on AO3, e.g., the list of Anime & Manga fandoms. Sometimes those numbers don't quite match what's on the actual Works page for a tag (e.g., The X-Files Works page says the fandom has 27,303 works as I'm typing this up, but the TV Shows category page says The X-Files has 27,355 works. (I suspect the larger number may include drafts and/or some deleted works, but I don't know for sure.)

The spreadsheet contains one list of all the tags together (sorted by size) plus lists for each of the different categories (in separate spreadsheet tabs).

The categories overlap -- e.g., the fandom tag "Star Wars - All Media Types" appears in Movies, TV Shows, Books & Literature, Cartoons & Comics & Graphic Novels, Other Media, and Video Games.

The data also includes stats on category size -- i.e., the number of fandom tags in each category. (Used to make the above graph)

This data includes restricted works as well as public works (unlike a lot of my fandom stats).

Uncategorized Fandoms (often typos or errors, or other things that will eventually end up wrangled into a bigger fandom) are not included above, as there are no sizes for those and a lot of them will disappear once wranglers handle them. But you can browse the current list in this spreadsheet.

There may be errors! Please let me know if you find anything that's obviously just wrong.

[more-flotsam-and-jetsam]

[dasanye-wet]

The commodification of hobby-level art is the true villain here. And I say this as someone who does hobby-level art as my day job. All I truly want to do is sit around and draw stuff I like all day without having to worry if my basic needs for food and shelter are being met. Even when it was my sole income stream, I still gave out free art all the time because for me even when it's been about the money, it's always been foremost about creating. I want to create things because they're striking, not because I'm hungry. Capitalism really rotted our brains into thinking all of our talents need to be marketable side hustles because we're all temporarily embarrassed millionaires who just haven't had our lucky break yet. Meanwhile we're all too busy treading water trying to stay economically afloat to be rational about anything that threatens what little we DO have

[copia]

no power in my house and it won't be fixed for a couple of days. what the fuck. on perpetua eve of all days

[ganondorf]

what they don't tell you about gtav enhanced is that one day it'll suddenly consistently crash 2-3 minutes into gameplay

[moonfurthetemmie]

im gonna share the heroforge shit i made for the old middle school oc reboot tonight, and maybe share lore tomorrow. but i'm gonna be doin stuff tomorrow so i may forget

also i may add an idiot to the roster but for now we have these guys. kari's the host btw. and that's what their shared body looks like

Kari - agender, prefers none but do whatever

Tethys - demi-girl, she/they

Delta- cis woman, she/her

Data - nonbinary, they/them

Lizzie - agender, prefers she/her but use whatever

Jennifer - officially haven't decided, but uses she/her. maybe others? we'll see

[gothteddiesdotcom]

not to brag about being good at my job but I’ve now developed two separate tools for debugging entirely on my own within my company entirely from scratch without help and A. it makes my job so much fucking easier and B. my boss is thinks im incredible just because im too lazy to want to write the same bits of code over and over just for debugging purposes

[sketchpepper]

Harry!!!! I successfully edited the dog base to give him muttonchops and some hair, *and* figured out a way to have him keep his jacket. His shirt will still be swap-able like the rest of AC's animals. I unfortunately did not have the triangle wiggle room for him to keep the tie :(

(Design lifted from here)

[aeolianblues]

I'm not an extrovert. At all. In everyday life, I'm a yapper, sure, but I need someone to first assure me I am okay to yap, so I don't start conversations, even when I really want to join in sometimes! It's just the social anxiety acting up. God knows where from and why I lose a lot of my inhibitions when it comes to talking to people about music. I don't know where the confidence has suddenly sprung from. I've made a crazy amount of friends in musical circles, either just talking to people about common music or (since it is after all in music circles) talking to bands about their own music. I let out a sigh of relief any time an interaction goes well, because in truth it's going against my every instinct. I wish I could do that in everyday life

[coriander-candlesticks]

Note to self: word prayers better when doing divinatory sessions

I think I've mentioned this before, but I do yes/no stone pulls on Sundays to ask for guidance about maintaining my health re: my commute because it's 2-2.5 hours each way via public transit if everything runs on time. It's rough on me in multiple ways and can lead to even more migraines than usual or being too fatigued to work at all, and it can be difficult to tell whether I'll have the spoons to go in person.

This past Sunday I was exhausted & stressed because of, you know, the horrors, and said my initial prayer a little differently than I usually do. I still invoked Apollo and Hermes as always, as both of them cover divination by lots, Apollo's domain covers health & disease, and he's the one I turn to for divination by default.

Now, the vast majority of the guidance and lessons Apollo has given have had to do with recognizing my physical & mental limits, especially around this issue. The answers I was getting this time around were...odd but not quite in the way they have been with just dud pulls, so I started asking clarifying questions to figure out what was going on. After a few - establishing that there was a reason for the answers but it wasn't a test or punishment or Apollo messing with me (which would have been. odd) - I realized that while I'd invoked Hermes as a god of divination by lots alongside Apollo, I had not explicitly asked him to act as a messenger and aid in communication this time around, nor had I asked Apollo to guide the divination session with the wording I usually use.

I think you can see where I'm going with this.

I re-said the prayer (correctly this time) and confirmed that it was, in fact, Hermes at first while re-doing the initial set of questions (which were much more consistent in the usual way), as well as confirming that the issue was the prayer wording. Lesson learned lol