D. Moonfire @dmoonfire@octodon.social

Flight of the Scions 14: Changing Plans #Action #YoungAdult #Patreon #OneDollarPatreon
https://fedran.com/flight-of-the-scions/chapter-14/

Kanéko wakes up in the morning to find that the rest of the class had left without her, leaving only Pahim alone to catch up with the others. But there are other things waiting for her, including a st

@kevinbeynon Yeah. Learning the differences between those two can be a killer. My last few jobs have been dealing with compliance for large companies, so learning how to write apps that have 1.2 M rows of data that has to be shown in real time or generating 12k page PDFs is both challenging and frustrating at the same time. :)

@kevinbeynon Having your task plan really helps with that. I found I try to have the 1, 2, 4, 8, and 16 year plans when working on projects. Sometimes it goes wrong, but I found you make different decisions when you know where you are heading.

Speaking of which, have you considered a public site for gathering feature requests/support. Something that can be voted on like uservoice or GitLab's issue-only projects?

@kevinbeynon

Yes, if you are planning on supporting huge files, establishing and solving the concept of secondary services will make your life easier.

That is how Stack Overflow, GitHub, GitLab, and Reddit (to a smaller degree) work.

Stupid front ends that are difficult to bring down, back ends that can be scaled up with demand.

This approach would also let you have people correct the metadata of their books as background process (the "command" pattern).

@kevinbeynon Model-View-Controller is life. :) I have a tendency to use secondary processes off a message queue instead of bumping up the front ends. Mainly because it gives you more flexibility for scaling with a 2- or 3-tier environment (web, processing, DB).

@kevinbeynon JS is nice for the fancier browsers, but a fallback for the ereaders would also be good; there are some decent libraries that let you do that.

I'm not sure where the OOM is coming from, but I suspect you getting the files isn't the problem as much as trying to open it and do things; that is where a secondary process can help a lot. (It is more complicated though).

The JS helps with getting the files. Treating the two as separate tasks will make it easier.

@kevinbeynon With more modern architecture, you might have a redis cache or message broker that passed it to background processors. But the principle is the same. The web server puts it somewhere, something else does work, the web server gives a response back.

@kevinbeynon Well, for my day job, we have a tendency to get customers doing 2-3 GB files all the time. We ended up forking off a separate processing job outside of the IIS/Apache process specifically to handle it. That helped avoid some of the memory pressure but also prevented the web server from reaping the process.

@kevinbeynon Related to that, it wasn't clear. Could I upload multiple zips at the same time? Say if they were 100 MB?

@kevinbeynon I was going to see if I can resplit my zips into a smaller size; the 500 MB is choking on #7 consistently.

@kevinbeynon Still working on uploads. :)

This weekend, we went up to Madison to see my grandma. She loves seeing our two kids. It is a spirit-sucking experience, though, because of her nature and the truly sad relationship we have with my ma.

Good to see family though.

Oh I should do #authorconfession over here too.

D1
💜😨😃
💜🐱🐰
💜🌕🌞
💜🌹
💜💻🛠️💻🧵💻
💜▶️▶️▶️
💜💬🕐💬🕑💬💬💬

Mastodon is missing a few pretty emoji, I think. :(