i mostly agree with you, but i just do not trust closed ai labs. sorry. and yes most western ai labs are closed (meta and google used to release open stuff, even microsoft, but they do not do it anymore). if it were some open lab, mozilla could set up their own inference with specialised tiny - mid scale models. with closed labs, i do not expect them to give them access to models to run.

please look at curl project and barrage of false security reports made. it got so bad because they do a paid bug bounty, and people would ask some llm to find bugs, llms would conjure something out of thin air, and people will post that. mozilla will now have to handle this junk.

that was really heart warming

i rarly use it, mostly to do sentiment/grammar analysis for some formal stuff/legalese. I kinda rarely use llms (1 or 2 times a month)(i just do not have a usecase). As for how good, tiny models are not good in general, but that is because they do not have enough knowledge to store info, so my use case often is purely language processing. though i have previously used it to do some work demo to generate structured data from unstructured data. basically if you provide info, they can perform well (so you can potentially build something to fetch web search results, feed into context, and use it(many such projects are available, basically something like perplexity but open)).

pretty much this. I use smolllm (a 3B param model, trained only on openly available datasets)

further clarification - ollama is a distribution of llama cpp (and it is a bit commercial in some sense). basically, in ye olde days of 2023-24 (decades in llm space as they say), llama cpp was a server/cli only thing. it would provide output in terminal (that is how i used to use it back then), or via a api (an openai compatible one, so if you used openai stuff before, you can easily swap over), and many people wanted a gui interface (a web based chat interface), so ollama back then was a wrapper around llama cpp (there were several others, but ollama was relatively main stream). then as time progressed ollama “allegedly enshittified”, while llama cpp kept getting features (a web ui, ability to swap models during run time(back then that required a separate llama-swap), etc. also llama cpp stack is a bit “lighter” (not really, they both are web tech, so as light as js can get), and first party(ish - the interface was done by community, but it is still the same git repo) so more and more local llama folk kept switching to llama cpp only setup (you could use llama cpp with ollama, but at that point, ollama was just a web ui, and not a great one, some people prefered comfyui, etc). some old timers (like me) never even tried ollama, as plain llama.cpp was sufficient for us.

as the above commenter said, you can do very fancy things with llama cpp (the best thing about llama cpp is that it works with both cpu and gpu - you can use both simulataneously, as opposed to vllm or transformers, where you almost always need gpu. this simultaneous thing is called offloading. where some of the layers are dumped in system meory as opposed to vram, hence the vram poor population used ram )(this also kinda led to ram inflation, but do not blame llama cpp for it, blame people), and you can do some of them on ollama (as ollama is wrapper around llama cpp), but that requires ollama folks to keep their fork up to date to parent, as well as expose the said features in ui.

try to use it with llama cpp if you folks are interested in runinng locall llms - https://github.com/ggml-org/llama.cpp/issues/9181

the issue is closed, but that is not because it is solved, check it out, and find link to your relevant hardware (amd or intel or something else), and see if your particular piece is available. if so, you have hope.

in case it is not, try to find first party stuff (intel vino or intel one or amd rocm stack, and use that with transformers python or see if vllm has support).

also, try to check r/localllama on the forbidden website for your particular hardware - there is likely someone who has done something with it.

i feel i am going to hell for laughing on this one (not religious in case someone starts that tangent)

well it was not just for abuse, it basically repeated what you said in a funny high pitch voice, and there were many other small little activities it could do (based on where you touch the screen, for example a pat on head was meow, click on a sofa and it sits, there was shower, and other daily things - small but funny, and kinda very special like 12-15 years ago). I do not remember hitting it, but getting it to repeat stupid noises i make.

Question for mechanical/designer folks here - what do you call the middle thing exactly. i know the side cheeks are for allen keys, but what is the middle one called. I know it is meant to be used for servicing or during emergencies, and there are diagrams on the sides of door explaing how to open, but they just say mount tool and rotate, but do not name the key (or tool) or the this mount.

certainly, for far less actually. His ogood thing is that he did this in public, so coke can not really go after him (trail would be obvious).

the pfp of person is tsuchikage or rock ninja lord (who practiced tonkai land fire air i think) from naruto, whose whole shtick was that a very old person.

upvoting because you gave alt text/captions (it is a thing i have started to do)

no problem buddy, must maintain the grind

buddy, are you doing fine? want some one to talk to?

One piece the manga is great through and through

i beg your pardon for following rudeness, but did you read the above message? I completely trust you that you tasted a mushroom and spat it, to live and tell the story to me, but what you are saying is that a certain mushroom requires a certain amount to kill a person. firstly i do not know how was that number found (as in ingestion or directly shooting it’s extract to blood). when you ingest, you do not absorb anything, and there is a potential that directly exposed will require a lesser critical dose. and beyond that - toxins do not require digestive pathways.

the number is most likely calculated by measuring the amount present in a failed organ (in a dead patient mostly) and scaling to whole body and asking from surrounding folks how much they ate, and then matching with toxin concentration in mushroom. this lethal amount is not same for direct blood stream exposure.

you possibly want to say something like - mushrooms do not have enough to kill you just from touch or chew/spit, but not will. will suggests that there is some specific reason that either mushrooms can not produce enoug toxin to kill you from touch.

I would still stand by my original statment that it is stupid to expose contact or chew/spit. I am not saying you are stupid, I hav willingly tasted/sniffed many chemicals (not safe ones), but that is more of a decision (as in for learning purposes like you did for taste or for fun(that i do mostly)). It does not make that activity safe.

sure, but was anything wrong in second paragraph?

(following comment is long, so natural guess would be that i used a llm to write it - i did not. my poor structure sentence, grammar and spellings should indicate that. So please read it - if you are uninterested, skip the middle section and jump mostly from 3rd last para).

since i clearly do not know mushrooms (or botany for that matter, i have studied biochem moostly at intro level, so that is about it), i looked up mushroom toxicity, and most websites roughly say ‘“generally safe” to touch, but don’t ingest and wash hands’. thing is, these guidelines are said for pretty much anything, since ingestion is the easiest way to go beyond our primary defense (skin). so i tried to look up mechanisms, and found the following article

https://pmc.ncbi.nlm.nih.gov/articles/PMC11333700/

so i am trying to find mechanisms of toxicity which do not specifically require digestion metabolic pathways (you have metabolic processes happening in all cells, so general oxidation and reduction do not count as ingestion specific, as that can happen from topical contact only).

gyromitrin - ‘Toxicosis can result from oral and inhalation exposure.’ so likely getting into bloodstream from lungs. further processes require hydrolysis at low ph, so not happening in blood as is. but if we consider a small amount of hydrolysis, it can still form formaldehyde on oxidation.

also

‘enzyme that is directly inhibited by gyromitrin is the pyridoxal phosphokinase. This enzyme is responsible for dietary vitamin B6 (pyridoxine) conversion into active pyridoxal 5-phosphate (Horowitz et al., 2024[53]). Moreover, in vitro and in vivo, MMH may generate hydrazones with pyridoxal-5-phosphate (Barceloux, 2008[8]). Pyridoxal-5-phosphate is a cofactor for glutamic acid decarboxylase and GABA transaminase in the gamma-aminobutyric acid (GABA) synthetic pathway, which results in decreased GABA synthesis (Barceloux, 2008[8]). MMH can directly block glutamic acid decarboxylase when given intraperitoneally to rats at a concentration of 0.8 mM/kg, resulting in a further decrease in GABA levels (Medina 1963[71]).’

so gaba (for now, just consider it something required in brain for optimal signalling)(signalling refers to neuron activation here) is disturbed. this is a direct effect, no metabolic activity required.

moving onto - ‘Orellanine is a potent nephrotoxin found in some species of the genus Cortinarius’. nephro means kidney here.

Orellanine toxic pathway is not clear, but none of the proposed methods suggest metabolic pathways, and mostly go like after ingestion of so many grams, so and so amount is found concentrated in kidneys (and since the same compund is found, it mostly got absorbed into blood from intestines, and then filtered by blood.

also ‘Orellanine disrupts LLC-PK1 cell monolayers and inhibits membrane-bound alkaline phosphatase and cytosolic lactate dehydrogenase activity’

moving to Cyclopeptides - Phallotoxins and Amatoxins.

‘Amatoxins are able to inhibit mainly the activity of the RNA polymerase II (RNAP II) and also polymerase III (RNAP III), through α-amanitin and β-amanitin (respectively) (Diaz 2018[27]), resulting in decreases in mRNA content, causing deficient protein synthesis and cell death (Garcia et al., 2015[42]) (Figure 7(Fig. 7)).’

‘α-Amanitin has been shown to act synergistically with cytokines such as tumor necrosis factor-alpha (TNF-α) and this may be the final cause of liver failure.’

then the article goes into antidotes.

point being - all the toxic things (except partly the first one, which would be much slower in one of its pathways) do not require digestive metabolic pathways, just have to reach blood, and then time and amount is key.

Should i say on stuff that I do not have knowledge about - no, mostly. my first comment was mostly written in humor, the way the parent commenter wrote. but then the asked about it in followup, and they guessed it was a joke too. but i still replied and gave a plausible reasoning for my comment, mostly because that is kinda how i like my humor (be at least partially based on reality, and then change it). could i have done a better job? sure, but I do not think i did a gross injustice. most comments that are written are not refering or citing reearch articles. I had heard of how some mushroom toxins work ( i had heard of nephro one sspecifically), so based my response on that. as to where i got that - i dont know, probably some youtube video.

And finally - can you please turn down the sass just a notch. you seemingly were unhappy with my comment (possibly a seasoned forager, or a mushroom toxicology researcher), unhappy enough to downvote both comments. and someone also agreed with you, so they likely have similar knowledge i presume. given these facts, would you like to revisit your comment, or voting. If nothing, at least respond to this comment. I think my ego is fragile enough to reply to a single line comment with 500+ words just so i can say i was write, but i do not like being wrong.

i was trying to be funny. fill redact with paralyse or kill.

I would not recommend chewing (and subsequent spitting) mostly because you do not know (of the top of your head) about the toxic dosage, and it may enter your blood (where if it enters, game over i guess). think some amount of exposed area near your gums, or micro-scissions. Same with picking, maybe you cut your nails recently and have exposed skin (blood will likely help by clottong and blocking) or while foraging, you ran next to a sharp branch or bark and have a deep scratch exposing blood. not likely stuff.

also i do not know much about mushrooms, and likely their toxic nature is completely different from stuff like ivies (poison ivy for example) where just contact on exposed skin can cause immune response (swelling, itching, etc), but maybe (possibly) some mushrooms would have some toxic thing on surface.

some of them are so toxic, just the act of touching or picking them could redact you, so you would not be able to eat it.