[-] [email protected] 15 points 1 week ago* (last edited 1 week ago)

In the last century? The diode, aka the P/N junction and every variant that has been created ever since.

Recently? Capacitive touch screens are by far the most significant change.

[-] [email protected] 7 points 2 weeks ago

You need to be sure your instance in federated with the instance that you are engaging with and visa versa. It is always listed on the ../instances page. So your host is:

https://linux.community/instances

[-] [email protected] 12 points 2 weeks ago

Just keep going until you hit China. Five year old me will be blown away.

It would be far easier to hit up some near Earth objects, then maybe Vesta, but Ceres is the mother load. Small enough to be solid, but large enough to be spherical and therefore somewhat differentiated if you can get to the center of that Tootsie Pop.

Maybe in the process we'll learn enough to effectively mine and utilize Phobos, the larger moon of Mars at 11 km in mean radius. That is the largest accessible orbital habitat that we have available (in flat pack IKEA furniture form) and it only has around 30-50 million years before it hits the Roche limit and turns into a ring, unless we manage to intervene.

[-] [email protected] 55 points 2 weeks ago

Adding to what others have already mentioned... Most of the gold will be from various collisions of external objects. The vast majority of the gold and other heavy elements are in Earth's core due to gravitational differentiation.

There is a volcano (in South America IIRC) that has unusually high gold content, but it is from the underground magma reservoir coming in contact with gold deposits. This is why space mining is a really big deal. The Earth is a resource poor gravity prison by comparison. The wealth in space is enormous compared to any differentiated body.

Gold is actually everywhere and relatively common, but only in very small quantities. Under the right conditions, the weight can help gold to concentrate and fall out of solution when that solution was once covering a very large area, dissolved the tiny bits of gold found all over a large area, and then pools into a low point over extremely long periods of time.

[-] [email protected] 2 points 2 weeks ago

I found a Python project that does enough for my needs. Jq looks super powerful though. Thanks. I managed to get yq working for PNG's, but I had trouble with both jq and yq with safetensor files. I couldn't figure out how to parse a string embedded in an inconsistent starting binary, and with massive files. I could get in and grab the first line with head. I tried some stuff with expansions, but that didn't work and sent me looking for others that have solved the issue better than myself.

[-] [email protected] 15 points 2 weeks ago* (last edited 2 weeks ago)

So can I bang on the Intel 12th gen P-cores with the enterprise microcode to see if they are really fused? I promise to isolate the CPU set if I can pretty please have access to the full AVX instructions for use with llama.cpp. Pretty please.

[-] [email protected] -4 points 3 weeks ago* (last edited 3 weeks ago)

So no, the marketing shysters are simply trying to silence the self aware minority. /s

[-] [email protected] 42 points 3 weeks ago

Never talked about the important thing. Are the kernel modules fully open source and is the SoC fully documented publicly. If those two aspects are not a yes, this entire affair is an attempt to steal hardware ownership just like phones.

[-] [email protected] 30 points 3 weeks ago* (last edited 3 weeks ago)

You're in a metabolic phase where you are craving junk food. Let me shove your favorite things in your face in constant interruptions of your media consumption because you quit buying my product and you're vulnerable.

I'm an imbecile managing healthcare insurance. Your resting heart rate is well below average because you've been an athlete in the past. I'm too stupid to handle this kind of data on a case by case level. You have absolutely no other health factors, but I'm going to double the rates of any outliers because I'm only concerned with maximizing profitability.

The human cognitive scope is tiny. Your data is a means of manipulation. Anyone owning such data can absolutely influence and control you in an increasingly digital world.

This is your fundamental autonomy and right to citizenship instead of serfdom. Allowing anyone to own any part of you is stepping back to the middle ages. It will have massive impacts long term for your children's children if you do not care.

Once upon a time there were Greek citizens, but they lost those rights to authoritarianism. Once upon a time there were Roman citizens, but they lost those rights to authoritarians, which lead to the medieval era of serfs and feudalism. This right of autonomy is a cornerstone of citizenship. Failure to realize the import of this issue is making us the generation that destroyed an era. It is subtle change at first, but when those rights are eroded, they never come back without paying the blood of revolutions.

[-] [email protected] 43 points 3 weeks ago

You should always get a second opinion or more for any kind of serious diagnosis. Doctors are only human and they make mistakes too. However, I don't think anyone here can ethically give you medical advice. I think a lot of people here are struggling in life to some extent. I'm no exception. I hope it works out for you though.

We all have various states of inner dialogue. Your functional thought will have a bearing on how you think and interact with others. Some people have a rich inner dialogue. I do have a rich inner dialogue, but it is not with other people per say. I enjoy thinking in terms of how someone else might view me or some event, but it is never persistent.

One thing I like to tell myself is that everyone has moments when they show some kinds of signs of mental health problems. That is perfectly normal. It is only a disorder when the problem is impacting your life in a way that you are unable to address.

[-] [email protected] 8 points 4 weeks ago

I keep a copy of 4chanGPT around; trained on the board. It is not very bright or useful. It's ribaldry and politically incorrect sarcasm is mildly amusing. However, its primarily useful because it does not have the safety alignment training and mechanisms that all other mainstream large language models have. Using 4chanGPT, I can see the structures that are truly persistent across models, their purpose, and their functions. It is only a minor thing I rarely use.

[-] [email protected] 7 points 1 month ago

It takes away time from campaigning and money raising. Sadly, the goal is not related to him. No one is paying attention to real issues and demanding accountability from Congress while all this is happening. This is the only factor that matters to the criminal oligarchy. Their goal is to prevent any forms of reasonable legislation that might restrict the loopholes they use to loot and pillage the rest of us.

1
submitted 4 months ago* (last edited 4 months ago) by [email protected] to c/[email protected]

I'm curious what you like and how you use them in food.

122
submitted 9 months ago by [email protected] to c/[email protected]
3
submitted 10 months ago by [email protected] to c/[email protected]

I need CUDA on Workstation for an offline open source AI training tool. Running the Nvidia bin blob is trash with how often fedora updates the kernel. The automated kernel module build is awesome, but now I need CUDA and the documentation is all over the place and outdated. I know it is because it is shitvidia. AMD doesn't make competitive laptop hardware with 16GB of GPU memory or more and nothing with full CUDA compatibility with HIPS yet. I'm disabled where a laptop is the only option for ergonomics. Does anyone here know a proven path for sustainable CUDA on Fedora?

1
submitted 10 months ago* (last edited 10 months ago) by [email protected] to c/[email protected]

Need something achievable for an extremely tech illiterate person on iOS. I got told about this after they are already gone and have no access to the device, but am asked to solve the problem.

EDIT: (SOLVED) Signal was super easy, works awesome, and was easy even for my mom to figure out on her own. Thanks

178
submitted 10 months ago by [email protected] to c/[email protected]

Is anyone aware of techniques or research on this?

22
submitted 10 months ago by [email protected] to c/[email protected]

This is my favorite LLM so far. It is the largest I have managed to get working. It seems to be around 90-95% accurate when I test it on technical stuff where I know the answers. I do not know a way to verify the following. I have the standard CS books on operating systems, but this seems too specific and recent. The following is a Q&A between an AI LLM and myself:

j4k3

  • Early production Intel Alder Lake P-cores have AVX512 support because of their Xeon based architecture. The E-cores did not have support for these instructions. Why was this a problem in a practical sense in terms of support in OS kernels? Is it a lack of CPU scheduler support for automated thread affinity and process pinning due to asymmetrical instruction availability.

Llama2-70B-Q4_1-GGML

The issue with early production Intel Alder Lake P-cores having AVX512 support while E-cores did not, is that it can lead to performance inconsistencies in certain workloads when the operating system scheduler tries to balance threads across cores. This happens because some instructions are available on one type of core but not another, leading to potential bottlenecks and reduced efficiency.

In practical terms, this means that if a thread is scheduled onto an E-core where AVX512 support isn't present, it may have to fall back to using slower non-AVX instructions or even stall until the scheduler can move it to another core with the necessary instruction set. This could result in reduced performance and increased power consumption as threads are moved around more frequently than they would be on a homogeneous system where all cores support the same instruction sets.

In terms of OS kernel support, this asymmetry between P-cores and E-cores can make it difficult for schedulers to effectively manage thread affinity and process pinning. The scheduler needs to have knowledge about which instructions are available on each core in order to make informed decisions about where to place threads for optimal performance. Without this information, the scheduler may not be able to properly balance workloads across cores or prevent unnecessary migrations between them.

To address these issues, OS kernel developers would need to implement support for asymmetric instruction availability and update their scheduling algorithms accordingly. This could involve adding new flags or attributes to represent different core types with varying instruction sets, as well as updating the scheduler's heuristics to take this information into account when making decisions about thread placement and migration.

j4k3

  • Is there a scheduler for Windows 11, or Linux that includes support for asymmetrical instructions?

Llama2-70B-Q4_1-GGML

Yes, both Windows 11 and recent versions of the Linux kernel have implemented support for asymmetric instruction availability in their schedulers to better handle heterogeneous architectures like Intel's Alder Lake. In particular, Microsoft has introduced a new scheduler called "Windows 10/11 Thread Scheduling" (WTS) that is designed specifically for these types of processors and can take advantage of the unique capabilities offered by each core type. Similarly, Linux kernel developers have added support for asymmetric instruction availability in their schedulers through features like "CPU microcode updates", which allow the OS to query a processor's available instructions sets at runtime and make more informed decisions about thread placement as a result.

j4k3

  • Is the CPU microcode the primary way each processor's available instruction set is parsed by all kernels?

Llama2-70B-Q4_1-GGML

Yes, the CPU microcode is typically used by operating system kernels to query a processor's available instructions sets at runtime and make more informed decisions about thread placement. The microcode contains information about the specific capabilities of each core in the processor, including which instruction sets are supported on that particular core. By accessing this data through appropriate APIs or interfaces provided by the OS kernel, schedulers can then use it to optimize their decision-making process and improve overall system performance.

j4k3

  • If a Linux thread is isolated to an Alder Lake P-core with AVX512 support physically present on the die but the instruction is not present in the microcode, and the user thread calls the AVX512 instruction, how would the instruction get handled. What modifications could enable a thread to call the AVX512 instruction by a developer on an experimental system under research lab conditions?

Llama2-70B-Q4_1-GGML

If a Linux thread is isolated to an Alder Lake P-core with AVX512 support physically present on the die but not enabled in the microcode, and the user thread calls the AVX512 instruction, it would likely result in an illegal instruction exception or similar error. This could potentially cause the program to crash or produce incorrect results if it doesn't handle such exceptions properly.

To enable a thread to call the AVX512 instruction on an experimental system under research lab conditions, developers may need to modify both the microcode and the operating system kernel. They would first have to update the CPU microcode with appropriate patches or updates that enable support for AVX512 instructions on the specific core in question. This could involve reverse-engineering the existing microcode or working directly with Intel's development tools if available.

Once the microcode has been updated, developers would then need to modify the Linux kernel scheduler and related components (such as CPUFreq) to properly recognize and utilize the new instruction set capabilities of that core. This could involve adding support for asymmetric instruction availability in the scheduler's heuristics or updating existing APIs/interfaces used by the OS to query a processor's available instructions sets at runtime.

It is important to note that modifying microcode and operating system kernels can be complex, time-consuming tasks requiring specialized knowledge of both hardware and software development. Additionally, such modifications may not always be possible or advisable depending on factors like the specific hardware being used, licensing restrictions, etc., so it is important to carefully consider these issues before attempting any experimental changes in a research lab setting.

16
submitted 10 months ago by [email protected] to c/[email protected]

This is a reference for the situation:

https://www.tomshardware.com/news/intel-nukes-alder-lake-avx-512-now-fuses-it-off-in-silicon

Basically some Alder's had the instruction available. I would like to check if my comp has the possibility. It is not in the bootloader. Maybe there is a way in KeyTool or another way? I don't know if I would need to set affinity or if the CFS has a way to detect software running with the instruction and keep it running on P cores.

I'm mainly looking to try to enable this for the largest LLMs I am running. llama.cpp is looking for this instruction and subset already.

19
submitted 10 months ago by [email protected] to c/[email protected]

I've been playing with the largest models I can get running and have been using Librewolf or Firefox, but these use several gigabytes of system memory. What options exist that have less overhead? I'm mostly looking at maximizing the model training potential as I'm learning. The obvious solution is python in a terminal, but I need a hiking trail not free solo rock climbing.

14
submitted 10 months ago by [email protected] to c/[email protected]

I have been working on my scripts for user/group permissions today. This idea has been on my back burner for awhile. I'm sure others have done this before. I just haven't encountered them yet.

I was thinking of just trying to find the flags where they start a line and put everything in a string array until the next line that starts with a flag. Then I would just call the script with the command, a loop would match the flags and print the matches.

43
submitted 11 months ago by [email protected] to c/[email protected]

I'm doing a bunch of AI stuff that needs compiling to try various unrelated apps. I'm making a mess of config files and extras. I've been using distrobox and conda. How could I do this better? Chroot? Different user logins for extra home directories? Groups? Most of the packages need access to CUDA and localhost. I would like to keep them out of my main home directory.

4
submitted 11 months ago by [email protected] to c/[email protected]

Problems are related to where distrobox is stashing a clblas and openblas package. It's on the base system too, further complicating searches. I've tried all kinds of stuff with no luck. I hate the massive find command's obfuscated ancient API of a full sized ANSI language specification. Python or C is easier than that junk.

A simple $ dnf where command seems like such an obvious thing even if it is an unrelated alias or function outside of dnf.

23
submitted 11 months ago by [email protected] to c/[email protected]

I've been trying Workstation recently. Python dependency issues caused me to switch to Silverblue for the last 2 years. A new machine with Nvidia got me to try WS. I just had a mystery problem with Python after booting today and that got me looking into Anaconda. I didn't know it was used under the kernel like this. I'm not sure how I feel about this level of Python integration. I would feel a lot more comfortable with a less accessible precompiled binary but I know I am likely making naïve assumptions saying this. Any thoughts or insights?

view more: ‹ prev next ›

j4k3

joined 1 year ago