Kernel Builder script -- simple version

[Ed_P]

The wifi doesn't work with 5.15.1 which is why I have the kernel-firmware-20220218_c53073d-noarch-1.xzm module and prior to that I had the kernel-firmware-20211229_57d6b95-noarch-1.xzm module for the same reason. 5.16.10 doesn't support the wifi with the 20220218 firmware module and trying to test things without wifi access is next to impossible.

This devel module check is a nice upgrade. Thanks!

Happy to hear you like it. But change a -f to a -e and add a -e for better results.

Code: Select all

if [ ! -e /mnt/live/memory/images/05-devel.xzm ]; then 
    echo "05-devel.xzm needs to be active." && exit 1
fi

# Switch to root:
if [ `whoami` != root ]; then
	echo -e "Please enter root's password below: \033[1;31m"
	su -c "$0 $1 $PWD"
    exit
fi
echo -e "\033[0m"; echo -en "\033]0;kernelBuilder\a"

[fulalas]

The wifi doesn't work with 5.15.1 which is why I have the kernel-firmware-20220218_c53073d-noarch-1.xzm module and prior to that I had the kernel-firmware-20211229_57d6b95-noarch-1.xzm module for the same reason. 5.16.10 doesn't support the wifi with the 20220218 firmware module and trying to test things without wifi access is next to impossible.

I see what you mean now. Can you try to build 5.15.1 using my script? Try your wifi out of the box and if doesn't work try using the firmware module that works in your current 5.15.1. If it doesn't work, I would guess there's some wrong setting in my kernel configuration. If it works, it's probably a kernel regression and I'm afraid we can't do much about.

[beny]

hi fulalas your script work well, maybe the config that is the engine of kernel compile, for the firmware can be downloaded from the slackware current repository is strange that the intel wifi do not work Ed_P do not post the lsmod to show if the iwlwifi .ko are loaded or not.
and the ko. zst is the compression that only arch system have for his modules how is possible that is on porteus kernel,ok just for the record the Aporteus firmware package is near 780 mb .xzm is a huge one

[Ed_P]

wifi and sound are working with this config.

Code: Select all

~#  uname -a
Linux porteus.example.net 5.16.11-porteus #1 SMP PREEMPT Thu Feb 24 15:07:26 EST 2022 x86_64 11th Gen Intel(R) Core(TM) i5-1135G7 @ 2.40GHz GenuineIntel GNU/Linux

Will retry without the 20220218 firmware module but an AF run worked previously.
And here is a lsmod output beny.

Code: Select all

guest@porteus:~$ lsmod
Module                  Size  Used by
cmac                   12288  1
ccm                    16384  3
hid_sensor_hub         12288  0
intel_ishtp_hid        16384  0
snd_hda_codec_hdmi     45056  1
snd_ctl_led            16384  0
coretemp               12288  0
snd_hda_codec_realtek    98304  1
snd_hda_codec_generic    53248  1 snd_hda_codec_realtek
ledtrig_audio          12288  2 snd_ctl_led,snd_hda_codec_generic
kvm_intel             180224  0
hid_multitouch         20480  0
snd_hda_intel          28672  0
kvm                   376832  1 kvm_intel
intel_rapl_msr         12288  0
iwlmvm                233472  0
snd_intel_dspcfg       12288  1 snd_hda_intel
irqbypass              12288  1 kvm
crct10dif_pclmul       12288  1
crc32_pclmul           12288  0
mac80211              368640  1 iwlmvm
ghash_clmulni_intel    12288  0
snd_hda_codec          81920  4 snd_hda_codec_generic,snd_hda_codec_hdmi,snd_hda_intel,snd_hda_codec_realtek
aesni_intel           335872  3
snd_hda_core           45056  5 snd_hda_codec_generic,snd_hda_codec_hdmi,snd_hda_intel,snd_hda_codec,snd_hda_codec_realtek
crypto_simd            12288  1 aesni_intel
snd_hwdep              12288  1 snd_hda_codec
cryptd                 12288  2 crypto_simd,ghash_clmulni_intel
btusb                  36864  0
snd_pcm                69632  4 snd_hda_codec_hdmi,snd_hda_intel,snd_hda_codec,snd_hda_core
libarc4                12288  1 mac80211
btrtl                  12288  1 btusb
btbcm                  16384  1 btusb
intel_cstate           12288  0
input_leds             12288  0
i2c_i801               24576  0
btintel                28672  1 btusb
led_class              12288  3 snd_hda_codec_generic,input_leds,iwlmvm
i915                 1662976  23
snd_timer              24576  1 snd_pcm
bluetooth             339968  5 btrtl,btintel,btbcm,btusb
intel_ish_ipc          16384  0
iwlwifi               217088  1 iwlmvm
mei_me                 20480  0
cec                    36864  1 i915
intel_ishtp            32768  2 intel_ishtp_hid,intel_ish_ipc
mei                    57344  1 mei_me
ttm                    40960  1 i915
ecdh_generic           12288  1 bluetooth
intel_lpss_pci         24576  0
intel_lpss             12288  1 intel_lpss_pci
cfg80211              274432  3 iwlmvm,iwlwifi,mac80211
ecc                    20480  1 ecdh_generic
8250_pci               45056  0
drm_kms_helper        151552  1 i915
processor_thermal_device_pci_legacy    12288  0
8250                   24576  1 8250_pci
rfkill                 20480  4 bluetooth,cfg80211
processor_thermal_device    12288  1 processor_thermal_device_pci_legacy
8250_base              32768  2 8250,8250_pci
processor_thermal_rfim    12288  1 processor_thermal_device
processor_thermal_mbox    12288  2 processor_thermal_rfim,processor_thermal_device
processor_thermal_rapl    12288  1 processor_thermal_device
intel_rapl_common      16384  2 intel_rapl_msr,processor_thermal_rapl
syscopyarea            12288  1 drm_kms_helper
serial_mctrl_gpio      12288  2 8250,8250_base
sysfillrect            12288  1 drm_kms_helper
sysimgblt              12288  1 drm_kms_helper
serial_core            28672  3 8250,serial_mctrl_gpio,8250_base
fb_sys_fops            12288  1 drm_kms_helper
intel_soc_dts_iosf     12288  1 processor_thermal_device_pci_legacy
intel_gtt              16384  1 i915
wmi                    20480  0
i2c_hid_acpi           12288  0
i2c_hid                24576  1 i2c_hid_acpi
int3403_thermal        12288  0
int340x_thermal_zone    12288  2 int3403_thermal,processor_thermal_device
intel_hid              16384  0
sparse_keymap          12288  1 intel_hid
int3400_thermal        12288  0
acpi_thermal_rel       12288  1 int3400_thermal
acpi_pad               16384  0
ipv6                  335872  198
guest@porteus:~$ 

Code: Select all

guest@porteus:~$ lsmod | grep iwlwifi
iwlwifi               217088  1 iwlmvm
cfg80211              274432  3 iwlmvm,iwlwifi,mac80211
guest@porteus:~$ 

[fulalas]

@ed_P, it's not clear what exactly you did to make it work. You just compiled 5.16.11? Using my script?

And, yes, make sure everything works without any additional module.

I see progress

[Ed_P]

Yup, everything working and no firmware module.

Code: Select all

~#  uname -a
Linux porteus.example.net 5.16.11-porteus #1 SMP PREEMPT Thu Feb 24 15:07:26 EST 2022 x86_64 11th Gen Intel(R) Core(TM) i5-1135G7 @ 2.40GHz GenuineIntel GNU/Linux

I like your kernelBuilder fulalas.

[fulalas]

So you just built 5.16.11 using my script and nothing else?

[Ed_P]

So you just built 5.16.11 using my script and nothing else?

Well, I did use the 05-devel.xzm module, a new notebook with M.2 nvmen0 drives and 8 GB of RAM, and a booted Porteus ISO so everything was done in RAM.

Will your script work with Porteus 4 ISOs? Cause when I just tried the last Porteus Cinnamon ISO it couldn't find the Porteus 4.0 cfg file.

[fulalas]

This kernel script should work in Porteus 4, yes. I can't guarantee much though, especially if you use current devel.

When/what exactly couldn't find the cfg file?

[Ed_P]

Reply moved to Porteus-v4.0 bug reports (Post by Ed_P #87215)

[Ed_P]

The kernel.sh script fails when run in Porteus 4.0.

Code: Select all

Downloading kernel source code...
--2022-02-27 18:05:41--  https://mirrors.edge.kernel.org/pub/linux/kernel/v5.x/linux-5.16.11.tar.xz
Resolving mirrors.edge.kernel.org (mirrors.edge.kernel.org)... 2604:1380:1:3600::1, 147.75.197.195
Connecting to mirrors.edge.kernel.org (mirrors.edge.kernel.org)|2604:1380:1:3600::1|:443... connected.
ERROR: cannot verify mirrors.edge.kernel.org's certificate, issued by ‘CN=R3,O=Let's Encrypt,C=US’:
  Issued certificate has expired.
To connect to mirrors.edge.kernel.org insecurely, use `--no-check-certificate'.
Fail to download kernel source code.

Added in 4 minutes 33 seconds:
Adding "--no-check-certificate" to the wget works.

Added in 1 hour 17 minutes 43 seconds:
And after 45 minutes:

Code: Select all

Extracting kernel source code...
Copying .config file...
Downloading AUFS...
Patching AUFS...

Sun Feb 27 18:14:13 EST 2022

Building kernel (this may take up to an hour)...
Fail to build kernel.
guest@porteus:/mnt/sda6/porteus4.0/kernelBuilder$ 

There were some warnings about root space being low and to empty the trash.

[fulalas]

If you just want to use 5.16.11 in Porteus 4, I guess you can simply copy the module (and vmlinuz) built in your current. It should work.

[Ed_P]

I did try that and it didn't work which is why I'm trying to build the kernel in 4.0. My last run was from my booted ISO system on my old notebook where Porteus 4.0 ISO works. I'm thinking of doing it in AF mode and if that fails from my USB install.

Added in 4 hours 37 minutes 42 seconds:
Tried the ISO boot in AF mode. It failed after an hour, with the root space being limited again. Running it now booted from the USB drive. If this fails I will need to figure out how to add swap space to Porteus 4.0.

Added in 45 minutes 34 seconds:
That failed also after about 45 minutes.

Code: Select all

guest@porteus:/mnt/sda6/porteus4.0/kernelBuilder$ ./kernel.sh 5.16.11
Please enter root's password below: 
Password: 

Initial setup...
Downloading kernel source code...
--2022-02-28 01:00:25--  https://mirrors.edge.kernel.org/pub/linux/kernel/v5.x/linux-5.16.11.tar.xz
Resolving mirrors.edge.kernel.org (mirrors.edge.kernel.org)... 2604:1380:1:3600::1, 147.75.197.195
Connecting to mirrors.edge.kernel.org (mirrors.edge.kernel.org)|2604:1380:1:3600::1|:443... connected.
WARNING: cannot verify mirrors.edge.kernel.org's certificate, issued by ‘CN=R3,O=Let's Encrypt,C=US’:
  Issued certificate has expired.
HTTP request sent, awaiting response... 200 OK
Length: 127555284 (122M) [application/x-xz]
Saving to: ‘linux-5.16.11.tar.xz’

linux-5.16.11.tar.x 100%[===================>] 121.65M  1.03MB/s    in 80s     

2022-02-28 01:01:45 (1.51 MB/s) - ‘linux-5.16.11.tar.xz’ saved [127555284/127555284]

Extracting kernel source code...
Copying .config file...
Downloading AUFS...
Patching AUFS...

Mon Feb 28 01:02:01 Local time zone must be set--see zic manual page 2022

Building kernel (this may take up to an hour)...
Fail to build kernel.
guest@porteus:/mnt/sda6/porteus4.0/kernelBuilder$ 

The black error window

Code: Select all

Low Disk Space on "Filesystem root"

The volume "Filesystem root" has only 87.7 MB disk space remaining.

Ignore

What I'm running on the 4 GB RAM system.

Code: Select all

~#  uname -a
Linux porteus 4.16.3-porteus #1 SMP PREEMPT Sat Apr 21 12:42:52 Local time zone must be set-- x86_64 Intel(R) Core(TM) i3-6100U CPU @ 2.30GHz GenuineIntel GNU/Linux

~#  cat /etc/porteus/*
001-core.xzm:20180422
002-xorg.xzm:20180422
003-cinnamon.xzm:20180416
initrd.xz:20180311

~#  ls -l /mnt/live/memory/images
000-kernel.xzm : Apr 21 2018
001-core.xzm : Apr 22 2018
002-xorg.xzm : Apr 22 2018
003-cinnamon.xzm : Jul 15 2016
05-devel.xzm : Apr 21 2018


System Memory: 3813M
Boot device:   /mnt/sdb1
Boot device format: "vfat" 
Boot folder:   /porteus/
Boot mode:     /mnt/sdb1/porteus
OS:       Porteus-v4.0
ARCH:     x86_64
Desktop:  cinnamon
Kernel:   Linux porteus 4.16.3-porteus
Cmdline:  quiet BOOT_IMAGE=///boot/syslinux/vmlinuz nomagic base_only norootcopy

Added in 1 hour 15 minutes 32 seconds:
Another fail.

This time root space down to 19.6 MB and this after I changed line 59 to:

Code: Select all

tar xf linux-$kernelVersion.tar.xz; rm xf linux-$kernelVersion.tar.xz

to free up space.

[beny]

Ed_P to build a kernel you need 3 giga of space not ram maybe there are quote of the directory that not allow you to build it, the system that have the devel module can do all the task that you need on all the porteus version.so you have to work on a real system,but you know i can go wrong....

[Ed_P]

Thank you beny, good to know. I've never built kernels before, but whether I boot an ISO or a USB install my /tmp folder is in RAM and I build xzm modules and ISOs in my /tmp folder. But you may of pointed me to a solution to my problem. Change the script to use a harddrive folder. Thank you beny.

Added in 3 hours 45 minutes 27 seconds:
And another fail, but no root space error window.
My changes to the script: I did an edit for "/tmp" to be "/$TMP" throughout the script and I added this line:

Code: Select all

echo "Initial setup..."
TMP=/mnt/sda6/porteus4.0/kBtmp                        # tmp

Code: Select all

guest@porteus:/mnt/sda6/porteus4.0/kernelBuilder$ ./kernel.sh 5.16.11
Please enter root's password below: 
Password: 

Initial setup...
Downloading kernel source code...
--2022-02-28 13:29:28--  https://mirrors.edge.kernel.org/pub/linux/kernel/v5.x/linux-5.16.11.tar.xz
Resolving mirrors.edge.kernel.org (mirrors.edge.kernel.org)... 2604:1380:1:3600::1, 147.75.197.195
Connecting to mirrors.edge.kernel.org (mirrors.edge.kernel.org)|2604:1380:1:3600::1|:443... connected.
WARNING: cannot verify mirrors.edge.kernel.org's certificate, issued by ‘CN=R3,O=Let's Encrypt,C=US’:
  Issued certificate has expired.
HTTP request sent, awaiting response... 200 OK
Length: 127555284 (122M) [application/x-xz]
Saving to: ‘linux-5.16.11.tar.xz’

linux-5.16.11.tar.x 100%[===================>] 121.65M  2.70MB/s    in 53s     

2022-02-28 13:30:21 (2.30 MB/s) - ‘linux-5.16.11.tar.xz’ saved [127555284/127555284]

Extracting kernel source code...
Copying .config file...
Downloading AUFS...
Patching AUFS...

Mon Feb 28 13:30:55 EST 2022

Building kernel (this may take up to an hour)...
Fail to build kernel.
guest@porteus:/mnt/sda6/porteus4.0/kernelBuilder$ 

Code: Select all

guest@porteus:/mnt/sda6/porteus4.0/kBtmp$ su
Password: 
root@porteus:/mnt/sda6/porteus4.0/kBtmp# ls -rlk --color=never kernel-builder/
total 124580
-rwxrwxrwx 1 root root 127555284 Feb 23 06:21 linux-5.16.11.tar.xz*
drwxrwxrwx 1 root root      8192 Feb 28 14:25 linux-5.16.11/
drwxrwxrwx 1 root root         0 Feb 28 13:30 b/
drwxrwxrwx 1 root root      4096 Feb 28 13:30 aufs/
drwxrwxrwx 1 root root         0 Feb 28 13:30 a/
root@porteus:/mnt/sda6/porteus4.0/kBtmp# ls -rlk --color=never kernel-builder/aufs/
total 86
-rwxrwxrwx 1 root root   600 Feb 28 13:30 vfs-ino.patch*
-rwxrwxrwx 1 root root  6689 Feb 28 13:30 tmpfs-idr.patch*
drwxrwxrwx 1 root root     0 Feb 28 13:30 include/
drwxrwxrwx 1 root root     0 Feb 28 13:30 fs/
-rwxrwxrwx 1 root root  2870 Feb 28 13:30 config.mk*
-rwxrwxrwx 1 root root  8082 Feb 28 13:30 aufs5-standalone.patch*
-rwxrwxrwx 1 root root 12657 Feb 28 13:30 aufs5-mmap.patch*
-rwxrwxrwx 1 root root  7338 Feb 28 13:30 aufs5-loopback.patch*
-rwxrwxrwx 1 root root   676 Feb 28 13:30 aufs5-kbuild.patch*
-rwxrwxrwx 1 root root  8473 Feb 28 13:30 aufs5-base.patch*
lrwxrwxrwx 1 root root    86 Feb 28 13:30 README -> ./Documentation/filesystems/aufs/README*
-rwxrwxrwx 1 root root  1300 Feb 28 13:30 Makefile*
drwxrwxrwx 1 root root     0 Feb 28 13:30 Documentation/
-rwxrwxrwx 1 root root 17990 Feb 28 13:30 COPYING*
root@porteus:/mnt/sda6/porteus4.0/kBtmp# ls -rlk --color=never kernel-builder/linux-5.16.11/
total 67282
-rwxrwxrwx 1 root root   575275 Feb 28 14:25 vmlinux.symvers*
-rwxrwxrwx 1 root root 37516352 Feb 28 14:25 vmlinux.o*
-rwxrwxrwx 1 root root 30422200 Feb 28 14:25 vmlinux*
drwxrwxrwx 1 root root     4096 Feb 28 13:44 virt/
drwxrwxrwx 1 root root     4096 Feb 28 13:31 usr/
drwxrwxrwx 1 root root     4096 Feb 23 06:06 tools/
drwxrwxrwx 1 root root     8192 Feb 28 14:29 sound/
drwxrwxrwx 1 root root     4096 Feb 28 13:34 security/
drwxrwxrwx 1 root root    32768 Feb 28 13:47 scripts/
drwxrwxrwx 1 root root     4096 Feb 23 06:06 samples/
drwxrwxrwx 1 root root    12288 Feb 28 13:46 net/
-rwxrwxrwx 1 root root    75916 Feb 28 14:24 modules.order*
-rwxrwxrwx 1 root root    85119 Feb 28 14:25 modules.builtin.modinfo*
-rwxrwxrwx 1 root root    10267 Feb 28 14:25 modules.builtin*
-rwxrwxrwx 1 root root   560065 Feb 28 14:25 modules-only.symvers*
drwxrwxrwx 1 root root    49152 Feb 28 13:33 mm/
drwxrwxrwx 1 root root    98304 Feb 28 14:29 lib/
drwxrwxrwx 1 root root    45056 Feb 28 14:29 kernel/
drwxrwxrwx 1 root root     8192 Feb 28 13:33 ipc/
drwxrwxrwx 1 root root     4096 Feb 28 13:31 init/
drwxrwxrwx 1 root root     4096 Feb 28 13:31 include/
drwxrwxrwx 1 root root    49152 Feb 28 13:44 fs/
drwxrwxrwx 1 root root    28672 Feb 28 14:24 drivers/
drwxrwxrwx 1 root root   118784 Feb 28 14:28 crypto/
drwxrwxrwx 1 root root     4096 Feb 28 13:31 certs/
drwxrwxrwx 1 root root    28672 Feb 28 13:35 block/
-rwxrwxrwx 1 root root  1051590 Feb 28 13:30 aufs.patch*
drwxrwxrwx 1 root root     4096 Feb 23 06:06 arch/
-rwxrwxrwx 1 root root  4229438 Feb 28 14:25 System.map*
-rwxrwxrwx 1 root root      727 Feb 23 06:06 README*
-rwxrwxrwx 1 root root  1135340 Feb 28 14:25 Module.symvers*
-rwxrwxrwx 1 root root    65540 Feb 23 06:06 Makefile*
-rwxrwxrwx 1 root root   631769 Feb 28 13:30 MAINTAINERS*
drwxrwxrwx 1 root root        0 Feb 23 06:06 LICENSES/
-rwxrwxrwx 1 root root      555 Feb 23 06:06 Kconfig*
-rwxrwxrwx 1 root root     1327 Feb 23 06:06 Kbuild*
drwxrwxrwx 1 root root    16384 Feb 23 06:06 Documentation/
-rwxrwxrwx 1 root root   100996 Feb 23 06:06 CREDITS*
-rwxrwxrwx 1 root root      496 Feb 23 06:06 COPYING*
root@porteus:/mnt/sda6/porteus4.0/kBtmp# 
 

Looks like it ran for at least 55 minutes.

So what's the problem?