Change-Id: I2d2f5a6ef9c3f8929c6342d290f1e9010f97898b
Signed-off-by: Park Ju Hyung <qkrwngud825@gmail.com>
Signed-off-by: Richard Raya <rdxzv.dev@gmail.com>
Those function are frequently used in various places and declaring them inline
can reduce overheads.
Change-Id: I4c0845686f758eddeae0bd1a89ea09d551fb332f
Signed-off-by: Park Ju Hyung <qkrwngud825@gmail.com>
Signed-off-by: Richard Raya <rdxzv.dev@gmail.com>
__d_lookup_rcu() is one of the hottest functions in the kernel on
certain loads, and it is complicated by filesystems that might want to
have their own name compare function.
We can improve code generation by moving the test of DCACHE_OP_COMPARE
outside the loop, which makes the loop itself much simpler, at the cost
of some code duplication. But both cases end up being simpler, and the
"native" direct case-sensitive compare particularly so.
Change-Id: Ib45cdc9d56c950f472cf2bea34330c18926ba925
Cc: Al Viro <viro@zeniv.linux.org.uk>
Signed-off-by: Linus Torvalds <torvalds@linux-foundation.org>
Signed-off-by: Richard Raya <rdxzv.dev@gmail.com>
Merge KSU workflow into main script.
Directly use the Telegram API for posting builds.
Change-Id: Iae193d8b38f6a8d1a103708a8ca9570259c80c64
Signed-off-by: Richard Raya <rdxzv.dev@gmail.com>
This reverts commit 1695ed419ba16ae3f039ac303d5baeeaf3caf240.
Change-Id: I0c015cf9ea20dbf67de97a726871ae71c4bbd9e7
Signed-off-by: Richard Raya <rdxzv.dev@gmail.com>
This reverts commit 2a888d52929ec2345b38b12872b4b14cb7a8afe8.
Change-Id: Id477e99d72436940e812c613f10c9fe7492a596b
Signed-off-by: Richard Raya <rdxzv.dev@gmail.com>
The CPU idle loop runs with IRQs disabled, so a raw spin lock must be used
here.
Change-Id: I980a971afd44e239e34b41c6c558658b8fb95396
Signed-off-by: Sultan Alsawaf <sultan@kerneltoast.com>
Signed-off-by: Richard Raya <rdxzv.dev@gmail.com>
The CPU idle driver's hrtimers need to be able to wake CPUs up from their
C-states using a timer interrupt. This doesn't work if the hrtimers are
instead queued into soft IRQ and run from there, so make them expire in
hard IRQ.
Change-Id: I695a8ccaabe6835aa69585d57497dfe82a586bac
Signed-off-by: Sultan Alsawaf <sultan@kerneltoast.com>
Signed-off-by: Richard Raya <rdxzv.dev@gmail.com>
There is no point in stopping the scheduler tick if the expected
idle duration is shorter than the tick period length.
Change-Id: I3c23a02795066108c973ce7cbb35986becd37984
Signed-off-by: Alexander Winkowski <dereference23@outlook.com>
Signed-off-by: Richard Raya <rdxzv.dev@gmail.com>
Those never get applied here.
Change-Id: Iac3f7e3a5757c0c60b115bf4a7f6dea1dc988335
Signed-off-by: Kazuki Hashimoto <kazukih@tuta.io>
Signed-off-by: Richard Raya <rdxzv.dev@gmail.com>
For more accurate cpuidle predictions.
[Tashar02]
- Extend visibility of update_ipi_history().
Change-Id: Ie9c91965f89cbceda925bcbe6ef35941f9162d5e
Signed-off-by: Kazuki Hashimoto <kazukih@tuta.io>
Signed-off-by: Tashfin Shakeer Rhythm <tashfinshakeerrhythm@gmail.com>
Signed-off-by: Richard Raya <rdxzv.dev@gmail.com>
Change-Id: I9b790582a947da8929ec1bff54391f2bd680f023
Signed-off-by: Kazuki Hashimoto <kazukih@tuta.io>
Signed-off-by: Richard Raya <rdxzv.dev@gmail.com>
Hardcode to save a few branches in some hot paths. Values taken from
devicetree.
Change-Id: If221a88e464eac9d3416579f52be0d8178c363a8
Signed-off-by: Kazuki Hashimoto <kazukih@tuta.io>
Signed-off-by: Richard Raya <rdxzv.dev@gmail.com>
This reverts commit c980eae303b3d4f6c7ecc89c3ac6440b8935c4b0.
Change-Id: I324f1ded32ad960978ce2684bbd50f04f7f16f0d
Signed-off-by: Richard Raya <rdxzv.dev@gmail.com>
This reverts commit 5bdb5354eab9faa3e9c52e5c6d1aa2398677c499.
Change-Id: If69d0b201de8a1ae085b35734f1010f1b61a863b
Signed-off-by: Richard Raya <rdxzv.dev@gmail.com>
This reverts commit 6473578f23bcde059b568ef2d3827d599cafbea0.
Change-Id: Ia070aeeea78b6dda5488e9088adbe9d3274d289b
Signed-off-by: Richard Raya <rdxzv.dev@gmail.com>
[workflows]
- Simplify the KSU workflow
- Use default artifacts name
[build.sh]
- Implement KernelSU support
- Minor fixups and maintenance
Change-Id: Id810243e969b3ae51eb307328b6c101d4697e36f
Signed-off-by: Richard Raya <rdxzv.dev@gmail.com>
commit 3c12466b6b7bf1e56f9b32c366a3d83d87afb4de upstream.
Currently EROFS can map another compressed buffer for inplace
decompression, that was used to handle the cases that some pages of
compressed data are actually not in-place I/O.
However, like most simple LZ77 algorithms, LZ4 expects the compressed
data is arranged at the end of the decompressed buffer and it
explicitly uses memmove() to handle overlapping:
__________________________________________________________
|_ direction of decompression --> ____ |_ compressed data _|
Although EROFS arranges compressed data like this, it typically maps two
individual virtual buffers so the relative order is uncertain.
Previously, it was hardly observed since LZ4 only uses memmove() for
short overlapped literals and x86/arm64 memmove implementations seem to
completely cover it up and they don't have this issue. Juhyung reported
that EROFS data corruption can be found on a new Intel x86 processor.
After some analysis, it seems that recent x86 processors with the new
FSRM feature expose this issue with "rep movsb".
Let's strictly use the decompressed buffer for lz4 inplace
decompression for now. Later, as an useful improvement, we could try
to tie up these two buffers together in the correct order.
Reported-and-tested-by: Juhyung Park <qkrwngud825@gmail.com>
Closes: https://lore.kernel.org/r/CAD14+f2AVKf8Fa2OO1aAUdDNTDsVzzR6ctU_oJSmTyd6zSYR2Q@mail.gmail.com
Fixes: 0ffd71bcc3a0 ("staging: erofs: introduce LZ4 decompression inplace")
Fixes: 598162d05080 ("erofs: support decompress big pcluster for lz4 backend")
Cc: stable <stable@vger.kernel.org> # 5.4+
Tested-by: Yifan Zhao <zhaoyifan@sjtu.edu.cn>
Change-Id: Ib7a578283e33f0329ae2133223878ddf0738aba4
Signed-off-by: Gao Xiang <hsiangkao@linux.alibaba.com>
Link: https://lore.kernel.org/r/20231206045534.3920847-1-hsiangkao@linux.alibaba.com
Signed-off-by: Greg Kroah-Hartman <gregkh@linuxfoundation.org>
[mkbestas: Adapt for android <=5.4 kernel which contains backports that
caused various conflicts]
Signed-off-by: Michael Bestas <mkbestas@lineageos.org>
Signed-off-by: Richard Raya <rdxzv.dev@gmail.com>
Change-Id: I00388d639f7b62355550197c9033dab7a996b916
Signed-off-by: Dark-Matter7232 <me@const.eu.org>
Signed-off-by: Richard Raya <rdxzv.dev@gmail.com>
This reverts commit d7fd8e47786a2781d2100f9fec3f38b5718914f6.
Change-Id: I05439cb3b974123b47d6cbad58a2252adaa3dc0b
Signed-off-by: Richard Raya <rdxzv.dev@gmail.com>
This reverts commit a252be0a7170bef864e281851d6a885e4ebfb193.
Change-Id: I52e6256688a154cc94beb6f52a8fd509861745ae
Signed-off-by: Richard Raya <rdxzv.dev@gmail.com>
This reverts commit 84e325d9cfea60ebb192d0f2307021ac818f8df7.
Change-Id: I59da5bae06fff3ea775cdcc938ee0dc327feb45d
Signed-off-by: Richard Raya <rdxzv.dev@gmail.com>
crc32_le and __crc32c_le can be overridden - extend this to crc32_be.
Change-Id: Ia51b0f97201903ba27bd22a345b781af13ef4a53
Signed-off-by: Kevin Bracey <kevin@bracey.fi>
Signed-off-by: Herbert Xu <herbert@gondor.apana.org.au>
Signed-off-by: Jebaitedneko <Jebaitedneko@gmail.com>
Signed-off-by: Richard Raya <rdxzv.dev@gmail.com>
Casts were added in commit 8f243af42ade ("sections: fix const sections
for crc32 table") to cope with the tables not being const. They are no
longer required since commit f5e38b9284e1 ("lib: crc32: constify crc32
lookup table").
Change-Id: If601e66d4f0a753fba9c72698ba83c645409b634
Signed-off-by: Kevin Bracey <kevin@bracey.fi>
Signed-off-by: Herbert Xu <herbert@gondor.apana.org.au>
Signed-off-by: Jebaitedneko <Jebaitedneko@gmail.com>
Signed-off-by: Richard Raya <rdxzv.dev@gmail.com>
Header was defining CRCPOLY_LE/BE and CRC32C_POLY_LE but in fact all of
them are CRC-32 polynomials so use consistent naming.
Change-Id: I21da6af43ebc69dcae24f2b97652728f739a2876
Signed-off-by: Krzysztof Kozlowski <krzk@kernel.org>
Signed-off-by: Herbert Xu <herbert@gondor.apana.org.au>
Signed-off-by: Jebaitedneko <Jebaitedneko@gmail.com>
Signed-off-by: Richard Raya <rdxzv.dev@gmail.com>
Allow other drivers and parts of kernel to use the same define for
CRC32 polynomial, instead of duplicating it in many places. This code
does not bring any functional changes, except moving existing code.
Change-Id: Ibe919da197be32e1298d7b64c1602810bd3c0bb3
Signed-off-by: Krzysztof Kozlowski <krzk@kernel.org>
Signed-off-by: Herbert Xu <herbert@gondor.apana.org.au>
Signed-off-by: Jebaitedneko <Jebaitedneko@gmail.com>
Signed-off-by: Richard Raya <rdxzv.dev@gmail.com>
Change-Id: Ia61397e4e71c3251e34def8d25d06f4f0f59a2f0
Signed-off-by: Jebaitedneko <Jebaitedneko@gmail.com>
Signed-off-by: Richard Raya <rdxzv.dev@gmail.com>
It makes no sense to leave crc32_be using the generic code while we
only accelerate the little-endian ops.
Even though the big-endian form doesn't fit as smoothly into the arm64,
we can speed it up and avoid hitting the D cache.
Tested on Cortex-A53. Without acceleration:
crc32: CRC_LE_BITS = 64, CRC_BE BITS = 64
crc32: self tests passed, processed 225944 bytes in 192240 nsec
crc32c: CRC_LE_BITS = 64
crc32c: self tests passed, processed 112972 bytes in 21360 nsec
With acceleration:
crc32: CRC_LE_BITS = 64, CRC_BE BITS = 64
crc32: self tests passed, processed 225944 bytes in 53480 nsec
crc32c: CRC_LE_BITS = 64
crc32c: self tests passed, processed 112972 bytes in 21480 nsec
Change-Id: I42ec0b2416ff44de4b6537dc8275c8777ebbbc3a
Acked-by: Catalin Marinas <catalin.marinas@arm.com>
Tested-by: Ard Biesheuvel <ardb@kernel.org>
Reviewed-by: Ard Biesheuvel <ardb@kernel.org>
Signed-off-by: Kevin Bracey <kevin@bracey.fi>
Signed-off-by: Herbert Xu <herbert@gondor.apana.org.au>
Signed-off-by: Jebaitedneko <Jebaitedneko@gmail.com>
Signed-off-by: Richard Raya <rdxzv.dev@gmail.com>
* Currently most of the assembly files that use architecture
extensions enable them using the .arch directive but crc32.S
uses .cpu instead. Move that over to .arch for consistency.
Link: https://lore.kernel.org/r/20200414182843.31664-1-broonie@kernel.org
Change-Id: I675cbbe78927b1465d12e550d6ae688d5bce601e
Signed-off-by: Richard Raya <rdxzv.dev@gmail.com>
* Add a CRC32 feature bit and wire it up to the CPU id register so we
will be able to use alternatives patching for CRC32 operations.
Change-Id: Iae808f77016c242c74475f75a85190465088c6f8
Signed-off-by: Richard Raya <rdxzv.dev@gmail.com>
Remove the code for fair tag sharing because it significantly hurts
performance for UFS devices. Removing this code is safe because the
legacy block layer worked fine without any equivalent fairness
algorithm.
This algorithm hurts performance for UFS devices because UFS devices
have multiple logical units. One of these logical units (WLUN) is used
to submit control commands, e.g. START STOP UNIT. If any request is
submitted to the WLUN, the queue depth is reduced from 31 to 15 or
lower for data LUNs.
See also https://lore.kernel.org/linux-scsi/20221229030645.11558-1-ed.tsai@mediatek.com/
Bug: 281845090
Change-Id: Ia6d75917d533f32fffc68348b52fd3d972c9074c
Link: https://lore.kernel.org/linux-block/20230103195337.158625-1-bvanassche@acm.org/
Cc: Christoph Hellwig <hch@lst.de>
Cc: Martin K. Petersen <martin.petersen@oracle.com>
Cc: Ming Lei <ming.lei@redhat.com>
Cc: Keith Busch <kbusch@kernel.org>
Cc: Damien Le Moal <damien.lemoal@opensource.wdc.com>
Cc: Ed Tsai <ed.tsai@mediatek.com>
Signed-off-by: Bart Van Assche <bvanassche@acm.org>
Signed-off-by: Richard Raya <rdxzv.dev@gmail.com>
Switch an accidental use of DEFINE_PER_CPU when
the developer clearly wanted to use DECLARE_PER_CPU.
CONFIG_DEBUG_FORCE_WEAK_CPU enforces that each per-cpu object
in the kernel have a unique name so if one accidently uses
DEFINE_PER_CPU_READ_MOSTLY in a header it would define the same
symbol in each file that used the header.
Fixes: 0aaf4cf7415a ("drivers: soc: qcom: snapshot of idle/sleep driver as of msm-4.14")
Change-Id: Ic0dedbadbce4e85f2130ea59c84d1e10767d50d7
Signed-off-by: Jordan Crouse <jcrouse@codeaurora.org>
Signed-off-by: Richard Raya <rdxzv.dev@gmail.com>
Change-Id: I59f83fb9f2f13f246a57b771a410aeaf7392e6df
Signed-off-by: Samuel Pascua <pascua.samuel.14@gmail.com>
Signed-off-by: Richard Raya <rdxzv.dev@gmail.com>
A minor optimization to reduce IPIs.
Change-Id: Ifd6c94ad5cac9dc3646547818506ce47f2b0ff6a
Signed-off-by: Alexander Winkowski <dereference23@outlook.com>
Signed-off-by: Richard Raya <rdxzv.dev@gmail.com>
