Gentoo Archives: gentoo-commits

From: Anna Vyalkova <cyber+gentoo@×××××.in>
To: gentoo-commits@l.g.o
Subject: [gentoo-commits] repo/proj/guru:dev commit in: sys-fs/dwarfs/, profiles/, sys-fs/dwarfs/files/
Date: Mon, 27 Feb 2023 21:18:04
Message-Id: 1677532103.39be7b1d4d497a0f8c6bf63f4a7e562931bf65c3.cybertailor@gentoo
1 commit: 39be7b1d4d497a0f8c6bf63f4a7e562931bf65c3
2 Author: Anna (cybertailor) Vyalkova <cyber+gentoo <AT> sysrq <DOT> in>
3 AuthorDate: Mon Feb 27 21:08:23 2023 +0000
4 Commit: Anna Vyalkova <cyber+gentoo <AT> sysrq <DOT> in>
5 CommitDate: Mon Feb 27 21:08:23 2023 +0000
6 URL: https://gitweb.gentoo.org/repo/proj/guru.git/commit/?id=39be7b1d
7
8 sys-fs/dwarfs: treeclean
9
10 Closes: https://bugs.gentoo.org/897666
11 Closes: https://bugs.gentoo.org/828004
12 Closes: https://bugs.gentoo.org/801079
13 Signed-off-by: Anna (cybertailor) Vyalkova <cyber+gentoo <AT> sysrq.in>
14
15 profiles/package.mask | 1 -
16 sys-fs/dwarfs/Manifest | 1 -
17 sys-fs/dwarfs/dwarfs-0.5.6-r3.ebuild | 100 ---------------
18 sys-fs/dwarfs/files/dwarfs-0.5.6-mutex.patch | 12 --
19 sys-fs/dwarfs/files/dwarfs-0.5.6-unbundle.patch | 161 ------------------------
20 sys-fs/dwarfs/metadata.xml | 15 ---
21 6 files changed, 290 deletions(-)
22
23 diff --git a/profiles/package.mask b/profiles/package.mask
24 index c7c4191e7..213fae069 100644
25 --- a/profiles/package.mask
26 +++ b/profiles/package.mask
27 @@ -86,7 +86,6 @@ sys-power/gwe
28 dev-cpp/fbthrift
29 dev-cpp/fizz
30 dev-cpp/wangle
31 -sys-fs/dwarfs
32
33 # Viorel Munteanu <ceamac.paragon@×××××.com> (2022-08-03)
34 # depends on dev-python/PyQt6, which is currently masked with all of qt6
35
36 diff --git a/sys-fs/dwarfs/Manifest b/sys-fs/dwarfs/Manifest
37 deleted file mode 100644
38 index 46fed586b..000000000
39 --- a/sys-fs/dwarfs/Manifest
40 +++ /dev/null
41 @@ -1 +0,0 @@
42 -DIST dwarfs-0.5.6.tar.bz2 12146379 BLAKE2B 6d570de65358238eb8207297529f7cb632533eb6e63b5c27349add978d765e462fbeeb123962695b8092c919425454e7ef7cce6b2247ca46586b9732297ee1d1 SHA512 0b57f0ca5295d9b450cb0b9fd8086a87e29f0b010f70437374043689eb009f7ce10c2b862d7da3cc5613c305486c91866abe7840eb1fb09d00cde0d46f194ef6
43
44 diff --git a/sys-fs/dwarfs/dwarfs-0.5.6-r3.ebuild b/sys-fs/dwarfs/dwarfs-0.5.6-r3.ebuild
45 deleted file mode 100644
46 index 4f22553ac..000000000
47 --- a/sys-fs/dwarfs/dwarfs-0.5.6-r3.ebuild
48 +++ /dev/null
49 @@ -1,100 +0,0 @@
50 -# Copyright 1999-2021 Gentoo Authors
51 -# Distributed under the terms of the GNU General Public License v2
52 -
53 -EAPI=7
54 -
55 -PYTHON_COMPAT=( python3_{8,9,10} )
56 -
57 -inherit check-reqs cmake flag-o-matic python-single-r1
58 -
59 -DESCRIPTION="A fast very high compression read-only FUSE file system"
60 -HOMEPAGE="https://github.com/mhx/dwarfs"
61 -SRC_URI="https://github.com/mhx/dwarfs/releases/download/v${PV}/${P}.tar.bz2"
62 -
63 -LICENSE="GPL-3"
64 -SLOT="0"
65 -KEYWORDS="~amd64"
66 -IUSE="python +jemalloc test"
67 -
68 -RDEPEND="
69 - ${PYTHON_DEPS}
70 - app-arch/libarchive
71 - app-arch/lz4
72 - app-arch/snappy
73 - app-arch/xz-utils
74 - app-arch/zstd
75 - dev-cpp/fbthrift:=
76 - >=dev-cpp/folly-2021.04.19.00-r1:=
77 - dev-cpp/gflags
78 - dev-cpp/glog[gflags]
79 - dev-cpp/parallel-hashmap:=
80 - dev-cpp/sparsehash
81 - dev-libs/boost[context,threads(+),python?]
82 - dev-libs/double-conversion
83 - dev-libs/fsst:=
84 - dev-libs/libevent
85 - dev-libs/libfmt
86 - dev-libs/xxhash
87 - sys-fs/fuse:3
88 - sys-libs/binutils-libs
89 - sys-libs/libunwind
90 - sys-libs/zlib
91 -
92 - jemalloc? ( >=dev-libs/jemalloc-5.2.1 )
93 -"
94 -DEPEND="
95 - ${RDEPEND}
96 - sys-devel/flex
97 -"
98 -BDEPEND="
99 - app-text/ronn
100 - sys-devel/bison
101 - virtual/pkgconfig
102 -
103 - test? ( dev-cpp/gtest )
104 -"
105 -
106 -DOCS=( "README.md" "CHANGES.md" "TODO" )
107 -RESTRICT="!test? ( test )"
108 -REQUIRED_USE="python? ( ${PYTHON_REQUIRED_USE} )"
109 -PATCHES=( "${FILESDIR}/${P}-unbundle.patch" "${FILESDIR}/${P}-mutex.patch" )
110 -
111 -CHECKREQS_DISK_BUILD="1300M"
112 -CMAKE_IN_SOURCE_BUILD=1
113 -CMAKE_WARN_UNUSED_CLI=0
114 -
115 -src_prepare(){
116 - rm -r fsst zstd fbthrift/* folly xxHash parallel-hashmap || die
117 - cmake_src_prepare
118 - sed "s/DESTINATION lib/DESTINATION $(get_libdir)/" -i CMakeLists.txt || die
119 -}
120 -
121 -src_configure(){
122 - append-cxxflags "-I/usr/include"
123 -
124 - mycmakeargs=(
125 - -DUSE_JEMALLOC=$(usex jemalloc ON OFF)
126 - -DWITH_PYTHON=$(usex python ON OFF)
127 - -DWITH_TESTS=$(usex test ON OFF)
128 - -DPREFER_SYSTEM_ZSTD=1
129 - -DPREFER_SYSTEM_XXHASH=1
130 - -DPREFER_SYSTEM_GTEST=1
131 - -DWITH_LEGACY_FUSE=0
132 - )
133 - use python && mycmakeargs+=( "-DWITH_PYTHON_VERSION=${EPYTHON#python}" )
134 - cmake_src_configure
135 -}
136 -
137 -src_install(){
138 - cmake_src_install
139 - dolib.so libdwarfs.so
140 -}
141 -
142 -pkg_postinst(){
143 - elog "Suggest to enable USE 'threads' globally if you have multicore machine"
144 - elog "Since version 0.4.1 GGC builds has been fixed. Now both Clang and GCC are working very well"
145 - elog "You may find more information in the"
146 - elog "${HOMEPAGE}"
147 - elog "About creating: ${HOMEPAGE}/blob/main/doc/mkdwarfs.md"
148 - elog "About mounting: ${HOMEPAGE}/blob/main/doc/dwarfs.md"
149 -}
150
151 diff --git a/sys-fs/dwarfs/files/dwarfs-0.5.6-mutex.patch b/sys-fs/dwarfs/files/dwarfs-0.5.6-mutex.patch
152 deleted file mode 100644
153 index 1a47150d3..000000000
154 --- a/sys-fs/dwarfs/files/dwarfs-0.5.6-mutex.patch
155 +++ /dev/null
156 @@ -1,12 +0,0 @@
157 -diff --git a/src/dwarfs/block_compressor.cpp b/src/dwarfs/block_compressor.cpp
158 -index 9cdcdb9..c2219c5 100644
159 ---- a/src/dwarfs/block_compressor.cpp
160 -+++ b/src/dwarfs/block_compressor.cpp
161 -@@ -26,6 +26,7 @@
162 - #include <cstring>
163 - #include <iterator>
164 - #include <memory>
165 -+#include <mutex>
166 - #include <unordered_map>
167 -
168 - #include <sys/types.h>
169
170 diff --git a/sys-fs/dwarfs/files/dwarfs-0.5.6-unbundle.patch b/sys-fs/dwarfs/files/dwarfs-0.5.6-unbundle.patch
171 deleted file mode 100644
172 index 101af0dc6..000000000
173 --- a/sys-fs/dwarfs/files/dwarfs-0.5.6-unbundle.patch
174 +++ /dev/null
175 @@ -1,161 +0,0 @@
176 ---- a/CMakeLists.txt
177 -+++ b/CMakeLists.txt
178 -@@ -151,8 +151,6 @@
179 - ON
180 - CACHE BOOL "only build thrift compiler")
181 -
182 --add_subdirectory(folly EXCLUDE_FROM_ALL)
183 --add_subdirectory(fbthrift EXCLUDE_FROM_ALL)
184 - if(NOT (ZSTD_FOUND AND PREFER_SYSTEM_ZSTD))
185 - add_subdirectory(zstd/build/cmake EXCLUDE_FROM_ALL)
186 - endif()
187 -@@ -383,23 +381,6 @@
188 -
189 - list(
190 - APPEND
191 -- FROZEN_THRIFT_SRC
192 -- ${CMAKE_CURRENT_BINARY_DIR}/thrift/lib/thrift/gen-cpp2/frozen_data.h
193 -- ${CMAKE_CURRENT_BINARY_DIR}/thrift/lib/thrift/gen-cpp2/frozen_data.cpp
194 -- ${CMAKE_CURRENT_BINARY_DIR}/thrift/lib/thrift/gen-cpp2/frozen_types.h
195 -- ${CMAKE_CURRENT_BINARY_DIR}/thrift/lib/thrift/gen-cpp2/frozen_types.tcc
196 -- ${CMAKE_CURRENT_BINARY_DIR}/thrift/lib/thrift/gen-cpp2/frozen_types.cpp
197 -- ${CMAKE_CURRENT_BINARY_DIR}/thrift/lib/thrift/gen-cpp2/frozen_types_custom_protocol.h
198 -- ${CMAKE_CURRENT_BINARY_DIR}/thrift/lib/thrift/gen-cpp2/frozen_constants.h
199 -- ${CMAKE_CURRENT_BINARY_DIR}/thrift/lib/thrift/gen-cpp2/frozen_constants.cpp
200 -- ${CMAKE_CURRENT_BINARY_DIR}/thrift/lib/thrift/gen-cpp2/frozen_metadata.h
201 -- ${CMAKE_CURRENT_BINARY_DIR}/thrift/lib/thrift/gen-cpp2/frozen_metadata.cpp
202 -- ${CMAKE_CURRENT_BINARY_DIR}/thrift/lib/thrift/gen-cpp2/frozen_visitation.h
203 -- ${CMAKE_CURRENT_BINARY_DIR}/thrift/lib/thrift/gen-cpp2/frozen_for_each_field.h
204 -- ${CMAKE_CURRENT_BINARY_DIR}/thrift/lib/thrift/gen-cpp2/frozen_visit_union.h)
205 --
206 --list(
207 -- APPEND
208 - METADATA_THRIFT_SRC
209 - ${CMAKE_CURRENT_BINARY_DIR}/thrift/dwarfs/gen-cpp2/metadata_constants.cpp
210 - ${CMAKE_CURRENT_BINARY_DIR}/thrift/dwarfs/gen-cpp2/metadata_constants.h
211 -@@ -418,35 +399,20 @@
212 - ${CMAKE_CURRENT_BINARY_DIR}/thrift/dwarfs/gen-cpp2/metadata_visitation.h)
213 -
214 - add_custom_command(
215 -- OUTPUT ${FROZEN_THRIFT_SRC}
216 -- COMMAND mkdir -p ${CMAKE_CURRENT_BINARY_DIR}/thrift/lib/thrift
217 -- COMMAND
218 -- cp ${CMAKE_CURRENT_SOURCE_DIR}/fbthrift/thrift/lib/thrift/frozen.thrift
219 -- ${CMAKE_CURRENT_BINARY_DIR}/thrift/lib/thrift/
220 -- COMMAND cd ${CMAKE_CURRENT_BINARY_DIR}/thrift/lib/thrift &&
221 -- ${CMAKE_CURRENT_BINARY_DIR}/bin/thrift1 --gen mstch_cpp2 frozen.thrift
222 -- DEPENDS ${CMAKE_CURRENT_BINARY_DIR}/bin/thrift1
223 -- ${CMAKE_CURRENT_SOURCE_DIR}/fbthrift/thrift/lib/thrift/frozen.thrift)
224 --
225 --add_custom_command(
226 - OUTPUT ${METADATA_THRIFT_SRC}
227 - COMMAND mkdir -p ${CMAKE_CURRENT_BINARY_DIR}/thrift/dwarfs
228 - COMMAND cp ${CMAKE_CURRENT_SOURCE_DIR}/thrift/metadata.thrift
229 - thrift/dwarfs/metadata.thrift
230 - COMMAND
231 - cd ${CMAKE_CURRENT_BINARY_DIR}/thrift/dwarfs &&
232 -- ${CMAKE_CURRENT_BINARY_DIR}/bin/thrift1 --gen mstch_cpp2:frozen2
233 -+ thrift1 --gen mstch_cpp2:frozen2
234 - metadata.thrift
235 -- DEPENDS ${CMAKE_CURRENT_BINARY_DIR}/bin/thrift1
236 -- ${CMAKE_CURRENT_SOURCE_DIR}/thrift/metadata.thrift)
237 -+ DEPENDS ${CMAKE_CURRENT_SOURCE_DIR}/thrift/metadata.thrift)
238 -
239 - list(
240 - APPEND
241 - INCLUDE_DIRS
242 -- ${CMAKE_CURRENT_BINARY_DIR}/folly
243 - ${CMAKE_CURRENT_BINARY_DIR}/thrift
244 -- ${CMAKE_CURRENT_SOURCE_DIR}/folly
245 -- ${CMAKE_CURRENT_SOURCE_DIR}/fbthrift
246 - ${CMAKE_CURRENT_BINARY_DIR})
247 -
248 - if(NOT (ZSTD_FOUND AND PREFER_SYSTEM_ZSTD))
249 -@@ -472,43 +438,24 @@
250 - endif()
251 -
252 - add_library(
253 -- thrift_light
254 -- ${CMAKE_CURRENT_SOURCE_DIR}/fbthrift/thrift/lib/cpp2/FieldRef.cpp
255 -- ${CMAKE_CURRENT_SOURCE_DIR}/fbthrift/thrift/lib/cpp2/protocol/CompactProtocol.cpp
256 -- ${CMAKE_CURRENT_SOURCE_DIR}/fbthrift/thrift/lib/cpp2/protocol/BinaryProtocol.cpp
257 -- ${CMAKE_CURRENT_SOURCE_DIR}/fbthrift/thrift/lib/cpp2/protocol/DebugProtocol.cpp
258 -- ${CMAKE_CURRENT_SOURCE_DIR}/fbthrift/thrift/lib/cpp2/protocol/JSONProtocolCommon.cpp
259 -- ${CMAKE_CURRENT_SOURCE_DIR}/fbthrift/thrift/lib/cpp2/protocol/JSONProtocol.cpp
260 -- ${CMAKE_CURRENT_SOURCE_DIR}/fbthrift/thrift/lib/cpp/protocol/TProtocolException.cpp
261 -- ${CMAKE_CURRENT_SOURCE_DIR}/fbthrift/thrift/lib/cpp/util/VarintUtils.cpp
262 -- ${CMAKE_CURRENT_SOURCE_DIR}/fbthrift/thrift/lib/cpp2/gen/module_types_cpp.cpp
263 -- ${CMAKE_CURRENT_SOURCE_DIR}/fbthrift/thrift/lib/cpp2/frozen/Frozen.cpp
264 -- ${CMAKE_CURRENT_SOURCE_DIR}/fbthrift/thrift/lib/cpp2/frozen/FrozenUtil.cpp
265 -- ${CMAKE_CURRENT_SOURCE_DIR}/fbthrift/thrift/lib/cpp2/frozen/schema/MemorySchema.cpp
266 -- ${CMAKE_CURRENT_BINARY_DIR}/thrift/lib/thrift/gen-cpp2/frozen_data.cpp
267 -- ${CMAKE_CURRENT_BINARY_DIR}/thrift/lib/thrift/gen-cpp2/frozen_types.cpp)
268 --
269 --set_property(TARGET thrift_light PROPERTY CXX_STANDARD 17)
270 --
271 --target_include_directories(thrift_light PRIVATE ${INCLUDE_DIRS})
272 --
273 --add_library(
274 - metadata_thrift
275 -+ STATIC
276 - ${CMAKE_CURRENT_BINARY_DIR}/thrift/dwarfs/gen-cpp2/metadata_layouts.cpp
277 - ${CMAKE_CURRENT_BINARY_DIR}/thrift/dwarfs/gen-cpp2/metadata_types.cpp
278 - ${CMAKE_CURRENT_BINARY_DIR}/thrift/dwarfs/gen-cpp2/metadata_data.cpp)
279 -
280 - set_property(TARGET metadata_thrift PROPERTY CXX_STANDARD 17)
281 --
282 -+set_property(TARGET metadata_thrift PROPERTY POSITION_INDEPENDENT_CODE ON)
283 -+set_property(TARGET metadata_thrift PROPERTY CXX_VISIBILITY_PRESET hidden)
284 -+set_property(TARGET metadata_thrift PROPERTY VISIBILITY_INLINES_HIDDEN 1)
285 - target_include_directories(metadata_thrift PRIVATE ${INCLUDE_DIRS})
286 --
287 --add_dependencies(metadata_thrift thrift_light)
288 -+target_link_libraries(metadata_thrift fmt glog folly)
289 -
290 - foreach(tgt dwarfs ${BINARY_TARGETS})
291 - target_include_directories(
292 - ${tgt} SYSTEM
293 - PRIVATE ${Boost_INCLUDE_DIRS} ${Python3_INCLUDE_DIRS} ${INCLUDE_DIRS}
294 -- ${CMAKE_CURRENT_SOURCE_DIR}/parallel-hashmap)
295 -+ )
296 -
297 - target_include_directories(${tgt} PUBLIC ${CMAKE_CURRENT_SOURCE_DIR}/include)
298 -
299 -@@ -565,23 +512,11 @@
300 - endif()
301 - endforeach()
302 -
303 --# not sure why exactly, copied from fsst/CMakeLists.txt
304 --if(CMAKE_BUILD_TYPE STREQUAL Release)
305 -- set_source_files_properties(fsst/fsst_avx512.cpp PROPERTIES COMPILE_FLAGS -O1)
306 --endif()
307 --
308 --add_library(
309 -- fsst
310 -- fsst/libfsst.cpp fsst/fsst_avx512.cpp fsst/fsst_avx512_unroll1.inc
311 -- fsst/fsst_avx512_unroll2.inc fsst/fsst_avx512_unroll3.inc
312 -- fsst/fsst_avx512_unroll4.inc)
313 --
314 --target_include_directories(dwarfs PRIVATE ${CMAKE_CURRENT_SOURCE_DIR}/fsst)
315 --
316 - target_link_libraries(
317 - dwarfs
318 -+ thriftprotocol
319 -+ thriftfrozen2
320 - metadata_thrift
321 -- thrift_light
322 - folly
323 - fsst
324 - ${Boost_LIBRARIES}
325 -@@ -612,11 +547,6 @@
326 - if(USE_JEMALLOC)
327 - target_link_libraries(${tgt} ${Jemalloc_LIBRARIES})
328 - endif()
329 -- if(DWARFS_USE_EXCEPTION_TRACER)
330 -- target_link_libraries(
331 -- ${tgt} -Wl,--whole-archive folly_exception_tracer_base
332 -- folly_exception_tracer -Wl,--no-whole-archive)
333 -- endif()
334 - endforeach()
335 -
336 - if(STATIC_BUILD_DO_NOT_USE)
337
338 diff --git a/sys-fs/dwarfs/metadata.xml b/sys-fs/dwarfs/metadata.xml
339 deleted file mode 100644
340 index a4fd5acb3..000000000
341 --- a/sys-fs/dwarfs/metadata.xml
342 +++ /dev/null
343 @@ -1,15 +0,0 @@
344 -<?xml version="1.0" encoding="UTF-8"?>
345 -<!DOCTYPE pkgmetadata SYSTEM 'http://www.gentoo.org/dtd/metadata.dtd'>
346 -<pkgmetadata>
347 - <!-- maintainer-needed -->
348 - <longdescription lang="en">
349 - DwarFS is a read-only file system with a focus on achieving very high compression ratios in particular for very redundant data.
350 - This probably doesn't sound very exciting, because if it's redundant, it should compress well. However, I found that other read-only, compressed file systems don't do a very good job at making use of this redundancy. See here for a comparison with other compressed file systems.
351 - DwarFS also doesn't compromise on speed and for my use cases I've found it to be on par with or perform better than SquashFS. For my primary use case, DwarFS compression is an order of magnitude better than SquashFS compression, it's 4 times faster to build the file system, it's typically faster to access files on DwarFS and it uses less CPU resources.
352 - Distinct features of DwarFS are:
353 - * Clustering of files by similarity using a similarity hash function. This makes it easier to exploit the redundancy across file boundaries.
354 - * Segmentation analysis across file system blocks in order to reduce the size of the uncompressed file system. This saves memory when using the compressed file system and thus potentially allows for higher cache hit rates as more data can be kept in the cache.
355 - * Highly multi-threaded implementation. Both the file system creation tool as well as the FUSE driver are able to make good use of the many cores of your system.
356 - * Optional experimental Lua support to provide custom filtering and ordering functionality.
357 - </longdescription>
358 -</pkgmetadata>