From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from lists.gentoo.org (pigeon.gentoo.org [208.92.234.80]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by finch.gentoo.org (Postfix) with ESMTPS id 5669D138359 for ; Sun, 12 Jul 2020 15:43:22 +0000 (UTC) Received: from pigeon.gentoo.org (localhost [127.0.0.1]) by pigeon.gentoo.org (Postfix) with SMTP id 66160E0391; Sun, 12 Jul 2020 15:43:21 +0000 (UTC) Received: from mail-wr1-x433.google.com (mail-wr1-x433.google.com [IPv6:2a00:1450:4864:20::433]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by pigeon.gentoo.org (Postfix) with ESMTPS id 51C90E0391 for ; Sun, 12 Jul 2020 15:43:21 +0000 (UTC) Received: by mail-wr1-x433.google.com with SMTP id r12so10507050wrj.13 for ; Sun, 12 Jul 2020 08:43:21 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=Aah8vOTpMeXvb5QrcBWrlHEurE15AazJ/aZ60Zqv3G0=; b=k+hjVWmeBTO63BUxar8HHkcPOgBHbke54bMeaeG3UmSkA8dRkOW60g5bN/W+g5tcSN eVE0kl75hn7ZdPnbUuEmflXjLSGpseWi38xal4M5Kj664Xhmoy8COjtx3MeOMKBbALUz w8y5NVqTY+sH4nI5U9QpmKONpbFj3isZz9I86yqI8bKg7r2bAwuWWKGd6mPrwUmgNoY8 w+iwkMcuqwsITz2mRNnnazxYTpPD9azhh2FpOGOLRpBXw6+dyJHvxHCjVCRqMqd0q4o2 /iMiYS0ljbeCe3YNMpAHEq0ky9pkN0IyCddzjtHFnC9+qHt4iFPe1u9HxCxu+HFfAGmL tv8Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=Aah8vOTpMeXvb5QrcBWrlHEurE15AazJ/aZ60Zqv3G0=; b=W+23zcxfePwvHjXzLpfrjmJatqBYNpAgtqrly+G7utF384CZFNYWOzquzGulYj7/25 AzxNNxpeVqfFLFT+vTN01XGcabTIvCCZjGd1d4jKNARIITRpV1wgae08xs3/om8xoYnM 53NEYuDlFwF8OE/ca6GidrLRXs0+7sUz3zk56iLlI4xBG6l1La07gnz98whwxZTxasSn Zl2BZfTubdDbqV1VsuqF7qtmHeqEak1PQBDPmrF5ofwRY8aOgfw5a3Nv8gZaoBBMLatc 1rn5KAjNftWUleI/nPsDt8EfCaL/5KJ8meZ6U3DWZWC4S7ZXd+8QA4cb7omUVaQaaNk8 sTCQ== X-Gm-Message-State: AOAM533bNQQaPgdeLMNHRKgJOXCAm/wXErL7vNrXAnhDsQGZuQ+M/UkA iLeqQ/qlx6nsRA8cQDyxGfOK8Gd1uct281wWvEt0kYlmhf0= X-Google-Smtp-Source: ABdhPJwDty9472DvnEnH8uPjxrdc/+nCTTvsLqu5WrTb1V2uHZz4OQ0oAC9IH5WxGJSF29zXR9aibknNaXjC46QxGX0= X-Received: by 2002:a5d:540d:: with SMTP id g13mr70861500wrv.380.1594568599556; Sun, 12 Jul 2020 08:43:19 -0700 (PDT) Precedence: bulk List-Post: List-Help: List-Unsubscribe: List-Subscribe: List-Id: Gentoo Linux mail X-BeenThere: gentoo-soc@lists.gentoo.org Reply-to: gentoo-soc@lists.gentoo.org X-Auto-Response-Suppress: DR, RN, NRN, OOF, AutoReply MIME-Version: 1.0 From: Zhang Zongyu Date: Sun, 12 Jul 2020 23:42:00 +0800 Message-ID: Subject: [gentoo-soc] Weekly Report: Big Data Infrastructure and Maven Overlay in Week 6 To: gentoo-soc@lists.gentoo.org Content-Type: text/plain; charset="UTF-8" X-Archives-Salt: f886437d-02e9-40a6-b841-e8c15178b0ac X-Archives-Hash: 3978f7900b0673c85ce3c64b47f7d44a Hello, This week I have made java-ebuilder accept "--binjar-uri" switch, which will help us avoid circular deps. Also, It is helpful if we want to compare the locally compiled jars and Maven Central distributed jars. [1] I have also patched java-pkg-simple to skip compiling source files if USE="binary" is set. One big progress is that I have managed to install "org.apache.spark:spark-core_2.12:3.0.0-preview2". [2] Most of the packages are compiled natively, while a few packages are Maven Central distributed binary jars. The reason why I have to install binaries varies. Here are the main reasons: 1. Maven central only distributes binary jars (even those jars are named with a "sources" suffix). I will fix the problem by changing the SRC_URI of a proper source code file next week. 2. The source code files are not written in Java. Some Jars contain Ruby, Scala, Kotlin, or Lombok codes. [3] Maybe we should discuss how to emerge those packages next week. There are also other issues: 1. Netty is implemented by org.glassfish and com.sun, but they ended up using the same artifactId. They now share the same package name. I will rename them next week. 2. packages of javax.* and jakarta.*: I believe they should be merged into java-virtuals/. Next week, I will improve the quality of the overlay and submit some up-to-date ebuild files. The most urgent package should be netty-tcnative, because openssl has changed a lot during these years and the current package cannot be compiled now. Regards, Zhang Zongyu [1] java-ebuilder https://github.com/6-6-6/java-ebuilder [2] the overlay https://github.com/6-6-6/spark-overlay [3] an example artifact that contains Kotlin source codes https://repo1.maven.org/maven2/com/squareup/okio/okio/2.6.0/okio-2.6.0-sources.jar