Project

General

Profile

TasksFunding » History » Version 193

Denis 'GNUtoo' Carikli, 01/31/2019 03:12 PM

1 1 Denis 'GNUtoo' Carikli
{{>toc}}
2
3 181 Denis 'GNUtoo' Carikli
h1. Funding
4 1 Denis 'GNUtoo' Carikli
5 181 Denis 'GNUtoo' Carikli
h2. Funding procedure
6
7
h3. Funding status
8 179 Denis 'GNUtoo' Carikli
9 183 Denis 'GNUtoo' Carikli
* [[Tasks_funding#"Finish porting Replicant to a newer Android version" nlnet Grant application|Finish porting Replicant to a newer Android version]]: Funding application complete, needs review, not sent yet.
10 185 Denis 'GNUtoo' Carikli
* [[Tasks_funding#"Complete libsamsung-ipc and libsamsung-ril" nlnet Grant application|Complete libsamsung-ipc and libsamsung-ril]] : Funding application WIP, has the all data
11 186 Denis 'GNUtoo' Carikli
* Graphics acceleration: Funding application WIP
12 187 Denis 'GNUtoo' Carikli
* Implement a fully-featured QMI-RIL: Lacks funding figures (how much time would it take to complete the work?), "contractor contacted at the last minute":https://aleksander.es/contact/ to hope to get some figures
13
* Finish to port the Galaxy S 3 (I9300), Galaxy Note 2 (N7100) to Mainline Linux: Lacks funding figures (how much time would it take to complete the work?), despite having the kernel status
14 84 Denis 'GNUtoo' Carikli
15
h3. Applicant criteria
16
17
* The applicants will need to already have Patches in Replicant to apply. So if you want to apply and don't have any patches in Replicant, the easiest way is just to send some useful patches.
18
* The applicants will need to be able to demonstrate that they have the required skills by showing contributions in free and open source project in similar areas.
19 93 Denis 'GNUtoo' Carikli
* The applicants will need to be able to do contract work
20
21 95 Denis 'GNUtoo' Carikli
h3. Grant application template
22 93 Denis 'GNUtoo' Carikli
23 1 Denis 'GNUtoo' Carikli
*url*: https://nlnet.nl/propose/
24 95 Denis 'GNUtoo' Carikli
*scope* : Is it per task?
25 84 Denis 'GNUtoo' Carikli
26 1 Denis 'GNUtoo' Carikli
h4. Contact information
27
28 149 Denis 'GNUtoo' Carikli
|_. Your name | Denis Carikli |
29
|_. Email address | [[PrivateContact#Email]] + our contact at the FSF |
30
|_. Phone numbers | GNUtoo's phone number |
31 108 Denis 'GNUtoo' Carikli
|_. Organisation | Replicant and the FSF |
32 149 Denis 'GNUtoo' Carikli
|_. Country | France(Denis Carikli), USA (FSF) |
33 95 Denis 'GNUtoo' Carikli
34
h4. General project information
35
36 150 Denis 'GNUtoo' Carikli
|_. Project name |  <Depend on the task>  |
37
|_. Website / wiki | <Depend on the task> |
38 151 Denis 'GNUtoo' Carikli
|_. Abstract: Can you explain the whole project and its expected outcome(s).(you have 1200 characters)
39 95 Denis 'GNUtoo' Carikli
Please be short and to the point in your answers; focus primarily on the what and how, not so much on the why.
40
Add longer descriptions as attachments (see below).
41
If English isn't your first language, don't worry - our reviewers don't care about spelling errors, only about great ideas.
42
On the up side, you can be as technical as you need to be (but you don't have to).
43 153 Denis 'GNUtoo' Carikli
Do stay concrete. | <Depend on the task> |
44 102 Denis 'GNUtoo' Carikli
|_. Have you been involved with projects or organizations relevant to this project before?
45 103 Denis 'GNUtoo' Carikli
And if so, can you tell us a bit about your contributions? | Yes: I've been involved in Replicant since the beginning both as a developer and for managing the project:
46 102 Denis 'GNUtoo' Carikli
As a developer:
47 1 Denis 'GNUtoo' Carikli
* I did most/all the initial system work and made it work for the the HTC Dream, and the Google Nexus One.
48 103 Denis 'GNUtoo' Carikli
* I also worked on porting the Goldelico GTA04, Galaxy nexus, Galaxy Tab 2 7.1 along with other Replicant developers and did various bug fixes and improvements.
49
* I am also doing code reviews for patches.
50 145 Denis 'GNUtoo' Carikli
And for managing the project I'm involved in:
51 144 Denis 'GNUtoo' Carikli
* public relations (blog post, etc)
52 103 Denis 'GNUtoo' Carikli
* fund usage decisions
53 152 Denis 'GNUtoo' Carikli
* infrastructure (system administration with other developers, etc)
54 103 Denis 'GNUtoo' Carikli
* documentation
55
* project direction and strategic decisions |
56 95 Denis 'GNUtoo' Carikli
57
h4. Requested support
58
59 154 Denis 'GNUtoo' Carikli
|_. Requested Amount (Between 5000 and 50000 Euros) | <depends on the task> |
60 137 Denis 'GNUtoo' Carikli
|_. * Explain what the requested budget will be used for? | <depends on the task> |
61
|_. * Does the project have other funding sources, both past and present? | 
62 130 Denis 'GNUtoo' Carikli
The Replicant project has about 200000 dollars at disposition:
63 96 Denis 'GNUtoo' Carikli
* The Replicant project has a donation page https://crm.fsf.org/civicrm/contribute/transact?reset=1&id=19. Part of the donations were used for buying devices and reimburse conference attendances. We have about 20000 dollars remaining from the donation.
64
* The Replicant project recently received 200000 dollars from Handshake: https://www.fsf.org/news/free-software-foundation-receives-1-million-from-handshake As the FSF takes 10% that leaves us 180000 dollars |
65
|_. Compare your own project with existing or historical efforts. | <Depend on the task?> |
66
|_. What are significant technical challenges you expect to solve during the project, if any? | <Depend on the task?> |
67 138 Denis 'GNUtoo' Carikli
68
Describe the ecosystem of the project, and how you will engage with relevant actors and promote the outcomes?
69
<pre>
70 139 Denis 'GNUtoo' Carikli
The Replicant project contributors and the FSF will supervise
71
contractors to do the work.
72 1 Denis 'GNUtoo' Carikli
73 139 Denis 'GNUtoo' Carikli
I will write a blog post to anounce that the Replicant project
74
has got some funding for this specific task, and that it is
75
looking for a contractor to work on it. This is to make sure
76
that every one has equals chances in the application process.
77 1 Denis 'GNUtoo' Carikli
78 139 Denis 'GNUtoo' Carikli
Then the most suited contractor will be selected. Only contractors
79
that already have worked on similar tasks as part of free and open
80
source software projects will be chosen. This way we can look at
81
their existing contributions and make sure that they are able to
82
do the task before engaging with them.
83
Some people already involved in the Replicant project with proven
84
contributions, me included, are already interested about doing such
85
contract work, so finding someone suitable to work on the task
86
should not be an issue.
87 142 Denis 'GNUtoo' Carikli
88
The Replicant project will also make sure that the contractor has
89
or gets the hardware required to work on the task, before starting
90
to work on it.
91 138 Denis 'GNUtoo' Carikli
</pre>
92 96 Denis 'GNUtoo' Carikli
93 95 Denis 'GNUtoo' Carikli
|_. Attachments | None |
94
95
h4. How may we handle your information
96 98 Denis 'GNUtoo' Carikli
97
|_. What should we do in the other case,
98 95 Denis 'GNUtoo' Carikli
 e.g. when your project is not immediately selected? | I allow NLnet Foundation to keep the information I submit on record, should future funding opportunities arise |
99 98 Denis 'GNUtoo' Carikli
|_. Send me a copy of this application. | check-box checked |
100 94 Denis 'GNUtoo' Carikli
|_. PGP pubkey | None (if we use Replicant contact address, we can't encrypt to it) |
101 84 Denis 'GNUtoo' Carikli
102
h3. Discussions
103
104
There is "a thread about funding on the mailing list":https://lists.osuosl.org/pipermail/replicant/2019-January/001774.html about that
105 76 Denis 'GNUtoo' Carikli
106 38 Denis 'GNUtoo' Carikli
h2. Tasks that could be funded
107 77 Denis 'GNUtoo' Carikli
108 1 Denis 'GNUtoo' Carikli
h3. Port Replicant to a newer Android version
109 113 Denis 'GNUtoo' Carikli
110
Replicant is currently based on LineageOS 13 which is based on Android 6.0.
111
It is becoming very urgent to upgrade Replicant to a newer release of Android, as Android 6.0 is not supported anymore. It would probably also make it way easier to fix the following issues:
112
* Replicant is currently lagging behind with security fixes
113
* Replicant cannot be built from a GNU/Linux distribution that follows the Free Software Distribution Guidelines
114
115
*Hardware requirements* :
116
* A computer that is able to build Replicant.
117
* A smartphone or tablet that can easily supported by the new version of Replicant and that meet Android 9 [[HardwareRequirements]].
118
119
*Expected outcomes*:
120
* Remove all proprietary components of LineageOS and make sure that Replicant follows the "Free Software Distributions Guidelines (FSDG)":https://www.gnu.org/distros/"
121
* Port all the changes needed to successfully boot without any proprietary software in Replicant
122
* Make sure that most of the security issues are fixed, and lower the attack surface if possible.
123
* Make sure that Replicant can be built on a GNU/Linux distribution that follows the "Free Software Distributions Guidelines (FSDG)":https://www.gnu.org/distros/
124
* Rebrand LineageOS as Replicant
125
126
*Funding*: We could apply to https://nlnet.nl/PET
127
128 1 Denis 'GNUtoo' Carikli
h4. Subtasks
129
130 89 Denis 'GNUtoo' Carikli
The following sub-tasks could also be worked on along with porting Replicant to a newer Android version, as it doesn't make sense to do them for older Replicant versions:
131 77 Denis 'GNUtoo' Carikli
* [[Tasks v2#Add support for devices with an upstream Linux kernel|Add support for devices with an upstream Linux kernel]]
132 80 Denis 'GNUtoo' Carikli
* [[Tasks v2#Add support for more recent smartphones|Add support for more recent smartphones]]
133 82 Denis 'GNUtoo' Carikli
* [[Tasks v2#Add support for the devices supported in Replicant 6.0 and 4.2|Add support for the devices supported in Replicant 6.0 and 4.2]]
134 113 Denis 'GNUtoo' Carikli
* [[Tasks v2#Support in-system upgrades|Support in-system upgrades]]
135 78 Denis 'GNUtoo' Carikli
136
h4. Add support for devices with an upstream Linux kernel
137 57 Denis 'GNUtoo' Carikli
138 1 Denis 'GNUtoo' Carikli
It would also be useful to support devices using kernels that are based on upstream Linux with the least amount of kernel changes possible:
139
140
Currently, Replicant uses a dedicated Hardware Abstraction Layer per device, because device manufacturers implemented non-standard kernel interfaces. However, Android works with mainline kernels and supports plug-n-play hardware nowadays, so it makes sense to have generic Hardware Abstraction Layers for the standard interfaces of the Linux kernel (ALSA, V4L2, etc).
141
142
See also the [[Upstream#Upstream-Linux|wiki page on Upstream Linux]] for more details on why using upstream kernel is beneficial, and for what devices to choose to work on this task.
143
144 89 Denis 'GNUtoo' Carikli
*Hardware requirements* :
145
In addition to the requirements for porting Replicant to a newer Android version:
146 1 Denis 'GNUtoo' Carikli
* A device that is already well supported by the Upstream kernel. That device don't need to be already supported by LineageOS or even Android.
147
148
*Difficulty*: Medium
149
150
*Requirements/Prerequisites*: Knowledge of C, some C++, the ability to understand Java, kernel interfaces knowledge
151 77 Denis 'GNUtoo' Carikli
152
*Expected outcomes*: 
153 1 Denis 'GNUtoo' Carikli
* Basic features working (graphics, touchscreen, buttons, audio, and telephony if there is a modem) for at least one device that use a kernel that is very closely based on upstream Linux with the generic HALs.
154
155
h4. Add support for more recent smartphones
156
157
The most recent smartphones that Replicant support are quite old (they were made around 2013). The goal here is to add support for more recent smartphones in Replicant.
158
159
Even if we think that it's at lot more important to support devices that are better for freedom (samsung devices usually have a nonfree bootloaders), adding supporting common (Samsung) phones and tablets is relatively easy and fast to do and could be a good way to get started in contributing to Replicant. 
160
161
It's advised to pick a device that:
162
* has an isolated modem (no shared memory between the modem and the processor running Android)
163
* meets Android 9 [[HardwareRequirements]] to still be useful when Replicant will be ported to Android 9
164
* has a modem that can easily be supported by samsung-ril and libsamsung-ipc 
165
* is or will be supported by lineageOS
166
167
Make sure to evaluate the device before starting to work on it. Some devices have been evaluated in the [[TargetsEvaluation|TargetsEvaluation wiki page]]. There is also a "forum section":https://redmine.replicant.us/projects/replicant/boards/27 for devices evaluation.
168 90 Denis 'GNUtoo' Carikli
169
*Hardware requirements*:
170 92 Denis 'GNUtoo' Carikli
In addition to the requirements for porting Replicant to a newer Android version: 
171 90 Denis 'GNUtoo' Carikli
* One or more smartphones that are already well supported by LineageOS or the AOSP project and that can easily be added in Replicant.
172 1 Denis 'GNUtoo' Carikli
173
*Difficulty*: Medium
174
175
*Expected outcomes*: 
176 78 Denis 'GNUtoo' Carikli
* Basic features working (graphics, touchscreen, buttons, audio, and telephony if there is a modem) without requiring Replicant or the user to install or ship nonfree software or firmwares.
177
178 1 Denis 'GNUtoo' Carikli
h4. Add support for the devices supported in Replicant 6.0 and 4.2
179
180
When porting Replicant to a new version, it's also a good idea to keep supporting all the devices we supported in the older versions, however this is not always possible or desirable.
181
182
In order not to require too much work, devices that were previously supported will have to meet the [[HardwareRequirements]] of the new Android version. Here many of the devices already supported by Replicant 6.0 already meet such requirements.
183
184
*Hardware requirements and dependencies*:
185
In addition to the requirements for porting Replicant to a newer Android version:
186
* The port to the new Android version needs to be complete for at least one device before starting to work on this.
187
* All the devices will need to be shipped to (or acquired by) the person working on this task before starting to work on this.
188
189
*Expected outcomes*: 
190
* For each device: evaluate if they meet the hardware requirements of the new Android version and document that in the wiki in an appropriate location  ( like [[HardwareRequirements]] for instance)
191
* For each device: basic features working (graphics, touchscreen, buttons, audio, and telephony if there is a modem) without requiring Replicant or the user to install or ship nonfree software or firmwares.
192
193
*Difficulty*: Medium
194
195
h4. Support in-system upgrades
196
197
It would be useful for a Replicant device to be able to update itself to a new version of Replicant without requiring being connected to a PC. LineageOS already supports this; we suspect that it should be possible to adapt this LineageOS functionality to Replicant.
198
199
Whenever possible, it would be useful to complete and submit some of the code written for Replicant to LineageOS.
200
201 78 Denis 'GNUtoo' Carikli
*Difficulty*: Medium
202
203
*Expected outcomes*: 
204 119 Denis 'GNUtoo' Carikli
* In-system updates working without being connected to a PC
205
206 182 Denis 'GNUtoo' Carikli
h4. "Finish porting Replicant to a newer Android version" nlnet Grant application
207 119 Denis 'GNUtoo' Carikli
208 168 Denis 'GNUtoo' Carikli
|_. Project name | Finish porting Replicant to a newer Android version |
209 192 Denis 'GNUtoo' Carikli
|_. Website / wiki | https://redmine.replicant.us/projects/replicant/wiki/Porting_Replicant_to_Android_9 |
210 125 Denis 'GNUtoo' Carikli
211
Abstract: Can you explain the whole project and its expected outcome(s).in 1200 characters
212 128 Denis 'GNUtoo' Carikli
<pre>
213 131 Denis 'GNUtoo' Carikli
Replicant is a fully free software Android distribution which
214 193 Denis 'GNUtoo' Carikli
is approved by the FSF (http://gnu.org/distros). It supports
215
several Samsung smartphones tablets which have a modem.
216 1 Denis 'GNUtoo' Carikli
217 193 Denis 'GNUtoo' Carikli
The modem can be thought as a separate computer that is dedicated
218
for interfacing with the cellular network. Nowadays Android
219
communicates with it through non-standard vendor-specific
220
protocols that are implemented by nonfree software, some of which
221
have potential backdoors:
222
www.fsf.org/blogs/community/replicant-developers-find-and-close-samsung-galaxy-backdoor
223 1 Denis 'GNUtoo' Carikli
224 193 Denis 'GNUtoo' Carikli
The "Samsung IPC" protocol is used in the modem of all the devices
225
currently supported by Replicant, and a lot of other Samsung
226
smartphones and Tablets.
227 1 Denis 'GNUtoo' Carikli
228 193 Denis 'GNUtoo' Carikli
In order to be able to use the cellular network for phone calls, SMS
229
and Internet access the Replicant project had to implement such protocols.
230
This is done in two programs:
231
- libsamsung-ipc which is the low level library that handles the protocol
232
  It has also been used by the GNU/Linux distributions through the
233
  freesmartphone.org middleware.
234
- libsamsung-ril which is the interface between libsamsung-ipc and Android.
235
  It has also be used under GNU/Linux with ofono-ril in the webos-ports
236
  project.
237 1 Denis 'GNUtoo' Carikli
238 193 Denis 'GNUtoo' Carikli
The project consists in implemeting the missing features in samsung-ril and
239
libsamsung-ipc. The unimplemented features are known and documented in the
240
RIL API, and consist in things like "start a conference call", "New SMS on
241
SIM notification", etc.
242
243
This is typically done by running the proprietary implementation and
244
understanding the data format of the data going from/to the modem
245
which is gathered either with strace or by patching the kernel, and
246
implementing the feature in libsamsung-ipc and libsamsung-ril.
247
248
If most or all the features are completed, we expect other Android
249
and GNU/Linux distributions to start using and contributing to
250
libsamsung-ipc and libsamsung-ril
251 119 Denis 'GNUtoo' Carikli
</pre> 
252
253
|_. Have you been involved with projects or organizations relevant to this project before?
254 133 Denis 'GNUtoo' Carikli
And if so, can you tell us a bit about your contributions? | SEE TEMPLATE |
255
256
|_. Requested Amount (Between 5000 and 50000 Euros) | 50000 Euros |
257 134 Denis 'GNUtoo' Carikli
|_. Does the project have other funding sources, both past and present? | SEE TEMPLATE |
258 140 Denis 'GNUtoo' Carikli
259 134 Denis 'GNUtoo' Carikli
Explain what the requested budget will be used for? 
260 188 Denis 'GNUtoo' Carikli
<pre>
261
The budget will only be used to fund this task through contract work.
262
263 190 Denis 'GNUtoo' Carikli
We think it will take something between 2 and 6 month of work
264
for one full time developer.
265
266 189 Denis 'GNUtoo' Carikli
However it is always difficult to evaluate precisely the amount of time
267 143 Denis 'GNUtoo' Carikli
that this kind of project would take as sometime it can be slown down a
268 133 Denis 'GNUtoo' Carikli
lot due to bugs needing to be fixed.
269
270
For instance, when adding support for the Nexus One to Replicant,
271 136 Denis 'GNUtoo' Carikli
a lot of time was spent dealing with display issues that didn't affect
272 155 Denis 'GNUtoo' Carikli
the upstream projects, because they relied on the GPU which required
273
nonfree software to work.
274
275
If we take the cost of a Freelance developer in the USA (75$ to 150$
276
per hour) as a basis, to enable people living in Europe and the USA
277 1 Denis 'GNUtoo' Carikli
to apply, we can fund a developer to work on it for a period that
278 169 Denis 'GNUtoo' Carikli
is mostly equivalent to something between 2 to 4 months full
279
time.
280
281
So far we have at least one person interested on working on it
282 155 Denis 'GNUtoo' Carikli
as a contractor (me), and one volunteer that wants to work on it at the
283
same time, but that cannot do it full time. We will make sure
284
that everybody has a change to apply for doing contract work.
285 169 Denis 'GNUtoo' Carikli
286
If the work is not done when the 50000 run out, and that we cannot
287 155 Denis 'GNUtoo' Carikli
make sure that it will be completed by volunteers in a time that is
288
not too long, the Replicant project will most probably use its existing
289
funds to pay for contract work to make sure that this task is completed.
290
291
The Replicant project will also take care of making sure that the
292 141 Denis 'GNUtoo' Carikli
people that will work on this task have the necessary hardware to
293 191 Denis 'GNUtoo' Carikli
do it, for instance by shipping or reimbursing the purchase of a
294
compatible smartphone with the Replicant project money.
295
296
Once we have the Samsung Galaxy SIII fully working with
297
Replicant 9, we will then add support for most the smartphones
298 171 Denis 'GNUtoo' Carikli
we currently support in Replicant, and add support for more recent
299
smartphones (the most recent one we currently support has been
300
released in 2013).
301 146 Denis 'GNUtoo' Carikli
302
We also have a some very basic documentation on the Android 9 port here:
303 148 Denis 'GNUtoo' Carikli
https://redmine.replicant.us/projects/replicant/wiki/Porting_Replicant_to_Android_9
304 1 Denis 'GNUtoo' Carikli
</pre>
305 168 Denis 'GNUtoo' Carikli
306
Compare your own project with existing or historical efforts.
307
<pre>
308
Upgrading Replicant to a new Android version usually took about 2 or 3
309 170 Denis 'GNUtoo' Carikli
months of full-time equivalent work for one person.
310
Here, we already have a device (The Galaxy SIII 4G) booting under Android 9
311
with a kernel that is closely based on upstream Linux, but a lot still needs
312 132 Denis 'GNUtoo' Carikli
to be done (modem, audio, sensors, etc) and validated. The Android 
313
architecture also changed a lot more between Android 6.0.1 and Android 9
314
than it did when we ported Replicant to newer Android versions.
315
</pre>
316 170 Denis 'GNUtoo' Carikli
317
What are significant technical challenges you expect to solve during the project, if any?
318
<pre>
319 76 Denis 'GNUtoo' Carikli
We will also need to make sure that Replicant 9 can be built with a
320
GNU/Linux distribution that is approved by the FSF. This could be
321
challenging.
322
</pre>
323
324 165 dl lud
|_. Describe the ecosystem of the project, and how you will engage with relevant actors and promote the outcomes? | SEE TEMPLATE |
325 1 Denis 'GNUtoo' Carikli
|_. Attachments | SEE TEMPLATE |
326 165 dl lud
327
h3. Graphics acceleration
328 166 dl lud
329
Currently, all supported devices on Replicant lack a free software driver for their GPU. This means that OpenGL ES (GLES) rendering must be done on the CPU (software rendering). The current approach to software rendering on Replicant 6 is based on "libAGL":https://android.googlesource.com/platform/frameworks/native/+/master/opengl, an optimized GLES 1.x implementation that uses "libpixelflinger":https://android.googlesource.com/platform/system/core/+log/master/libpixelflinger software renderer. Development on both these libraries ceased in 2013 and no work was done to support newer GLES versions.
330
The major consequences of this are that:
331 158 Denis 'GNUtoo' Carikli
* Critical applications like web browsers crash due to lack of GLES 2.x (#705). Replicant currently uses an out-dated browser that has many security flaws.
332 165 dl lud
* Replicant relies on patches to the Android framework to make things like the camera application work.
333 1 Denis 'GNUtoo' Carikli
* The rendering speed has degraded over the newer Android versions, like Android 6. Even applications that do not crash become difficult to use due to the huge rendering delays.
334 173 dl lud
335 165 dl lud
This task aims to fix all these severe issues by working in parallel with the Android 9 port and leveraging new graphics functionalities present in Android 9 like X, Y and Z. On Android 9 it should be easy to use "SwiftShader":https://swiftshader.googlesource.com/SwiftShader, Google's current software renderer that is capable of full GLES 2.x.
336 173 dl lud
337 1 Denis 'GNUtoo' Carikli
Unfortunately Android 9 doesn't have a gralloc (graphics memory allocator) library for software rendering that is compatible with hwcomposer (Hardware Composer HAL). There are patches to work around that and have a gralloc library that uses the framebuffer interface, however this has very bad consequences on performance. This is also not an approach compatible with upstream projects as they have dropped support for the framebuffer interface.
338 166 dl lud
339 165 dl lud
The major and first goal of this task is thus to write a hwcomposer compatible gralloc library that implements the full "Gralloc HAL":https://source.android.com/devices/graphics/implement#gralloc_hal and supports software rendering. If used in conjunction with SwiftShader, this new graphics' stack should enable full GLES 2.x support on Replicant, with a decent performance.
340 1 Denis 'GNUtoo' Carikli
341 162 Denis 'GNUtoo' Carikli
*Hardware requirements*: A computer that is able to build Replicant. A smartphone or tablet that is supported by Replicant to be able to test the result.
342
343 163 Denis 'GNUtoo' Carikli
*Difficulty*: Medium / Hard
344 1 Denis 'GNUtoo' Carikli
345 166 dl lud
*Requirements/Prerequisites*: Knowledge of C++, kernel interfaces knowledge or the ability to learn them
346 1 Denis 'GNUtoo' Carikli
347 165 dl lud
*Expected outcomes*:
348 1 Denis 'GNUtoo' Carikli
* hwcomposer compatible gralloc that has decent performance on software rendering
349
* Working GLES 2.x implementation
350
* Fast enough graphics
351
* F-Droid applications not crashing anymore because of GLES.
352
353 166 dl lud
h4. Subtasks
354 1 Denis 'GNUtoo' Carikli
355 166 dl lud
The following sub-tasks could also be worked on after finishing writing the gralloc:
356 1 Denis 'GNUtoo' Carikli
* [[Tasks_funding#Mainline Mesa|Mainline Mesa]]
357
* [[Tasks_funding#llvmpipe optimizations|llvmpipe optimizations]]
358
* [[Tasks_funding#Lima driver|Lima driver]]
359
360 173 dl lud
h4. Mainline Mesa
361 1 Denis 'GNUtoo' Carikli
362
Although currently maintained and used by Google, SwiftShader has several drawbacks:
363
* Only implements GLES up to 2.x. Android 9 devices are already "strongly recommended to support GLES 3.x and even Vulkan":https://source.android.com/compatibility/android-cdd.pdf. (There seems to be "ongoing work":https://swiftshader.googlesource.com/SwiftShader/+log/master to support Vulkan on SwiftShader.)
364
* It is a Google-only project, with little community support and downstream usage. If/when Google discontinues it, there's little chance anyone will pick up the maintenance work.
365
* It requires a CLA (contributor agreement) for code contributions.
366
367
The best way around this is to integrate "Mesa":https://www.mesa3d.org/intro.html into the graphics stack and use it as an alternative to SwiftShader. Mesa implements both GLES 3.x and Vulkan. It is a big community project, with hundreds of active contributors and great community support.
368
Replicant 6 already includes Mesa, albeit an old version (13.0.3), picked from Android-x86, that "has long been deprecated":https://redmine.replicant.us/issues/705#note-16. 
369
370
The goal of this sub-task is to have the current mainline Mesa running on Replicant, in order to take advantage of it's performance improvements and new features to develop all following sub-tasks ([[Tasks_funding#llvmpipe optimizations|llvmpipe optimizations]] and [[Tasks_funding#Lima driver|Lima driver]]).
371
372
*Hardware requirements*: A computer that is able to build Replicant. A smartphone or tablet that is supported by Replicant to be able to test the result.
373
374
*Difficulty*: Medium
375
376
*Requirements/Prerequisites*: Knowledge of C++, Makefiles and git. Android's graphics stack knowledge or the ability to learn them.
377
378
*Expected outcomes*:
379
* Mainline Mesa running on Replicant with one of it's software rendering drivers
380
* Working GLES 3.x implementation
381
382
h4. llvmpipe optimizations
383
384
Mesa is a highly versatile library that can be extended with device drivers to allow it to be used in different environments ranging from software emulation to complete hardware acceleration. One such driver is the "Gallium llvmpipe driver":https://www.mesa3d.org/llvmpipe.html, which is a software rasterizer that uses LLVM to do runtime code generation. It only needs a CPU to run graphics computations and thus brings full GLES support to all Replicant devices.
385
386
"llvmpipe has been integrated in Replicant 6":https://git.replicant.us/replicant/external_mesa3d/log/ but it's not activated by default yet as it is very slow. It is also not fully complete.
387
388
To fix that, llvmpipe and/or the integration of it in Replicant should be optimized. We should first start by configuring llvmpipe and/or Mesa "to not implement very expensive OpenGL operations":https://www.mesa3d.org/perf.html. If that's not sufficient, or if that breaks application compatibility, various software or hardware features ("ARM NEON":https://www.arm.com/products/processors/technologies/neon.php, hardware 2D acceleration, etc) could be used to improve the speed.
389
390
*Hardware requirements* : A computer that is able to build Replicant. A smartphone or tablet that is supported by Replicant to be able to test the result.
391
392
*Difficulty*: Medium / Hard (depending on the amount of optimizations required)
393
394
*Requirements/Prerequisites*: See with Mesa project
395
396
*Expected outcomes*: faster llvmpipe on ARM devices, able to run apps such as Fennec F-Droid (Firefox).
397
398
h4. Lima driver
399
400
"Lima":https://gitlab.freedesktop.org/lima is a free software Mesa driver for ARM Mali-4xx (Utgard) GPUs. These GPUs are present in several Replicant supported devices such as Galaxy S2, S3, S3 4G, Note and Note 2. 
401
402
Lima aims to full GLES support but it is still in development. However the "current implementation status":https://gitlab.freedesktop.org/lima/mesa/issues/39#note_79193 already allows the hardware acceleration of several tasks. GPU-based hardware acceleration is faster and less power hungry than software rendering, both by several orders of magnitude. It would allow Replicant devices to run applications with a performance close to that of non-free devices.
403
404
*Hardware requirements* : A computer that is able to build Replicant. A Replicant device with a Mali-4xx GPU that can run mainline Linux (e.g. Galaxy S3 or Note 2).
405
406
*Difficulty*: Medium
407
408 167 dl lud
*Requirements/Prerequisites*: "See with Lima project":https://gitlab.freedesktop.org/lima/web/wikis/home#build-and-install
409
410
*Expected outcomes*: Lima driver being used for GLES rendering on a supported device.
411
412
h3. Implement the missing features of Samsung-RIL
413
414
Samsung-RIL is the RIL (Radio Interface Layer) that many Replicant devices use to communicate with the modem.  It is a free, reverse-engineered replacement for the proprietary RIL that the Samsung phones ship with by default (which has been found to have backdoors).
415
416
Right now, Samsung-RIL mostly implements only the protocol features that are absolutely necessary for the phone to be operable.  As a result, many more rarely used protocol features are unimplemented, which decreases functionality compared to the proprietary RIL. You can help by implementing the missing features of Samsung-RIL.
417
418
It would also be nice to fix most the reported bugs involving samsung-ril and libsamsung-ipc that are impacting users very seriously. This includes the bugs about the SIM card not being detected, and the issue about having metallic sound quality when doing voice calls over 3G (bug #1773). It would also be nice to be able to recover from EFS (the modem filesystem) corruptions (Bug #1869).
419
420
*Hardware requirements* : A computer that is able to build Replicant. A smartphone or tablet supported by Samsung-RIL.
421
422
*Difficulty*: Medium to Hard
423
424
*Requirements/Prerequisites*: Knowledge of C.
425
426
*Expected outcomes*: Implement the missing features listed at [[Samsung-RIL]]. When all the features have been implemented, also ask usptream (LineageOS) if they want to use libsamsung-ipc and samsung-ril.
427
428
*Dependencies*: This task should be fairly independent as:
429
* [[Libsamsung-ipc]] should already be independent of the Android version (it can even run on GNU/Linux)
430
* [[Samsung-RIL]] can probably easily be adapted to newer Android version
431 184 Denis 'GNUtoo' Carikli
432 174 Denis 'GNUtoo' Carikli
*Funding*: We could apply to https://nlnet.nl/PET
433 175 Denis 'GNUtoo' Carikli
434
h4. "Complete libsamsung-ipc and libsamsung-ril" nlnet Grant application
435 174 Denis 'GNUtoo' Carikli
436
|_. Project name | Complete libsamsung-ipc and libsamsung-ril |
437
|_. Website / wiki | https://redmine.replicant.us/projects/replicant/wiki/Samsung-RIL |
438
439 176 Denis 'GNUtoo' Carikli
Abstract: Can you explain the whole project and its expected outcome(s).in 1200 characters
440
<pre>
441 1 Denis 'GNUtoo' Carikli
Replicant is a fully free software Android distribution which
442
is approved by the FSF (http://gnu.org/distros). It supports
443 176 Denis 'GNUtoo' Carikli
several Samsung smartphones tablets which have a modem.
444
445
The modem can be thought as a separate computer that is dedicated
446
for interfacing with the cellular network. Nowadays Android
447 175 Denis 'GNUtoo' Carikli
communicates with it through non-standard vendor-specific
448 174 Denis 'GNUtoo' Carikli
protocols that are implemented by nonfree software, some of which
449 176 Denis 'GNUtoo' Carikli
have potential backdoors:
450
www.fsf.org/blogs/community/replicant-developers-find-and-close-samsung-galaxy-backdoor
451
452
The "Samsung IPC" protocol is used in the modem of all the devices
453
currently supported by Replicant, and a lot of other Samsung
454
smartphones and Tablets.
455
456 175 Denis 'GNUtoo' Carikli
In order to be able to use the cellular network for phone calls, SMS
457 176 Denis 'GNUtoo' Carikli
and Internet access the Replicant project had to implement such protocols.
458
This is done in two programs:
459
- libsamsung-ipc which is the low level library that handles the protocol
460 177 Denis 'GNUtoo' Carikli
  It has also been used by the GNU/Linux distributions through the
461 175 Denis 'GNUtoo' Carikli
  freesmartphone.org middleware.
462 174 Denis 'GNUtoo' Carikli
- libsamsung-ril which is the interface between libsamsung-ipc and Android.
463
</pre>
464
465
|_. Have you been involved with projects or organizations relevant to this project before?
466
And if so, can you tell us a bit about your contributions? | SEE TEMPLATE |
467
468
|_. Requested Amount (Between 5000 and 50000 Euros) | 50000 Euros |
469
|_. Does the project have other funding sources, both past and present? | SEE TEMPLATE |
470
471
Explain what the requested budget will be used for? 
472
<pre>
473
The budget will only be used to fund this task through contract work.
474
475
However it is difficult to evaluate precisely the amount of time such work
476
will take as sometime bugs can slow down a lot that kind of work.
477
For instance, when adding support for the Nexus One to Replicant,
478
a lot of time was spent dealing with display issues that didn't affect
479
the upstream projects, because they relied on the GPU which required
480
nonfree software to work.
481
482
We think it will take something between 2 and 6 month of work
483
for one full time developer.
484
485
If we take the cost of a Freelance developer in the USA (75$ to 150$
486
per hour) as a basis, to enable people living in Europe and the USA
487
to apply, we can fund a developer to work on it for a period that
488
is mostly equivalent to something between 2 to 4 months full
489
time.
490
491
So far we have at least one person interested on working on it
492
as a contractor (me), and one volunteer that wants to work on it at the
493
same time, but that cannot do it full time. We will make sure
494
that everybody has a change to apply for doing contract work.
495
496
If the work is not done when the 50000 run out, and that we cannot
497
make sure that it will be completed by volunteers in a time that is
498
not too long, the Replicant project will most probably use its existing
499
funds to pay for contract work to make sure that this task is completed.
500
501
The Replicant project will also take care of making sure that the
502
people that will work on this task have the necessary hardware to
503
do it, for instance by shipping or reimbursing the purchase of a
504
compatible smartphone with the Replicant project money.
505
506
Once we have the Samsung Galaxy SIII working with Replicant 9,
507
we will then add support for most the smartphones we currently
508
support in Replicant, and add support for more recent smartphones
509
(the most recent one we currently support has been released in 2013).
510
511
We also have a some very basic documentation on the Android 9 port here:
512
https://redmine.replicant.us/projects/replicant/wiki/Porting_Replicant_to_Android_9
513
</pre>
514
515
Compare your own project with existing or historical efforts.
516
<pre>
517
Upgrading Replicant to a new Android version usually took about 2 or 3
518
months of full-time equivalent work for one person.
519
Here, we already have a device (The Galaxy SIII 4G) booting under Android 9
520
with a kernel that is closely based on upstream Linux, but a lot still needs
521
to be done (modem, audio, sensors, etc) and validated. The Android 
522
architecture also changed a lot more between Android 6.0.1 and Android 9
523
than it did when we ported Replicant to newer Android versions.
524
</pre>
525
526
What are significant technical challenges you expect to solve during the project, if any?
527
<pre>
528
We will also need to make sure that Replicant 9 can be built with a
529
GNU/Linux distribution that is approved by the FSF. This could be
530
challenging.
531
</pre>
532
533 167 dl lud
|_. Describe the ecosystem of the project, and how you will engage with relevant actors and promote the outcomes? | SEE TEMPLATE |
534
|_. Attachments | SEE TEMPLATE |
535
536
h3. Implement a fully-featured QMI-RIL
537
538
The LTE variants of the Samsung Galaxy S3 and Samsung Galaxy Note 2 use a different modem from the non-LTE variants that Replicant currently supports.  You can help Replicant support those modems by implementing a QMI-RIL, which performs a similar role on the LTE variants as what Samsung-RIL performs on the currently-supported non-LTE variants.  Wolfgang has done some preliminary work on this, so you'll probably be picking up where he left off.
539
540
*Hardware requirements* : A computer that is able to build Replicant. A smartphone or tablet supported by QMI-RIL like the Galaxy SIII 4G (i9305).
541
542
*Difficulty*: Hard
543
544
*Requirements/Prerequisites*: Knowledge of C.
545
546
*Expected outcomes*: A QMI-RIL that supports voice calls, SMS, and data, with as complete a protocol implementation as possible.
547
548
*Dependencies*: This task should be fairly independent as:
549
* The lower layers should already be independent of the Android version as they are used under GNU/Linux
550
* [[QMI-RIL]] can probably easily be adapted to newer Android version
551 172 Denis 'GNUtoo' Carikli
552 167 dl lud
*Funding*: We could apply to https://nlnet.nl/PET
553
554
h3. Finish to port the Galaxy S 3 (I9300), Galaxy Note 2 (N7100) to Mainline Linux
555
556
The the Galaxy S 2 (I9100), Galaxy S 3 (I9300) and Galaxy Note 2 (N7100) currently use a kernel based on a vendor fork of Linux, which poses a maintainability and security issue.  Forkbomb has done some initial work on porting these devices to use mainline Linux.  You can help by continuing this work. This would also enable these devices to use generic hardware abstraction layers (HAL) when abstractions layers are ready, and to do some research on whether the "TrustZone operating system":https://blog.fossencdi.org/u-boot-galaxys3.html can be removed from such devices.
557
558
*Hardware requirements* : A computer that is able to build Replicant. A Galaxy S 2 (I9100), Galaxy S 3 (I9300) or Galaxy Note 2 (N7100), and a serial port adapter to get the kernel boot logs.
559
560
*Difficulty*: Medium
561
562 85 Denis 'GNUtoo' Carikli
*Requirements/Prerequisites*: C programming language, driver development
563
564
*Expected outcomes*: Audio working, modem working, and Replicant or LineageOS booting with mainline Linux.
565
566
h1. Other tasks
567
568
h2. Tasks that are being defined
569
570
h3. Test infrastructure
571
572
Having an automated build and test infrastructure would be very beneficial for Replicant.
573
574
Issues:
575
* Running costs of such infrastructure have to be kept low, not to depend on continuous flow of money
576
577
h3. Documentation
578
579 63 Denis 'GNUtoo' Carikli
A lot of time is spent on the wiki documentation, and a lot of information is redundant (for instance the installation guide)
580
581
TODO:
582
* Research documentation systems
583 59 Denis 'GNUtoo' Carikli
* Research the technical knowledge required to use them
584
* Look into communities like RockBox on the benefit of non-wiki documentation
585
* Look if transitioning to non-wiki documentation would make the Replicant Project loose its contributors to the documentation
586
587
h2. Devices with 512M of RAM or less
588
589
We might want to consider Android 9 [[HardwareRequirements]] before working on that
590
591
h3. Advance the Optimus Black U-Boot and Linux mainline ports
592
593
The Optimus Black from LG is an interesting device from the perspective of freedom and privacy/security. It has the ability to run a free bootloader and uses an OMAP3 SoC that is well-documented and supported in upstream U-Boot (bootloader) and Linux (kernel). Its modem is well-isolated from the rest of the device, ensuring a sane base for privacy/security. Currently, the device-specific parts of the mainline U-Boot and Linux ports are still at an early stage, where they are functional with a very limited set of supported hardware.
594
595
Advancing the Optimus Black U-Boot and Linux mainline ports would allow using the device with free, up-to-date and maintainable software and would pave the way for support in GNU/Linux systems as well as Replicant. A list of priorities in hardware support will be defined, with the objective of tackling as many as possible.
596 1 Denis 'GNUtoo' Carikli
597 61 Denis 'GNUtoo' Carikli
*Hardware requirements* : A computer that is able to build Replicant. An Optimus Black with u-boot and modified boot pins, a serial port adapter to get the kernel boot logs.
598
599
*Difficulty*: Medium to Hard
600
601
*Requirements/Prerequisites*: C programming language, driver development
602
603
*Expected outcomes*: Improved hardware support for the Optimus Black in U-Boot and Linux
604
605
h3. Advance the Kindle Fire (first generation) U-Boot and Linux mainline ports
606
607
The Kindle Fire (first generation) from Amazon is an interesting device from the perspective of freedom and privacy/security. It has the ability to run a free bootloader and uses an OMAP4 SoC that is well-documented and supported in upstream U-Boot (bootloader) and Linux (kernel). It does not embed a modem, ensuring a sane base for privacy/security. Currently, the device-specific parts of the mainline U-Boot and Linux ports are still at an early stage, where they are functional with a very limited set of supported hardware.
608
609
Advancing the Kindle Fire (first generation) U-Boot and Linux mainline ports would allow using the device with free, up-to-date and maintainable software and would pave the way for support in GNU/Linux systems as well as Replicant. A list of priorities in hardware support will be defined, with the objective of tackling as many as possible.
610
611 62 Denis 'GNUtoo' Carikli
*Hardware requirements* : A computer that is able to build Replicant. A Kindle Fire first generation, a serial port adapter to get the kernel boot logs.
612
613
*Difficulty*: Medium
614
615
*Requirements/Prerequisites*: C programming language, driver development
616
617 67 Denis 'GNUtoo' Carikli
*Expected outcomes*: Improved hardware support for the Kindle Fire (first generation) in U-Boot and Linux
618
619
h3. Select and/or port a tablet with an Allwinner SOC to mainline Linux and U-boot, and Replicant
620
621
Tablets with Allwinner SOCs are an interesting targets because they do not use signed bootloaders and the SOCs and various devices using them have good Linux and u-boot mainline support. If not much work is required for that, once the code is merged, the candidate is also required to work on the generic abstraction layer project which is also documented in this page.
622
623
The chosen tablet should have:
624
* A SOC that has good mainline support, see "the Linux mainlining effort page on linux-sunxi":https://linux-sunxi.org/Linux_mainlining_effort for more details.
625
* A Free software bootloader, or the ability to easily add support for the tablet to a free software bootloader.
626
* The ability to power and use an USB WiFi card or chip that is compatible with the ath9k_htc driver.
627
628
It would be better if the chosen tablet doesn't use an AllWinner SOC with a PowerVR GPU, as MALI GPU have more probability to be usable with free software in the future.
629
630 56 Denis 'GNUtoo' Carikli
*Hardware requirements* : A computer that is able to build Replicant. An Allwinner tablet, a serial port adapter to get the kernel boot logs.
631 3 Denis 'GNUtoo' Carikli
632 55 Denis 'GNUtoo' Carikli
*Difficulty*: Medium
633
634 43 Denis 'GNUtoo' Carikli
*Requirements/Prerequisites*: C programming language, driver development
635
636
*Expected outcomes*: Replicant support for a tablet using an Allwinner SOC, with free software bootloader and mainline based Linux kernel.
637
638
h2. Tasks for Replicant 6.0
639
640
h3. Tackle security issues in Replicant 6.0
641
642
Replicant is plagued by various security issues, that are mostly due to using a downstream codebase. One of the most crucial issues is that Replicant uses an old version of the Android WebView (from circa 2015), which is also a functionality drawback.
643 1 Denis 'GNUtoo' Carikli
An initial evaluation of the security issues in Replicant should be conducted, followed by the integration or update of the concerned components of the system.
644 43 Denis 'GNUtoo' Carikli
645
It would also be nice to do the same for privacy issues. Since Replicant indirectly depends on the "Android Open Source Project" and directly depends on LineageOS, not all privacy issues might have been found fixed by Replicant. Once security issues have been fixed, it would be nice to try to identify as many privacy issues as possible, and in a second time to fix them.
646
647 46 Denis 'GNUtoo' Carikli
*Hardware requirements* : A computer that is able to build Replicant. A smartphone or tablet that is supported by Replicant to be able to test the result.
648
649
*Difficulty*: Medium-Hard
650
651 48 Denis 'GNUtoo' Carikli
*Requirements/Prerequisites*: Android build system, knowledge of system security, advanced git
652
653 46 Denis 'GNUtoo' Carikli
*Expected outcomes*: Integration or update of components of Replicant to tackle security issues
654
655
h3. Fix the Free software distribution guidelines issues and improve the build system in Replicant 6.0
656
657
Replicant has some issues with "FSDG (Free System Distribution Guidelines)":https://www.gnu.org/distros/free-system-distribution-guidelines.html compliance: "F-droid":https://f-droid.org/ repository is not FSDG compliant anymore (Bug #1629), and Replicant can't be built from an FSDG distribution (Bug #1861). This ought to be fixed. Replicant should also be fixed to build without issue.
658
659 47 Denis 'GNUtoo' Carikli
It would also be nice to have the build system not depend on pre-built dependencies anymore, and to document which FSDG compliant F-droid applications crash because Replicant's incomplete EGL implementation (#705) and tag such applications as incompatible (so they are greyed out) until the EGL implemetation is fixed. Ideally Replicant builds should also be made "reproducible":https://en.wikipedia.org/wiki/Deterministic_compilation if they are not already.
660 21 Denis 'GNUtoo' Carikli
661 44 Denis 'GNUtoo' Carikli
*Hardware requirements* : A computer that is able to build Replicant. A smartphone or tablet that is supported by Replicant to be able to test the result.
662 3 Denis 'GNUtoo' Carikli
663 1 Denis 'GNUtoo' Carikli
*Difficulty*: Easy
664 23 Denis 'GNUtoo' Carikli
665 36 Denis 'GNUtoo' Carikli
*Requirements/Prerequisites*: Knowledge of shell scripts and the ability to learn the Android build system
666
667 1 Denis 'GNUtoo' Carikli
*Expected outcomes*: The ability to compile Replicant from "an FSDG distribution":https://www.gnu.org/distros/free-distros.html, F-droid only showing FSDG compliant software.
668 44 Denis 'GNUtoo' Carikli
669 1 Denis 'GNUtoo' Carikli
h2. Research
670 39 Denis 'GNUtoo' Carikli
671
h3. Improve support for the free software compatible external WiFi adapter
672
673
All devices currently supported by Replicant have WiFi chips that requires a non-free firmware to work. So to have WiFi working with free software, users need to use external WiFi adapters. They typically use tiny ath9k_htc compatible USB WiFi adapter along with a tiny USB OTG Host adapter.
674
675
Such external USB WiFi adapters used with Replicant are originally intended for laptops, not phones. As a result, they tend to consume a lot of power. According to lsusb some ath9k_htc compatible devices can consume up to 500mA.
676 1 Denis 'GNUtoo' Carikli
677 50 Denis 'GNUtoo' Carikli
This poses several issues:
678
* Some smartphones and tablets might not be compatible, at the hardware level, with such big power consumption.
679
* They can adversely impact battery life
680
681
Such USB WiFi adapters can also randomly stop working completely on some devices (e.g. needing to unplug and replug the adapter periodically to keep it operational).
682 65 Denis 'GNUtoo' Carikli
683
You will need to investigate reliability issues such as the one mentioned above and look how power consumption can be improved in the adapter firmware and/or kernel driver.
684
685 66 Denis 'GNUtoo' Carikli
You will also need to investigate how much miliampers USB devices can use, at the hardware level, on the smartphones and tablets Replicant supports.
686 1 Denis 'GNUtoo' Carikli
687
*Hardware requirements* : An ath9k_htc compatible WiFi card, the ability to measure the current usage, the ability to build the ath9k_htc firmware and driver.
688
689
*Difficulty*: Medium/Hard
690
691
*Requirements/Prerequisites*: Knowledge of C
692
693
*Expected outcomes*: Reliable WiFi with external WiFi adapter