What Debian Does For Me

Post Syndicated from Bradley M. Kuhn original http://ebb.org/bkuhn/blog/2018/12/15/what-debian-does.html

I woke up early this morning, and those of you live above 45° parallel
north or so are used to the “I’m wide awake but it’s still dark as
night” feeling in the winter. I usually don’t turn on the lights,
wander into my office, and just bring my computer out of hibernate; that
takes a bit as my 100% Free-Software-only computer is old and slow, so I
usually go to make coffee while that happens.

As I came back in my office this morning I was a bit struck by both
displays with the huge Debian screen lock image, and it got me thinking of
how Debian has been my companion for so many years.
I spoke about this at
DebConf
15
a bit, and wrote
about a similar concept years before
. I realize that it’s been almost
nine years that I’ve been thinking rather deeply about my personal
relationship with Debian and why it matters.

This morning, I was inspired to post this because, echoing back to my
thoughts at my DebConf 15 talk, that I can’t actually do the work I do
without Debian. I thought this morning about a few simple things that
Debian gets done for me that are essential:

  • Licensing assurance. I really can trust that Debian will not put
    something in main that fails to respect my software
    freedom. Given my lifelong work on Free Software licensing, yes, I can
    vet a codebase to search for hidden proprietary software among the Free,
    but it’s so convenient to have another group of people gladly do that job
    for me and other users.
  • Curated and configured software, with connection to the
    expert
    . Some days it seems none of the new generation of
    developers are a fan of software packaging anymore. Anytime you want to
    run something new these days, someone is trying to convince you to
    download some docker image or something like that. It’s not that I don’t
    see the value in that, but what I usually want is that software I just
    read about installed on my machine as quickly as possible. Debian’s
    repository is huge, and the setup of Debian as a project allows for each
    package maintainer to work in relative independence to make the software
    of their interest run correctly as part of the whole. For the user, that
    means when I hear about some interesting software, Debian immediately
    connects me, via apt, with the individual expert who knows about that
    software
    and my operating system /
    distribution
    both. Apt, Debian’s Bug Tracker, etc. are actually a
    rudimentary but very usable form of a social networking that allows me to
    find the person who did the job to get this software actually working on
    my system. That’s a professional community that’s amazing
  • Stability. It’s rather amusing, All the Debian
    developers I know run testing on their laptop and stable only on their
    servers. I run stable on my laptop. I have a hectic schedule and always
    lots of work to do that, sadly, does not usually include “making my
    personal infrastructure setup do new things”. While I enjoy that
    sort of work, it’s a rabbit hole that I rarely have the luxury to enter.
    Running Debian stable on my laptop means I am (almost) never surprised by
    any behavior of my equipment. In the last nine years, if my computer does
    something weird, it’s basically always a hardware problem.

Sure, maybe you can get the last two mostly with other
distributions, but I don’t think you can get the first one anywhere
better. Anyway, I’ve gotta get to work for the day, but those of you out
there that make Debian happen, perhaps you’ll see a bit of a thank you from
me today. While I’ve thanked you all before, I think that no one does it
enough.

Vespa Product Updates, December 2018 – ONNX Import and Map Attribute Grouping

Post Syndicated from amberwilsonla-blog original https://yahooeng.tumblr.com/post/181089393751

yahoodevelopers:

Today we’re kicking off a blog post series of need-to-know updates on Vespa, summarizing the features and fixes detailed in Github issues.

We welcome your contributions and feedback about any new features or improvements you’d like to see.

For December, we’re excited to share the following product news:

Streaming Search Performance Improvement

Streaming Search is a solution for applications where each query only searches a small, statically determined subset of the corpus. In this case, Vespa searches without building reverse indexes, reducing storage cost and making writes more efficient. With the latest changes, the document type is used to further limit data scanning, resulting in lower latencies and higher throughput. Read more here.

ONNX Integration

ONNX is an open ecosystem for interchangeable AI models. Vespa now supports importing models in the ONNX format and transforming the models into Tensors for use in ranking. This adds to the TensorFlow import included earlier this year and allows Vespa to support many training tools. While Vespa’s strength is real-time model evaluation over large datasets, to get started using single data points, try the stateless model evaluation API. Explore this integration more in Ranking with ONNX models.

Precise Transaction Log Pruning

Vespa is built for large applications running continuous integration and deployment. This means nodes restart often for software upgrades, and node restart time matters. A common pattern is serving while restarting hosts one by one. Vespa has optimized transaction log pruning with prepareRestart, due to flushing as much as possible before stopping, which is quicker than replaying the same data after restarting. This feature is on by default. Learn more in live upgrade and prepareRestart.

Grouping on Maps

Grouping is used to implement faceting. Vespa has added support to group using map attribute fields, creating a group for values whose keys match the specified key, or field values referenced by the key. This support is useful to create indirections and relations in data and is great for use cases with structured data like e-commerce. Leverage key values instead of field names to simplify the search definition. Read more in Grouping on Map Attributes.

Questions or suggestions? Send us a tweet or an email.

A New Chapter for Omid

Post Syndicated from amberwilsonla-blog original https://yahooeng.tumblr.com/post/180867271141

yahoodevelopers:

By Ohad Shacham, Yonatan Gottesman, Edward Bortnikov
Scalable Systems Research, Verizon/Oath

Omid, an open source transaction processing platform for Big Data, was born as a research project at Yahoo (now part of Verizon), and became an Apache Incubator project in 2015. Omid complements Apache HBase, a distributed key-value store in Apache Hadoop suite, with a capability to clip multiple operations into logically indivisible (atomic) units named transactions. This programming model has been extremely popular since the dawn of SQL databases, and has more recently become indispensable in the NoSQL world. For example, it is the centerpiece for dynamic content indexing of search and media products at Verizon, powering a web-scale content management platform since 2015.

Today, we are excited to share a new chapter in Omid’s history. Thanks to its scalability, reliability, and speed, Omid has been selected as transaction management provider for Apache Phoenix, a real-time converged OLTP and analytics platform for Hadoop. Phoenix provides a standard SQL interface to HBase key-value storage, which is much simpler and in many cases more performant than the native HBase API. With Phoenix, big data and machine learning developers get the best of all worlds: increased productivity coupled with high scalability. Phoenix is designed to scale to 10,000 query processing nodes in one instance and is expected to process hundreds of thousands or even millions of transactions per second (tps). It is widely used in the industry, including by Alibaba, Bloomberg, PubMatic, Salesforce, Sogou and many others.

We have just released a new and significantly improved version of Omid (1.0.0), the first major release since its original launch. We have extended the system with multiple functional and performance features to power a modern SQL database technology, ready for deployment on both private and public cloud platforms.

A few of the significant innovations include:

Protocol re-design for low latency

The early version of Omid was designed for use in web-scale data pipeline systems, which are throughput-oriented by nature. We re-engineered Omid’s internals to now support new ultra-low-latency OLTP (online transaction processing) applications, like messaging and algo-trading. The new protocol, Omid Low Latency (Omid LL), dissipates Omid’s major architectural bottleneck. It reduces the latency of short transactions by 5 times under light load, and by 10 to 100 times under heavy load. It also scales the overall system throughput to 550,000 tps while remaining within real-time latency SLAs. The figure below illustrates Omid LL scaling versus the previous version of Omid, for short and long transactions.

image

Throughput vs latency, transaction size=1 op

image

Throughput vs latency, transaction size=10 ops

Figure 1. Omid LL scaling versus legacy Omid. The throughput scales beyond 550,000 tps while the latency remains flat (low milliseconds).

ANSI SQL support

Phoenix provides secondary indexes for SQL tables — a centerpiece tool for efficient access to data by multiple keys. The CREATE INDEX command is on-demand; it is not allowed to block already deployed applications. We added Omid support for accomplishing this without impeding concurrent database operations or sacrificing consistency. We further introduced a mechanism to avoid recursive read-your-own-writes scenarios in complex queries, like “INSERT INTO T … SELECT FROM T …” statements. This was achieved by extending Omid’s traditional Snapshot Isolation consistency model, which provides single-read-point-single-write-point semantics, with multiple read and write points.

Performance improvements

Phoenix extensively employs stored procedures implemented as HBase filters in order to eliminate the overhead of multiple round-trips to the data store. We integrated Omid’s code within such HBase-resident procedures, allowing for a smooth integration with Phoenix and also reduced the overhead of transactional reads (for example, filtering out redundant data versions).

We collaborated closely with the Phoenix developer community while working on this project, and contributed code to Phoenix that made Omid’s integration possible. We look forward to seeing Omid’s adoption through a wide range of Phoenix applications. We always welcome new developers to join the community and help push Omid forward!

My Views on GNU Kind Communication Guidelines and Related Material

Post Syndicated from Bradley M. Kuhn original http://ebb.org/bkuhn/blog/2018/11/22/gnu-kind-communication-guidelines.html

I have until now avoided making a public statement about my views on the
various interrelated issues regarding the GNU Kind Communication
Guidelines
that came up over the last month. However, given
increasing interest in our community on these issues, and the repeated
inquiries that I received privately from major contributors in our
community, I now must state my views publicly. I don’t have much desire to
debate these topics in public, nor do I think such is particularly useful,
but I’ve been asked frequently about these GNU policy statements. I feel,
if for no other reason than efficiency, that I should share them in one
place publicly for easy reference:

  • I think
    the GNU
    Kind Communication Guidelines
    , as a stand-alone document, are useful
    suggestions and helpful to the GNU project and would be helpful, if
    adopted, for any software freedom project.
  • However, I think that the GNU Kind Communication
    Guidelines standing alone are inadequate for a project of GNU’s
    size and number of contributors to address the stated problems.
    Traditional Codes of Conduct, particularly those that offer mechanisms
    for complaint resolution when bad behavior occurs, are necessary in Free
    Software projects of GNU’s size. Codes of Conduct are the best mechanism
    known today in our community to ensure welcoming environments for those
    who might be targeted by inappropriate and unprofessional behavior.
  • I therefore disagree with
    the meta-material stated in
    the announcement of these Communication Guidelines
    . First, I
    disagree with the decision to reject any Code of Conduct for the GNU
    project. Second, I believe that diversity is an important goal for
    advancing software freedom and human equality generally. I support all
    Outreachy‘s goals (including their
    political ones) and I work hard to help Outreachy
    succeed as part of my day job. I have publicly supported affirmative
    action since the early 1990s, and continue to support it. I agree with
    “making diversity a goal”; Richard Stallman (RMS), speaking
    on behalf of GNU, states
    that
    perse disagrees with “making diversity a goal”.
  • I also disagree with encouraging GNU project contributors to ignore
    the request of non-binary-gender individuals who ask for the pronouns
    they/them0,
    as
    stated
    in RMS’ personal essay linked to from the GNU Kind Communication
    Guidelines
    . My position is that refusing to use the pronouns
    people ask for is the same unkindness as refusing to call transgender
    people by a name that is not their legal name when they request it. I
    don’t think the grammatical argument that “pronouns are different
    from proper nouns” is compelling enough to warrant unwelcoming
    behavior toward these individuals. The words people use matter. RMS has
    insisted for years that people make a clear distinction between open
    source and free software — for good reason —. I believe that
    how we say things makes a political statement in itself.
  • Related to the last point, I am concerned with the conflating of GNU
    project views with RMS’ personal views. RMS seems to have decided
    unilaterally that GNU would take a position that requests for use of
    they/them pronouns need not be honored. I think it is essential that RMS
    keeps per personal views separate from official GNU policy; I have said
    so many times to the FSF Board of Directors in various contexts. It was
    a surprise to me that RMS’ personal view on this issue was referenced as
    part of GNU project guidelines.
  • I think
    the GNU
    Kindness Communication Guidelines should apply to all communication from
    the project, including GNU manuals themselves, and I also believe the
    glibc abort() joke
    should be removed. I don’t believe
    free speech of anyone is impacted if a Free Software project forbids
    certain types of off-topic communication in its official channels.
    Everyone can have their own website and blog to express their personal
    views; they don’t need to do so through project channels.

I have been encouraged many times this year by various prominent community
members to resign from the FSF’s Board of Directors (sometimes over these
issues, and sometimes over other, similar issues). I have also received
many private communications from other prominent community members
(including some GNU contributors) expressing similar concerns to the above,
but these individuals noted that they feel much better about the FSF and
its shepherding of the GNU project because I’m on the FSF Board of
Directors, even though I clearly pointed out to them that my views on these
matters will not necessarily become GNU and/or FSF policy. The argument
that many have made to me is that it’s valuable to have dissenting opinions
in the leadership on these issues, even if those dissenting opinions do not
become FSF and/or GNU policy.

I am swayed by the latter argument, and I have decided to continue as an
FSF Director indefinitely (assuming the other Directors wish me to
continue). However, these recent public positions are far enough out of
alignment with my own views that I feel it necessary to exercise my own
free speech rights here on my personal blog and state my disagreement with
them. I will continue to urge the FSF and GNU to change and/or clarify
these positions. (I also sent this blog post privately to the FSF
Directors 8 days before I posted it, and had also discussed these concerns
in detail with RMS for a month before posting this.)

Governing well means working (and finding common ground) with those you
disagree. We oscillate a bit too much in software freedom communities:
either we air every last disagreement no matter how minor, or (perhaps as
an over-correction to the former) we seek to represent a seemingly perfect
consensus even when one isn’t present. I try to avoid both extremes; so
this is the first time in my many years on the FSF Board of Directors where
I’ve publicly disagreed with an FSF or GNU project policy. FSF and GNU
primarily fight for one principle: equal software freedom for all users and
developers. On other topics, there can easily exist disagreement, and
working through those disagreements together, in my opinion, usually make
the community stronger.

As always, this is my personal blog, and nothing here necessarily reflects
the official views of any organization with which I am affiliated,
including not only the Free Software Foundation and GNU, but also Software
Freedom Conservancy.

Change made on 2019-03-25: Above, the words I am
a supporter of
Outreachy and work hard to help it
succeed as part of my day job.
were changed to:
I support all
Outreachy‘s goals (including their
political ones)


0
A review of
various
archive.org
links
shows that this particular text was surreptitious changed in the weeks
following my publication of this blog post. I was never contacted nor
consulted to review the original condemnation by the GNU project of
they/them pronouns nor the improvements. This footnote here was added in
2020 long after these incidents, as that’s when I first became aware those
changes were made after the fact. I believe that the change, which evolved
into something more reasonable after a few months of edits (but coming
after I posted this blog) vindicates both my position that the GNU project
should not have initially condemned the use of they/them pronouns for
non-binary individuals, and that it would have been advisable for the GNU
project to seek input from the FSF Board of Directors (which I
was a member of at the time
but am no longer
) before setting such policies about diversity and
inclusiveness.

Hadoop Contributors Meetup at Oath

Post Syndicated from amberwilsonla-blog original https://yahooeng.tumblr.com/post/179901430546

yahoodevelopers:

By Scott Bush, Director, Hadoop Software Engineering, Oath

On Tuesday, September 25, we hosted a special day-long Hadoop Contributors Meetup at our Sunnyvale, California campus. Much of the early Hadoop development work started at Yahoo, now part of Oath, and has continued over the past decade. Our campus was the perfect setting for this meetup, as we continue to make Hadoop a priority.

More than 80 Hadoop users, contributors, committers, and PMC members gathered to hear talks on key issues facing the Hadoop user community.

Speakers from Ampool, Cloudera, Hortonworks, Microsoft, Oath, and Twitter detailed some of the challenges and solutions pertinent to their parts of the Hadoop ecosystem. The talks were followed by a number of parallel, birds of a feather breakout sessions to discuss HDFS, Tez, containers and low latency processing. The day ended with a reception and consensus that the event went well and should be repeated in the near future.

Presentation recordings (YouTube playlist) and slides (links included in the video description) are available here:

Thank you to all the presenters and the attendees both in person and remote!

P.S. We’re hiring! Learn more about career opportunities at Oath.

Sharing Vespa (Open Source Big Data Serving Engine) at the SF Big Analytics Meetup

Post Syndicated from amberwilsonla-blog original https://yahooeng.tumblr.com/post/179150583591

yahoodevelopers:

By Jon Bratseth, Distinguished Architect, Oath

I had the wonderful opportunity to present Vespa at the SF Big Analytics Meetup on September 26th, hosted by Amplitude. Several members of the Vespa team (Kim, Frode and Kristian) also attended. We all enjoyed meeting with members of the Big Analytics community to discuss how Vespa could be helpful for their companies. Thank you to Chester Chen, T.J. Bay, and Jin Hao Wan for planning the meetup, and here’s our presentation, in case you missed it (slides are also available here):

Largely developed by Yahoo engineers, Vespa is our big data processing and serving engine, available as open source on GitHub. It’s in use by many products, such as Yahoo News, Yahoo Sports, Yahoo Finance and Oath Ads Platforms. 

Vespa use is growing even more rapidly; since it is open source under a permissive Apache license, Vespa can power other external third-party apps as well. 

A great example is Zedge, which uses Vespa for search and recommender systems to support content discovery for personalization of mobile phones (Android, iOS, and Web). Zedge uses Vespa in production to serve millions of monthly active users.

Visit https://vespa.ai/ to learn more and download the code. We encourage code contributions and welcome opportunities to collaborate.

Toward Community-Oriented, Public & Transparent Copyleft Policy Planning

Post Syndicated from Bradley M. Kuhn original http://ebb.org/bkuhn/blog/2018/10/16/mongodb-copyleft-drafting.html

[ A similar version
was crossposted
on Conservancy’s blog
. ]

More than 15 years ago, Free, Libre, and Open Source Software (FLOSS)
community activists successfully argued that licensing proliferation was a
serious threat to the viability of FLOSS. We convinced companies to end
the era of
“vanity” licenses. Different charities — from the Open Source Initiative (OSI) to
the Free Software Foundation (FSF) to the Apache Software Foundation — all agreed we were better
off with fewer FLOSS licenses. We de-facto instituted what my colleague
Richard Fontana once called the “Rule of Three” —
assuring that any potential FLOSS license should be met with suspicion
unless (a) the OSI declares that it meets their Open Source Definition,
(b) the FSF declares that it meets their Free Software Definition, and (c)
the Debian Project declares that it meets their Debian Free Software
Guidelines
. The work for those organizations quelled license proliferation
from radioactive threat to safe background noise. Everyone thought the
problem was solved. Pointless license drafting had become a rare practice,
and updated versions of established licenses were handled with public engagement
and close discussion with the OSI and other license evaluation experts.

Sadly, the age of
license proliferation has returned. It’s harder to stop this time, because
this isn’t merely about corporate vanity licenses. Companies now have complex FLOSS policy
agendas, and those agendas are not to guarantee software
freedom for all. While it is annoying that our community must again confront an
old threat, we are fortunate the problem is not hidden: companies proposing
their own licenses are now straightforward about their new FLOSS licenses’ purposes: to maximize profits.

Open-in-name-only
licenses are now common, but seem like FLOSS licenses only to the most casual of readers.
We’ve succeeded in convincing everyone to “check the OSI license
list before you buy”. We can therefore easily dismiss licenses like Common
Clause merely
by stating they are non-free/non-open-source
and urging the community to
avoid them. But, the next stage of tactics have begun, and they are
harder to combat. What happens when for-profit companies promulgate their
own hyper-aggressive (quasi-)copyleft licenses that seek to pursue the key
policy goal of “selling proprietary licenses” over
“defending software freedom”? We’re about to find out,
because, yesterday,
MongoDB declared themselves the arbiter of what “strong copyleft” means.

Understanding MongoDB’s Business Model

To understand the policy threat inherent in MongoDB’s so-called
“Server
Side Public License, Version 1”
, one must first understand the
fundamental business model for MongoDB and companies like them. These
companies use copyleft for profit-making rather than freedom-protecting. First, they require full control (either via ©AA or CLA) of
all copyrights in the work, and second, they offer two independent lines of
licensing. Publicly, they provide the software under the strongest
copyleft license available. Privately, the same (or secretly improved)
versions of the software are available under fully proprietary terms. In
theory, this could be
merely selling
exceptions
: a benign manner of funding more Free Software code —
giving the proprietary option only to those who request it. In practice
— in all examples that have been even mildly successful (such as
MongoDB and MySQL) — this mechanism serves as a warped proprietary
licensing shake-down: “Gee, it looks like you’re violating the
copyleft license. That’s a shame. I guess you just need to abandon the
copyleft version and buy a proprietary license from us to get yourself out
of this jam, since we don’t plan to reinstate any lost rights and
permissions under the copyleft license.” In other words, this
structure grants exclusive and dictatorial power to a for-profit company as
the arbiter of copyleft compliance. Indeed, we have never seen any of
these companies follow or endorse the Principles of
Community-Oriented GPL Enforcement
. While it has made me unpopular with some, I still make no apologies that I have since 2004
consistently criticized this “proprietary relicensing” business
model as “nefarious”, once I started hearing regular reports that MySQL AB (now
Oracle) asserts GPL violations against compliant uses merely to scare
users into becoming “customers”. Other companies,
including MongoDB, have since emulated this activity.

Why Seek Even Stronger Copyleft?

The GNU Affero General Public License (AGPL) has done a wonderful job defending the software freedom of
community-developed projects
like Mastodon
and Mediagoblin.
So, we should answer with skepticism
a solitary
for-profit company coming
forward to claim
that “Affero GPL has not resulted in sufficient
legal incentives for some of the largest users of infrastructure software
… to participate in the community. Many open source developers are
struggling with a similar reality”. If the last sentence were on
Wikipedia, I’d edit it to add a Citation Needed tag, as I know
of nomulti-copyright-held or charity-based AGPL’d project
that has “struggled with this reality”. In fact, it’s only a
“reality” for those that engage in proprietary relicensing.
Eliot Horowitz, co-founder of MongoDB and promulgator of their new license, neglects to mention that.

The most glaring problem with this license, which Horowitz admits in his OSI license-review list post, is that there was no community drafting process. Instead, a for-profit company, whose primary goal is to
use copyleft as a weapon against the software-sharing community for the purpose of converting that “community” into paying
customers, published this license as a fait accompli without prior public discussion of the license text.

If this action were an isolated incident by one company, ignoring it is surely the best response. Indeed,
I urged everyone to simply ignore the Commons Clause. Now, we see
a repackaging of the Commons Clause into a copyleft-like box (with reuse of Commons Clause’s text
such as “whose value derives, entirely or substantially, from the functionality of the Software”). Since
both licenses were drafted in secret, we cannot know if the reuse of text was simply because the same lawyer was
employed to write both, or if MongoDB has joined a broader and more significant industry-wide strategy to replace
existing FLOSS licensing with alternatives that favor businesses over individuals.

The Community Creation Process Matters

Admittedly, the history of copyleft has been one of slowly evolving
community-orientation. GPLv1 and GPLv2 were drafted in private, too, by
Richard Stallman and FSF’s (then) law firm lawyer, Jerry Cohen. However, from
the start, the license steward was not Stallman himself, nor the law firm,
but the FSF, a 501(c)(3) charity dedicated to
serve the public good. As such, the FSF made substantial efforts in the
GPLv3 process to reorient the drafting of copyleft licenses as a public
policy and legislative process. Like all legislative processes, GPLv3 was
not ideal — and I was even personally miffed to be relegated to the
oft-ignored “GPLv3 Discussion Committee D” — but the GPLv3 process was
undoubtedly a step forward in FLOSS community license drafting.
Mozilla
Corporation made efforts for community collaboration in redrafting the
MPL
, and specifically included the OSI and the FSF (arbiters of the
Open Source Definition and Free Software Definition (respectively)) in
MPL’s drafting deliberations. The modern acceptable standard is a leap rather
than a step forward: a fully public, transparent drafting process with a fully
public draft repository, as the copyleft-next project
has done
. I think we should now meet with utmost suspicion any license
that does not use copyleft-next’s approach of “running licensing drafting
as a Free Software project”.

I was admittedly skeptical of that approach at first. What I have seen
six years since Richard Fontana started copyleft-next is that, simply put,
the key people who are impacted most fundamentally by a software
license are mostly likely to be
aware of, and engage in, a process if it is fully public, community-oriented,
and uses community tools, like Git.

Like legislation, the policies outlined in copyleft licenses impact the
general public, so the general public should be welcomed to the
drafting. At Conservancy, we don’t draft our own
licenses0, so our contracts with
software developers and agreements with member projects state that the
licenses be both “OSI-approved Open Source” and
“FSF-approved GPL-compatible Free Software”. However, you can
imagine that Conservancy has a serious vested interest in what licenses are
ultimately approved by the OSI and the FSF. Indeed, with so much money
flowing to software developers bound by those licenses, our very charitable
mission could be at stake if OSI and the FSF began approving proprietary
licenses as Open, Free, and/or GPL-compatible. I want to therefore see
license stewards work, as Mozilla did, to make the vetting process easier,
not harder, for these organizations.

A community drafting process allows everyone to vet the license text early and often,
to investigate the community and industry impact of the license, and to probe the license drafter’s intent through the acceptance and rejection of proposed modified text (ideally through a DVCS). With for-profit actors seeking to
gain policy control of fundamental questions such as “what is strong
copyleft?”, we must demand full drafting transparency and frank public
discourse.

The Challenge Licensing Arbiters Face

OSI, FSF, and Debian have a huge challenge before them. Historically, the
FSF was the only organization who sought to push the boundary of strong
copyleft. (Full disclosure: I created the Affero clause while working for
the FSF in 2002, inspired by Henry Poole’s useful and timely demands for a true network
services copyleft.) Yet, the Affero clause was itself controversial. Many complained that it changed the fundamental rules of
copyleft. While “triggered only on distribution, not
modification” was a fundamental rule of the regular GPL, we
as a community — over time and much public debate — decided the Affero clause is a legitimate copyleft, and AGPL was
declared Open Source by OSI
and DFSG-free
by Debian
.

That debate was obviously framed by the FSF. The FSF, due
to public pressure, compromised by leaving the AGPL as an indefinite
fork of the GPL (i.e., the FSF did not include the Affero clause in plain GPL. While I
personally lobbied (from GPLv3 Discussion Committee D and elsewhere) for the merger
of AGPL and GPL during the GPLv3 drafting process, I respect the decision
of the FSF, which was informed not by my one voice,
but the voices of the entire community.

Furthermore, the FSF is a charity, chartered to serve the public good
and the advancement of software freedom for users and developers. MongoDB
is a for-profit company, chartered to serve the wallets of its owners.
While MongoDB employees1 (like those of any other company) should be welcomed on equal footing
to the other unaffiliated individuals, and representatives of companies, charities, and trade-associations to the debate about the
future of copyleft, we should not accept their active framing of that
debate. By submitting this license to OSI for approval without any public
community discussion, and without any discussion whatsoever with the key
charities in the community, is unacceptable. The OSI should now adopt a new requirement for license approval — namely, that licenses without a community-oriented drafting
process should be rejected for the meta-reason of “non-transparent
drafting”, regardless of their actual text. This will have the added
benefit of forcing future license drafters to come to OSI, on their public mailing
lists, before the license is finalized. That will save OSI the painstaking
work of walking back bad license drafts, which has in recent years consumed
much expert time by OSI’s volunteers.

Welcoming All To Public Discussion

Earlier this year, Conservancy announced plans to host and organize
the first annual CopyleftConf.
Conservancy decided to do this because Conservancy seeks to create a truly
neutral,
open, friendly, and
welcoming
forum for discussion about the past and future of copyleft as
a strategy for defending software freedom. We had no idea when
Karen and I first mentioned the possibility of running CopyleftConf (during
the Organizers’ Panel at the end of the Legal and Policy DevRoom at FOSDEM
2018 in February 2018) that multiple companies would come forward and seek
to control the microphone on the future of copyleft. Now that MongoDB has
done so, I’m very glad that the conference is already organized and on the
calendar before they did so.

Despite my criticisms of MongoDB, I welcome Eliot Horowitz, Heather Meeker (the law firm lawyer who drafted MongoDB’s new license and the Commons Clause), or anyone else who was involved in the
creation of MongoDB’s new license to submit a talk.
Conservancy will be announcing soon the independent group of copyleft
experts (and critics!) who will make up the Program Committee and will
independently evaluate the submissions. Even if a talk is rejected, I
welcome rejected proposers to attend and speak about their views in the hallway track and
the breakout sessions.

One of the most important principles in copyleft policy that our community
has learned is that commercial, non-commercial, and hobbyist activity3
should have equal footing with regard to rights assured by the copyleft
licenses themselves. There is no debate about that; we all agree that
copyleft codebases become meeting places for hobbyists, companies, charities,
and trade associations to work together toward common goals and in harmony
and software freedom. With this blog post, I call on everyone to continue
on the long road to applying that same principle to the meta-level of how
these licenses are drafted and how
they
are enforced
. While we have done some work recently on the latter, not
enough has been done on the former. MongoDB’s actions today give us an
opportunity to begin that work anew.


0 While Conservancy does
not draft any main FLOSS license texts, Conservancy does
help
with the drafting of additional permissions
upon the request of our
member projects. Note that additional permissions (sometimes called license
exceptions) grant permission to engage in activities that the main license
would otherwise prohibit. As such, by default, additional permissions can
only make a copyleft license weaker, never stronger.

1
, 3 I originally had
“individual actors” here instead of “hobbyist
activity”, and additionally had expressed poorly the idea of welcoming
individuals representing all types of entities to the discussion. The
miscommunication in my earlier text gave one person the wrong impression that
I believe the rights of companies should be equal to the rights of
individuals. I fundamentally that companies and organizations should not
have rights of personhood and I’ve updated the text in an effort to avoid
such confusions.

Thoughts on Microsoft Joining OIN’s Patent Non-Aggression Pact

Post Syndicated from Bradley M. Kuhn original http://ebb.org/bkuhn/blog/2018/10/10/microsoft-oin-exfat.html

[ A similar version
was crossposted
on Conservancy’s blog
. ]

Folks lauded today
that Microsoft
has joined the Open Invention Network (OIN)’s limited patent non-aggression
pact
, suggesting that perhaps it will bring peace in our time regarding
Microsoft’s historical patent aggression.
While today’s announcement is a step forward, we call on Microsoft to make
this just the beginning of their efforts to stop their patent aggression
efforts against the software freedom community.

The OIN patent non-aggression pact is governed by something
called the
Linux System Definition
. This is the most important component of the OIN
non-aggression pact, because it’s often surprising what is not
included in that Definition especially when compared with Microsoft’s patent
aggression activities. Most importantly, the non-aggression pact only
applies to the upstream versions of software, including Linux itself.

We know
that Microsoft has done patent troll shakedowns in the past on Linux products
related to the exfat filesystem.
While we
at Conservancy were successful in getting the code that implements exfat for
Linux released under GPL (by Samsung)
, that code has not been upstreamed
into Linux. So, Microsoft has not included any patents they
might hold on exfat into the patent non-aggression pact.

We now ask Microsoft, as a sign of good faith and to confirm its intention
to end all patent aggression against Linux and its users, to now submit to
upstream the exfat code themselves under GPLv2-or-later. This would
provide two important protections to Linux users regarding exfat: (a) it
would include any patents that read on exfat as part of OIN’s
non-aggression pact while Microsoft participates in OIN, and (b) it would
provide the various benefits that GPLv2-or-later provides regarding
patents,
including an
implied patent license
and those protections provided
by GPLv2§7
(and possibly other GPL protections and assurances as well)

The collective thoughts of the interwebz

By continuing to use the site, you agree to the use of cookies. more information

The cookie settings on this website are set to "allow cookies" to give you the best browsing experience possible. If you continue to use this website without changing your cookie settings or you click "Accept" below then you are consenting to this.

Close