Global Name Registry
Comments on Preliminary Staff Report on Evaluation of the Proposals
Reassignment of the .Org Registry

Executive Summary

We are pleased to have been recognized by the Preliminary Report as one of the top three contenders to be the successor to the current .org registry operator, and we thank the evaluation teams and the ICANN Staff for their hard work.

We disagree, however, with the conclusion of the report that the Internet Society ("ISOC") is the most qualified operator to run the new .org registry. Our careful review of the report reveals serious problems with the methodology used in certain evaluations, the consistency of the criteria applied to all 11 applications, the effort to translate scores on individual criteria into a single grade, and other important aspects of the evaluation process thus far. For example:

  • One of the most important criteria for running a successful registry is financial stability and viability. This is particularly relevant to an industry that has been plagued by serious financial problems during the past two years. Candidates' financial wherewithal and experience in managing a budget were never examined in detail by the report. The financial problems of both ISOC and NeuStar have been documented and need to be evaluated in consideration of their ability to operate .org.

  • Although we are generally pleased with the report by Gartner, there are certain procedural and substantive issues that may have led to inconsistent results and flawed scoring. In particular, Gartner's publication of an analytical report on NeuStar in the middle of the .org application process ("NeuStar: One of the Best Kept-Secrets in Telecom," by David Fraley, 06 May 2002, available on www.gartner.com) raises questions whether its more extensive knowledge of NeuStar's systems may have given that bidder an unfair advantage.

  • Since the CIO Team did not provide much detail as to its methodology or findings, we question the reliability of its process and the weight attributed to its determination.

  • While we appreciate the voluntary efforts of the NCDNHC team, aspects of its report concern us. Its methodology for measuring the level of public support was flawed. Also, the report contains inconsistencies in evaluation of the 11 applicants and mathematical errors.

Inasmuch as the report constitutes only Phase I of the evaluation process, these problems can be remedied before ICANN Staff issues its final report on 5 September 2002 (Phase II) and the ICANN Board makes its decision at the end of September (Phase III). As these flaws and errors are corrected, it will become even clearer that Global Name Registry is the best-qualified candidate:

  • Sound Financial Condition: Among the top three contenders identified in the report, we are unique in having a sound financial track record. Our backers include the Carlyle Group, which manages more than $14 billion in assets worldwide. Unlike ISOC, we would not be dependent upon delivery of the VeriSign endowment. (Although if one of our non-profit affiliates were deemed eligible for the funds, we would expand our outreach to more local communities in Latin America, Africa and Asia.)

  • Outstanding, Demonstrated Technical Capability & Compliance with Standards: We own and operate a state-of-the-art registry system that has been built in-house and designed to serve 50 million domain names and thousands of registrars:

    • Unlike ISOC/Afilias, we have built and operate a registry infrastructure that does not rely solely on an outsourced partner for its operations.

    • We will operate the .org registry using hardware and proprietary software, which - unlike Afilias' - is compliant with key IETF RFCs and has enough capacity to run the entire .com/.net/.org DNS and Whois systems.

  • Smooth Transition by 31 December 2002: Our technical team's experience working with VeriSign (including providing VeriSign with software developed by Global Name Registry's own technical team as the foundation for technical cooperation) could be the critical factor in a successful transition.

  • Responsiveness to the Non-Commercial Community: Global Name Registry is committed to developing .org as the "Community Capital," while exceeding current service standards and lowering the registry price - two critical factors the ICANN Board has emphasised. Our .orgcentre and the Causeway Community Foundation will be a large part of our marketing campaign designed to respond specifically to the community's needs. These initiatives will be undertaken in close consultation and cooperation with the .org Steering Committee. Our proposal means reinvesting revenues from .org back into the community, rather than simply supporting a narrower set of interests (e.g., ISOC) or increasing corporate earnings (e.g., NeuStar).

  • Global Outreach: We will leverage our relationship with the International Federation of Red Cross and Red Crescent Societies (the "Red Cross") to maximize our global outreach and to bring the resources of the .orgcentre and the Causeway Community Foundation to local communities worldwide.

  • Significant Enhancement of Competition: Selecting Global Name Registry as the .org operator will create the first European super-registry and significantly enhance competition in the registry services industry.

In order to ensure a fair evaluation process and a credible outcome, we therefore request that the final report:

  • Fully incorporate the concerns described in our comment, including correcting tabulation errors and re-scoring or invalidating scores that cannot be substantiated or that result from inconsistent application of the criteria; and

  • Include all of the information that the Board will require to make a fully informed decision in the interests of the 2.3-million .org registrants and the broader ICANN community, particularly on the financial stability and viability of the top three contenders.


Introduction


We have read the Preliminary Staff Report on Evaluation of the Proposals regarding Reassignment of the .Org Registry (the "Preliminary Report") and are pleased to have been recognized by ICANN Staff as one of the top three contenders to be the successor to the current .org registry operator. We know that the evaluation teams faced a tremendous challenge in digesting and analysing the bids within a short timeframe, and we commend them for their efforts and continued commitment to the process.

We want to thank the ICANN Staff, the Non-Commercial Domain Name Holders Constituency (the "NCDNHC"), Gartner, Inc. ("Gartner") and the Academic CIO Team (the "CIO Team") for their efforts, with special gratitude to those who volunteered their time. We commend the ICANN Staff in particular for its commitment to overseeing the application process in as fair, impartial, open and transparent a manner process as possible.

We appreciate the evaluation teams' recognition of the strengths of Global Name Registry as both a registry operator and as a visionary for the .org namespace. Gartner selected Global Name Registry as one of the top three applicants on technical excellence, and indicated that we stand first among all applicants with respect to our ability to support, function in, and adapt to protocol changes in SRS. This is one of the most important components of transitioning the .org registry from a thin registry accessed through RRP to a thick registry accessed through EPP. The NCDNHC applauded Global Name Registry's vision statement, including our explicit recognition of the diversity of .org, and our development of a "clear brand identity" based on creating "Community Capital".

We respectfully disagree, however, with the suggestion in the Preliminary Report that the new .org registry operator should be the Internet Society ("ISOC"). Our careful review of each of the reports underlying the Preliminary Report, and the Preliminary Report itself, reveals serious problems with the methodology used in certain evaluations, the consistency of the criteria applied to all 11 applications, the effort to translate scores on individual criteria into a single grade for an "Evaluation Summary", and other important aspects of the evaluation process thus far. Inasmuch as the Preliminary Report constitutes only Phase I of the evaluation process, these problems can be remedied before the ICANN Staff issues its final report on 5 September 2002 (Phase II) or the ICANN Board subsequently makes its decision at the end of September (Phase III).

Comment


It is vital that by the end of September the ICANN Board has before it for consideration all the information it needs to select the candidate most qualified - in every critical respect - to operate the new .org registry. We therefore request that ICANN Staff will, before issuing its final report for the Board's review:

  • Fully incorporate this comment on the Preliminary Report, including correcting tabulation errors and either re-scoring or invalidating scores that cannot be substantiated or that result from inconsistent application of the criteria.

  • Add to its final report all of the information that the Board will require to make a fully informed decision in the interests of the 2.3 million .org registrants and the broader ICANN community, particularly on the financial stability and viability of the top three contenders.

We recognize that a numerical evaluation process, with identified flaws corrected, may be the only way to narrow a competitive field of 11 candidates to a few top candidates. It may not, however, be the best way to differentiate among the top three: ISOC/Afilias, NeuStar and Global Name Registry. The combination of the (1) varying importance of the criteria developed by ICANN, (2) inherently subjective nature of their application, and (3) slight differences in scoring (e.g., Gartner gave overall scores of 3.65 to ISOC and 3.64 to Global Name Registry, a difference of only .01), does not establish a reliable method for discerning and weighing important differences among the top three applicants. We respectfully submit that the most useful way - and, really, the only way - to prepare the Board for its decision is to provide clearer, more comprehensive information on each of the top three candidates.

This comment (1) describes why Global Name Registry remains the candidate all around best qualified to be the new .org operator; (2) identifies material flaws and misinformation in, and omissions from, the Preliminary Report that must be corrected before the final report is issued on 5 September 2002; and (3) recommends additional information the Staff should present to the Board in its final report.

 

Global Name Registry's Qualifications


We believe that we are the candidate most qualified to assume full operation of the .org registry on 1 January 2003 because we represent the "best of the breed" overall. We say this without any slight to the other candidates. On the contrary, we have a healthy respect for our competitors, and nothing in this comment is intended to undermine that. At the same time, the need to make the final report accurate and complete in certain fundamental respects puts pressure on us to highlight the differences among the three of us for the benefit of the Board. When it is time for the Board to make the final decision and can choose only one winner, the following strengths will distinguish Global Name Registry from the other top contenders:

  • Sound Financial State: .org is too important a top-level domain to award to any entity that is not clearly - on its own - financially stable and viable. We are backed strongly by the Carlyle Group which manages more than $14 billion in assets worldwide and has been an enthusiastic supporter of our operations. In light of the serious financial problems that ISOC (see http://www.isoc.org/isoc/general/trustees/mtg25.shtml) and NeuStar (see "NeuStar Slashes Staff Again", TechNews.com, 23 May 2002 at http://www.washingtonpost.com/ac2/wp-dyn?pagename=article&node=&contentId=A3429-2002May10¬Found=true) have had during the past year, and as recently as a few months ago, we are clearly the most financially secure top contender. The problems facing ISOC and NeuStar could impact negatively on their ability to transition and operate .org, in both the short- and long-term. Unlike ISOC, we are not dependent upon receipt of the VeriSign endowment (although if one of our non-profit affiliates is deemed eligible for the funds, those funds would be used to expand outreach to local communities in Latin America, Africa and Asia).

  • Outstanding, Demonstrated Technical Capability & Compliance with Standards: The .org domain space, containing approximately 2.3 million registrants, is too important to entrust to any entity that has not operated a top-level domain, or even to an entity that does not have a track record of technical excellence. We own and operate a state-of-the-art registry system that has been built in-house and designed to serve 50 million domain names and thousands of registrars. Our technical capability and commitment to excellence provide a solid foundation onto which we will safely transition and operate the .org registry:

    • Unlike ISOC/Afilias, Global Name Registry has built and operates a registry infrastructure that does not rely solely on an outsourced partner for operations of its data centre, DNS, Whois or MX services.

    • Global Name Registry's decision to purchase certain SRS services from VeriSign to provide for additional stability and redundancy during the .name start-up period has given us unique familiarity with the incumbent operator's technical teams and systems. VeriSign will not, however, play any role whatsoever in the operation of .org.

    • Global Name Registry will operate the .org registry using its proven, internally designed and developed hardware and software, which - unlike Afilias's - is compliant with key IETF RFCs and has enough capacity to run the entire .com/.net/.org DNS and Whois systems.

  • Smooth Transition by 31 December 2002: There is no room for error on this tight schedule. The Global Name Registry technical team's experience working with VeriSign (including providing VeriSign with software developed by Global Name Registry's own technical team as the foundation for technical cooperation) could be the critical factor in a successful transition. We fear that some applicants may have underestimated the complexity of the .org transition and made unrealistic promises. We have carefully evaluated, and are ready to execute, every element critical to a seamless transition.

  • Responsiveness to the Non-Commercial Community: Global Name Registry is committed to developing .org as the "Community Capital", while exceeding current service standards and lowering the registry price. The .orgcentre - a success-centre for non-commercial entities - will be an open resource centre available exclusively for the benefit of the .org community and will continuously assess its changing needs and interests. The Causeway Community Foundation will be available to fund hundreds of projects that the .org community believes can benefit the broader Internet community. Both entities - which will re-invest revenues from .org back into the non-commercial community, rather than supporting a narrow set of interests or solely increasing corporate earnings - will be a large part of our marketing campaign designed to respond specifically to the community's needs. All of these efforts will be undertaken in close consultation and cooperation with the .org Steering Committee, consisting of the leadership of the NCDNHC and Global Name Registry.

  • Global Outreach: We will leverage our relationship with the International Federation of Red Cross and Red Crescent Societies (the "Red Cross") to maximize our global outreach and to bring the resources of the .orgcentre and the Causeway Community Foundation to local communities worldwide. Red Cross presence in more than 180 countries and its 92 million volunteers worldwide provide a strong foundation to expand use of the .org namespace. Through its global footprint, the .orgcentre's tools, and the Causeway Community Foundation's resources, we can reach a broader section of the Internet community.

  • Significant Enhancement of Competition: Selecting Global Name Registry as the .org operator will create the first European super-registry and significantly enhance competition in the registry services industry. Global Name Registry currently runs only one top-level domain and would therefore be able to focus our full attention and resources on the operation of the two registries. NeuStar and Afilias, on the other hand, already each operate two other top-level domains; indeed, awarding it to either of them could make it harder to justify the decision to require the incumbent to divest its third registry.

 

Flaws in the Evaluation Process and Preliminary Report

Gartner, Inc.

We are generally pleased with the report by Gartner, a well-respected organization that brings a level of experience to the process that cannot be replicated. Its evaluation was supported by detailed illustrations of the underlying objectives and methodology. Nonetheless, there are certain procedural and substantive issues that may have led to inconsistent results and flawed scoring, including Gartner's previous knowledge of the systems of at least one of the bidders, and inconsistent application of several criteria and their components.

Previous Familiarity with NeuStar Systems

We believe in Gartner's integrity as an industry analyst. We were surprised, however, to learn that it published an analytical report on NeuStar in the middle of the .org application process (see "NeuStar: One of the Best Kept-Secrets in Telecom", by David Fraley, 06 May 2002, available on www.gartner.com). It is now clear that Gartner had significant knowledge with respect to NeuStar's systems before evaluating its bid. This raises two issues:

  • There should have been disclosure prior to Gartner's evaluation of any bid, and acknowledgment in the Preliminary Report that Gartner had already conducted an in-depth analysis on NeuStar. This is particularly important in light of the fact that Gartner awarded NeuStar the highest score of any bidder, including Global Name Registry and ISOC/Afilias.

  • There is no way to determine whether Gartner's pre-existing knowledge of NeuStar's technical systems, rather than the contents of its .org bid, benefited NeuStar's application or adversely affected other bidders. However, Gartner's previous knowledge of NeuStar's systems may have given NeuStar an unfair advantage over its competitors because Gartner would have been able to fill in any gaps in NeuStar's application.

We reiterate our belief that Gartner likely entered this process with the intent to conduct a thoroughly impartial and objective evaluation. However, it is entirely possible that Gartner's pre-existing knowledge of the NeuStar systems swayed its analysis of the NeuStar bid. In light of this uncertainty, it cannot be said unequivocally that this part of the evaluation process was altogether fair.

Consistency of Criteria

With respect to consistency, using two separate teams to evaluate the 11 applications led to several deficiencies. Gartner raised certain issues with the Global Name Registry bid, in comparison to the ISOC/Afilias and NeuStar bids, with respect to Criterion 1 (stability of .org registry), Criterion 7 (the type/quality/cost of registry services proposed) and Criterion 11 (completeness of proposals). Clarifying these issues will demonstrate that Global Name Registry possesses equal, if not better, experience and capabilities.

Criterion 1: Stability of the .Org Registry - Capacity

Global Name Registry understands the overriding importance of preserving the stability of the Internet. In the .org context, this requires a system that is technically sound with high quality services that meet the needs of .org registrants. Relevant to this context is a discussion of the details of an applicant's DNS platform, which is extremely important to a well-functioning .org namespace and must operate flawlessly.

Gartner has stated that the Global Name Registry "proposal included no discussion of capacity, volume or response time" of our DNS platform. The team, however, overlooked the full description contained in the application (Response C17.10 "Peak Capacities"). Because the system underlying this description comprises an integral part of the DNS platform, this oversight appears to have materially and adversely affected Global Name Registry's performance on Criterion 1.

In fact, Global Name Registry provided a more detailed description of our capacity, volume and response time than did either ISOC/Afilias or NeuStar. Our discussion includes performance graphs per single server, per cluster and across the entire Global Name Registry network. It further describes, in detail, zone-loading times, memory and disk space usage plotted against different zone sizes. This is a painstakingly detailed description of capacity, not only for the current zone size of .org, but also for other operational conditions. In this respect, Global Name Registry's proposal demonstrated better experience with capacity than either ISOC/Afilias or NeuStar.

In evaluating the capabilities of each of the top contenders, it is important to note that VeriSign receives more than 6 billion DNS queries per day, equal to roughly 70,000 queries per second (see http://www.verisign-grs.com/mdns/ha/haDatasheet.pdf, http://www.nwfusion.com/news/2002/0306verisign.html, and http://www-1.ibm.com/servers/eserver/pseries/news/pressreleases/2000/apr/network_solutions.html). This equates to approximately 7,000 queries per second for .org alone, and peak demand is likely to be 200-300% higher than this average query rate.

Global Name Registry currently operates, and would operate .org, with a documented capacity of 32,000 queries per DNS cluster alone (see C17.10), or almost 200,000 queries per second across its six clusters and entire DNS network. This far exceeds the peak demand for .org and provides a stable environment that currently has sufficient capacity to account for growth in the future. Furthermore, this solution uses BIND and is fully compliant with all relevant specifications (see C17.12).

Gartner appears to have overlooked that ISOC/Afilias and NeuStar failed to meet these criteria. Afilias states that its DNS network (outsourced to UltraDNS) can handle 10,000 queries per second, while NeuStar asserts a peak DNS capacity of 5,000 queries per second. Clearly, both fall short of the peak demand for .org. Additionally, because Afilias's 100% outsourced provider, UltraDNS, also provides its services to several companies other than Afilias, its actual capacity available for .org may be even lower than 10,000.

Criterion 7: Type/Quality/Cost of Registry Services

The ICANN Board unanimously expressed its view on the type, quality and cost of registry services proposed during its meeting in Ghana in March 2002. Vint Cerf stated, with no objection from the rest of the ICANN Board, that:

"the organization be focused on making the operation safe, secure, efficient and inexpensive as possible [emphasis added]" (see Real-Time Captioning of ICANN Board Meeting in Accra, Ghana, Afternoon Session, 14 March 2002).

Criterion 7 incorporates this concept, indicating that the proposed price of .org registrations should be given "significant consideration":

"A significant consideration will be the price at which the proposal commits to provide initial and renewal registrations and other registry services" (see Criteria for Assessing Proposals).

It is unclear, however, the extent to which Gartner actually weighed proposed pricing in its evaluation, if at all. The Gartner analysis does not mention how proposed price reductions affected a bidder's performance, which strongly suggests that pricing did not receive the significant consideration intended by the ICANN Staff and Board relative to other criteria.

Pricing is in fact an important criterion that distinguishes us from ISOC and NeuStar because our proposed average prices differ significantly: US$6 (ISOC), US$5 (NeuStar) and US$4.51 (Global Name Registry). Indeed, our proposal on pricing is far more aggressive than our competitors - up to 40% discount based on volume and duration. Because affordability is so important, and it was the intent of the ICANN Board that the new operator reduce the registry price, this omission is material and therefore renders evaluation of Criterion 7 incomplete under the standards established by ICANN.

Outsourcing

Gartner has taken issue with the fact that the .name registry is "partly outsourced" and that we run a "mirrored registry". In fact, the .name registry has been largely developed and deployed using software created by Global Name Registry and hardware designed by our Operations Team. Global Name Registry currently operates both the main site and disaster recovery site described in the .org application, which currently run 100% of the Whois and MX capacity and 60% of the DNS capacity (approximately 120,000 queries per second - more capacity than ISOC/Afilias and NeuStar put together) for .name. The main site includes a full database set and business logic. The only component that Global Name Registry does not operate is the EPP front-end, the front-end, however, is comprised of software we developed internally and have shared with other registries (e.g., Afilias uses our EPP client software).

The EPP frontend is the only real addition that would be required for the Global Name Registry .name system to encompass full SRS capability. Rather than diminish our experience, this minimal outsourcing gives us knowledge of VeriSign's systems that will facilitate a smooth transition. Further, to the extent outsourcing is a concern, it is important to note that Afilias has proposed to outsource its system for .org to IBM on a much more comprehensive basis than the Global Name Registry arrangement for .name.

Experience

While we acknowledge that we have operated a top-level domain for a slightly shorter period than either Afilias or NeuStar, the differential is a matter of only three months. It is simply wrong to conclude that Global Name Registry is less competent on this basis. Rather, attention should be paid to the substance of the operation of the registries, as well as to previous experience that any of these bidders had prior to operation of their respective generic top-level domains.

In particular, Global Name Registry significantly outperformed both Afilias and NeuStar during our respective start-up phases. Global Name Registry has experienced 100% uptime on all services during our start-up and operations. Our registration processes proceeded without incident, in particular, with no technical or legal issues. In contrast, during the land rush phase of the .info rollout, Afilias experienced a number of procedural and policy problems that were described as an "abomination" by one of its directors (see ".Info Chief Quits in Protest over Sunrise Period" at http://news.zdnet.co.uk/story/0,,t269-s2094819,00.html). As a result, Afilias was required to resort to challenging its own registrations. During the .biz land rush process, NeuStar faced serious criticism for its lottery system and ultimately lost a lawsuit claiming that its registration process constituted an illegal lottery under the laws of California (see "NeuStar: America's New VeriSign?" at http://www.internetnews.com/dev-news/article.php/10_913441).

As further evidence of our experience, the same core team that currently comprises Global Name Registry successfully operated a personalized email communications system that grew to more than 1.5 million users within one year. While operating such system is not identical to running a generic top-level domain registry, there are many similarities that give Global Name Registry significant operational experience perfectly applicable in the registry context. These similarities include:

  • Online transaction system with high volumes: The email system, like a registry, was a high-volume transaction system that supported more than 1 million users within one year, and more than 1.5 million at its peak, with 35 million page views a month. This translates into almost 1.2 billion transactions per month.

  • Design: Like a registry SRS, the system was comprised of a three-layer structure where each layer was designed to individually scale.

  • Security: Despite daily DOS attacks and attempted security breaches, the system was never compromised due to its numerous firewall layers, IDS systems and state of the art security.

  • Scalability: Like a registry, the system was built to accommodate more than 100 million users and billions of transactions per month.

Size of Registry

Gartner cites the size of the .name registry as indicative of less experience. Unfortunately, this statistic overlooks the fact that:

  • Whether a registry system includes 1,000 objects, 150,000 objects, or 2 million objects, the experience of the operator is rather a function of how the scalability strategy has been implemented, not of how many objects have been inserted. For example, it is easy to design and insert an Excel spreadsheet that contains 10,000 data elements and scales to 65,000 elements; however, it is much more difficult to design and insert 10,000 data elements into a system designed to meet the needs of 50 million objects.

  • Global Name Registry has built a system that is capable of hosting more than 50 million domain names.

  • Our performance record is unmatched by any other generic top-level domain operator.

  • We have proven the registry's security and stability through virtually flawless operation and our 100% uptime on key registry components, such as DNS, Whois and MX services.

Backup Data Centres

Gartner has indicated that the Global Name Registry bid contains little to no information on the disaster recovery site. The bid does, in fact, include significant detail, as follows:

  • Response C17.1 (for "Disaster Recovery" see pages 33, 62, 75, 98, and 116-117; for "Offsite Logging" see pages 6, 8, 27, 31, 38, and 97-98).

  • Response C17.3 (includes a figure discussing how replication occurs between the data centres).

  • Response C17.2-16 (for "Disaster Recovery", including the disaster recovery site, see pages 2, 6, 24, 37, 153, 160-162, 166, 170-176 and 181).

In contrast, the ISOC/Afilias bid provided little detail on their fail-over data centre. As an example, the data replication method does not seem to be discussed, which could mean that they rely on anything from synchronous mirroring to physical transport of a database dump in the case of main data centre failure.

In conclusion, with respect to Criteria 7, the Gartner report should have better reflected that the experience of Global Name Registry is actually superior to that of ISOC. While ISOC may be doing a fine job of developing educational tools and fostering development of Internet standards, the group itself has no experience in operating a registry. Furthermore, ISOC (or its nominee), although the proposed registry operator of record, would be so far removed from the operation of the registry that little knowledge, if any, about technical operations would be possessed by the operator. To remedy its marked lack of experience in operating a registry, ISOC has teamed with Afilias. Afilias, in turn, plans to contract its key operations to IBM and UltraDNS. It must be noted that these steps would constitute a much higher percentage of outsourcing for .org than Global Name Registry's current arrangement for .name.

Criterion 11 (Completeness of Proposal)


We believe that this Criterion (completeness of proposal) has been misinterpreted by Gartner. As stated in the Criteria, a complete proposal must, among other aspects, reflect "a thorough understanding of what is involved", have "procured firm commitments for all necessary resources" and have "formulated sound plans for executing the proposal".

Global Name Registry's description of our experience in building a state of the art registry, of how we would approach the .org transition, and of our extensive implementation plan, demonstrate that we have met these requirements. Moreover, we appear to be the only top contender in sound financial shape, with blue chip investors committed to protecting our integrity and reliability. With strong support from the Carlyle Group, which manages assets in excess of US$14 billion worldwide, for our efforts on both .name and potentially .org, we are confident of our ability to fully support both registries. The Global Name Registry team is thoroughly staffed to meet the various challenges of running a registry, with wide-ranging capabilities in development, operations, marketing, business development, public relations, policy, legal, registrar relations, human resources, finance, and internal technical support.

ISOC, in contrast, faces serious financial hurdles that raise questions about its stability and viability, and its experience in budget management. The minutes of ISOC's December 2001 Board Meeting indicate that:

"Revenues have exceeded expenses in 2000 and 2001, reducing our negative net worth to about $500K by end of year 2001... this has severely limited our capacity to develop new initiatives in the education and policy domains. The society has been operating with a very low amount of available cash, sometimes not much more than two weeks."

"We observe that the current model of individual members and chapters is not working, and that we need to change it. Even with the recommended budget, we will still get a negative set worth of a couple $100K at the end of the year..."

"We loose [sic] 65% of our members every year, which means that we are finding 4500 new members every year. but we cannot keep them. Many chapters are not very active; the chapter council never took off the ground. Membership has been stagnant for years and is now decreasing." (See http://www.isoc.org/isoc/general/trustees/mtg25.shtml.)

If ISOC had trouble matching revenues and expense during the high-tech boom years, the question of how ISOC, if selected, would now fund the transition, start up and operation of the .org registry is even more compelling. Cash reserves of two weeks or less, or even a "surplus of US$152,382" (see "Internet Society Statement in Response to Questions Regarding the Preliminary Recommendation to Award the .Org Registry to ISOC" at http://www.isoc.org/dotorg/icann-response.shtml), may be sufficient for a non-profit organization, but this level of funding is entirely unacceptable for operation of a world-class registry that contains 2.3 million names and the potential to grow much larger.

In addition, ISOC's proposed operator, Public Interest Registry ("PIR"), has not been formed, does not have a management team and lacks infrastructure (e.g., PIR has established no articles of association, no bylaws, no directors and no staff). In light of the financial status and the corporate issues facing ISOC/PIR, proper interpretation and application of Criterion 11 would have rendered the ISOC proposal materially incomplete.

We also question the financial position of NeuStar. In May 2002, approximately one month after it was awarded the contract for .us, the company conducted its fourth lay-off, cutting an additional 16% of its workforce (see "NeuStar Slashes Staff Again", TechNews.com, 23 May 2002 at http://www.washingtonpost.com/ac2/wp-dyn?pagename=article&node=&contentId=A3429-2002May10¬Found=true).

Given uncertainty surrounding actual delivery, and timing, of the VeriSign endowment (assuming it will be delivered), the ICANN Board should select an applicant that is not dependent upon endowment funds. Moreover, in light of the extremely short timeframe in which the .org transition must be planned and executed, there should be particular emphasis on the actual ability of the successor to execute the proposal, not only whether the proposal is itself complete. It is unclear whether ICANN Staff has yet evaluated either of these important factors in drafting its Preliminary Report. When they are given the weight they deserve, it will be clear that our financial stability and fully implemented corporate structure make Global Name Registry the safer choice.

Consistency - Issues Overlooked in Other Bids

In addition to overlooking, or perhaps not fully understanding, certain issues presented in the Global Name Registry bid, Gartner seems to have failed to spot problems and omissions in other bids. These include DNS capacity (mentioned above), database documentation and compliance with specifications. A review of these inconsistencies should lead Gartner to conclude that the marks for other bids were higher than they should have been. Because these aspects of registry operations are integral parts of a successful registry, this information should be presented to the ICANN Board.

Documentation of Database

The successor operator of the .org registry should possess clear and specific documentation of its database, which Global Name Registry provides in Response C17.3. In contrast, the database documentation of ISOC is thin. This may be due to Afilias seeming to rely on a non-commercial PostgreSQL database, and the subsequent lack of available testing tools and competent personnel. It is not stated which database is being used (but one could be led to infer PostgreSQL), nor is it at all documented how the database(s) (if there are several) would interact, replicate or mirror. Database competence is crucial for a registry operator, whose main tasks include full control over the authoritative database for any top-level domain.

Compliance with Specifications

As required by ICANN, the successor operator of the .org registry should ensure full compliance with specifications, including "compliance with at least the following RFCs: 954, 1034, 1035, 1101, 2181, 2182".

ISOC has not answered the RFP Question C17.12 appropriately. In fact, ISOC indicates that it is compliant with a completely different set of RFCs ("2453, 2080, 2328, 2460, 2373, 2463, 2464, 2236, 1812, 1771"), notwithstanding the fact that these RFCs have little or nothing to do with the question. Thus, its solutions are not compliant with the IETF standards and could risk endangering the security and stability of the Internet.

Moreover, according to its bid, ISOC "will be serviced entirely through one of the world's leading DNS providers, UltraDNS", which uses "its own proprietary database". ISOC's reliance on this singular DNS provider carries significant risk for two reasons:

  • From an operational point of view, reliance on only one DNS provider may lead to fragmentation of the Internet.

  • The use of proprietary DNS software and non-compliance with standards (as stated in C17.12, but inconsistent with the statement from C17.4) carries with it an unknown set of vulnerabilities, possible stability problems and security breaches.

Academic CIO Team


The CIO Team was not asked to provide detailed analyses or justifications for its findings and thus provided a summary categorization of its analysis in a three-page report. With little information available on how it compiled its rankings, we find it difficult to comment with specificity on the reliability of its assessments. We can, however, make two general comments regarding process and weight.

Process

We question whether (1) the level of assurance of the understanding of key aspects of the registry services industry was adequate; and (2) it is possible for any group of individuals, no matter how intelligent or diligent, to meaningfully digest comprehensive responses to roughly 53 questions on technical capability within 11 different applications over a limited one and a half day period.

It is impossible to discern from the short report how the team developed a common understanding of "the domain name system, the functions of registries and registrars and an understanding of the RFP process", or managed to carefully review 11 complex applications during this short period. With all due respect to a team comprised of highly educated and well-respected individuals in the information technology industry, the answers provided by Global Name Registry alone to ICANN's 53 technical questions tallied roughly 350 pages (with the entire application totalling approximately 900 pages). If we multiply this number by 11 applications, it would seem almost impossible to be able to fully review, debate, research and resolve any differences.

Weight

Because of the unclear methodology and short time frame for the CIO Team evaluation, we are quite concerned that the Preliminary Report tabulations (Table 2) appear to give the CIO Team report the same weight as the far more detailed reports by Gartner and the NCDNHC. The stated purpose in asking the CIO Team to review the applications was to serve as a check of reasonableness on the Gartner report, and not to serve as an independent basis of evaluation. It should therefore be used in the Preliminary Report only to decide whether or not the Gartner evaluation is "in the ballpark". It should not, particularly in light of the process concerns described above, be used as an independent basis for ranking the applicants in Table 2.

NCDNHC

We appreciate all of the hard work done by the volunteers on the NCDNHC team, but we are concerned by several aspects of the report, particularly:
  • The methodology of measuring the level of public support for specific bidders, and the tabulation of that information, were flawed.

  • The evaluation of different sections of each bid by separate teams led to the inconsistent application of several criteria.

  • Mathematical errors have been found in the derived rankings (notwithstanding concerns about the underlying methodology and consistency).

It has come to light that there were differences among members of the NCDNHC team, and that not all agreed with the approaches taken. We recognize that had there been more time to try to resolve these differences, some - and perhaps all - of the problems we identify below could have been remedied or avoided.

Criterion 6: Public Support

ICANN's Statement of Criteria acknowledged at the outset that Criterion 6 (Public Support) would raise "significant difficulties in ascertaining the level of support for particular .org proposals" (see Criteria for Assessing Proposals). In the NCDNHC report, Milton Mueller acknowledges that:

"Assessing endorsements as a proxy for 'the level of public support' is an inexact process" (see NCDNHC report Annex 2).

It is indeed troubling that the NCDNHC team did not simply attempt to describe the different kinds and number of letters of support that came in for each applicant. Instead, the team tried to devise a system for weighing and counting each letter that turned out to be seriously flawed. This mistake was compounded by the inappropriate weight that was given - perhaps inadvertently - to these scores in the overall rankings.

As Thomas Roessler, President of the ICANN General Assembly (no affiliation with Global Name Registry), wrote to Milton Mueller, a member of the NCDNHC team, on 21 August:

"But as the different approaches and results you guys have produced indicate, these differences were hard to quantify - certainly harder than the differences in other areas of the report. Ultimately, you don't even know what you are comparing: Are you ultimately comparing the efforts made by applicants? Are you comparing the success of similar-size efforts? The numbers you generate that way are necessarily weak. Weaker than the ones from the other parts of the report.

That's why I maintain that it is an extremely bad idea to combine the scores across categories."

The NCDNHC report acknowledges uncertainty about how to count dozens of letters from members of ISOC. While in the end it decided to try and count "ISOC support" as one letter, that decision was inconsistent with the decision to exclude letters from groups with whom other bidders had a relationship, such as the Red Cross's letter of support for Global Name Registry. For the scoring decisions to be consistent, either both, or neither, of the ISOC and Red Cross letters should have been counted.

The issue of trying to determine whether any letters of support for ISOC were from non-members was also mishandled. The NCDNHC team admitted that it had no way to tell whether a letter was from an ISOC member or non-member. As Milton Mueller acknowledged to Thomas Roessler:

"What we can't tell from the evidence is whether the people who added their name to the Class B list were ISOC members or not" (See http://www.icann-ncc.org/pipermail/discuss/2002-August/002730.html.)

As a result, the team arbitrarily decided that "100" of the letters would be deemed to be from non-ISOC members. Under the methodology adopted by the team, each of these letters was counted as 1/5 of a letter from a .org registrant, thereby giving ISOC an extra 20 points that were critical to its overall ranking.

The NCDNHC report also admits qualms about the dozens of letters of support that NeuStar solicited, most of which were form letters that indicated no specific support for that bidder. Rather, the letters indicated that, if NeuStar won, the signatories would want to be part of the advisory process.

For all of these reasons, the only accurate method of evaluating Criterion 6 - within the available timeframe and budget - is to describe the letters of support in terms of bidder, type and number, and then let the ICANN Board draw its own conclusions. To do otherwise is to provide scores and overall rankings that do not reflect the level of support in the .org community, and that skew evaluation of other criteria within the NCDNHC mandate, as well as across the other evaluations. As Milton Mueller wrote:

"The only objective method would be to spend several million dollars and a year to conduct global surveys of non-commercial .org users based on statistically representative samples. Most of whom would be unaware of the whole process of .org reassignment." (See http://www.icann-ncc.org/pipermail/discuss/2002-August/002729.html.)

Inconsistent Criteria

Our review of the NCDNHC report has brought to light inconsistencies in the application of Criteria 4 and 5. In particular, with respect to Differentiation, NCDNHC seemed to have overlooked portions of the Global Name Registry bid that they recognized in other bids, such as our .orgcentre and Causeway Community Foundation, both of which benefit the .org and Internet communities, while differentiating the .org space as a place for non-commercial activities. The NCDNHC also seemed to have overlooked our discussion of cooperative marketing. With respect to Responsiveness, it seems that the NCDNHC similarly awarded other bidders points, while neglecting similar discussions in our bid as well as misunderstanding the purpose and composition of one of our important initiatives, the .org Steering Committee.

Criterion 4: Differentiation

Global Name Registry received two 0s under the category of Differentiation, one for Innovation and the other for Registrars. Because our application contained a comprehensive discussion of elements of our .org vision that addressed both issues, the basis for these determinations is unclear. In addition, we believe that the 4 we received on Positioning should be reconsidered. Either the NCDNHC mis-scored the Global Name Registry bid in the context of these categories, or it mistakenly overlooked key descriptions contained in our application.

Innovation: While the NCDNHC team recognized the pledge by Global Name Registry to commit up to 15% of its .org revenues to programs benefiting the .org and Internet communities, there seemed to be no further investigation of this commitment. We believe, and have received feedback from various members of the non-commercial community within ICANN, that our concept for the .orgcentre and the Causeway Community Foundation are uniquely innovative. In particular, the services of an open resource centre which provides .org registrants with various tools, training and support as to how to develop their presence online have been very well-received by various members of the NCDNHC. The .orgcentre and the Causeway Community Foundation - a fund that will be available to financially support potentially hundreds of projects every year that would grow the .org community and the benefit the broader Internet community - were fully described in Response C38.3 of our bid.

In addition, while the NCDNHC seemed to overlook a key aspect of Global Name Registry's innovative commitments - our cooperative marketing program - it looked favourably upon other applications that contained the same concept. Both Unity and SWITCH received points for their cooperative marketing plan concept where they committed to a specific program, a cooperative advertising program, a registrar relations department and a road show for education of registrars. All of these concepts were described equally in the Global Name Registry bid in Response 38.5.7A.

Registrars: As a registry operator for a currently existing and operational registry, we do not understand the basis for the 0 we received for our understanding of the challenges of leveraging registrar relationships. In fact, on page 15 of its report, NCDNHC states:

"[T]he Committee recognizes that GNR provides such expertise [technology and communications networks] through its relationships with global registrars."

The .name registry has supported more than 60 registrars that sell .name products to end-users. We understand the importance of incentivising registrars to sell our products, and we have established and described, in Response C38.5.7A, our commitment to developing marketing materials and toolkits for .org. To date, we have developed extensive marketing programs and tools to attract end-users because .name is uniquely a space for individuals, an audience to whom registrars have not historically marketed. We live and die by the success of our registrars, and this is a key message in our .org application (see Response C17.11, Customer Service).

Positioning: Although NCDNHC has indicated very clearly that the Global Name Registry bid included a clear brand identity, it appears that our marketing and positioning initiatives were not given fair consideration. Moreover, the NCDNHC team should not discount or underestimate our relationship with the Red Cross. The Red Cross remains committed to helping Global Name Registry build the vision for .org by ensuring that its corporate partners re-energize their .org registrations to focus on their community involvement.

Criterion 5: Responsiveness

There are several procedural issues with respect to the NCDNHC's evaluation of the applications for Responsiveness. First, in addition to the miscalculation of final scores, which clearly and adversely affected Global Name Registry's rank in this regard, in its analysis of this Criterion 5, the NCDNHC awarded 6s to some bidders. There is, however, no mention of a seven-point scale (0-6), which raises the question of whether the team inadvertently applied it only to certain applications.

Second, we believe that if NCDNHC had thoroughly understood the structure of the .org Steering Committee, it would have made a more favourable determination regarding Input/Governance and Services Targeted at Community. Not only does Global Name Registry seek input from the non-commercial community through the .org Steering Committee, but Global Name Registry has developed two separate initiatives, the .orgcentre and the Causeway Community Foundation, specifically designed with the concept of both continuous input and service in mind.

Unfortunately, the NCDNHC group evaluating our bid did not appear to understand the .org Steering Committee concept, described in Response C35(4). Global Name Registry will not have the right to hand pick its members. Rather, as we thought we made clear, the Steering Committee will be comprised of the leadership of the NCDNHC (or whatever successor group emerges from ICANN reform):

"The OSC [.org Steering Committee] will include the leadership of the ICANN's non-commercial constituency and the .org registry, as well as from the .orgcentre and the Causeway Community Foundation... The OSC will be the first liaison mechanism of its kind to be created directly between a registry and the ICANN community... We believe that creation of the OSC is preferable to establishment of a Policy or Advisory Council for several reasons. Done properly, setting up a new council would likely involve complex procedures for selecting and voting upon the members. (see Global Name Registry bid, Response C35(4))"

We believe that this structure would be better than one created solely by Global Name Registry since the individuals participating in the NCDNHC are the most informed and committed to addressing the issues facing the non-commercial community on the Internet. We devised this mechanism in order to ensure accountability by Global Name Registry to the non-commercial community. While as a technical or legal matter the registry operator might be free to reject such guidance, we are well aware that it would be foolish and short-sighted to risk doing so.

Tabulation Errors

As Thomas Roessler and Alexander Svensson pointed out to the NCDNHC team:

"The table on page 14 (responsiveness and governance rankings) is inconsistent in itself. GNR's score should be 27.75 (instead of 26.75, thereby placing GNR on rank 1, ahead of unity with 27.25), while ISOC's score should be 23.25 (instead of 21.75; no ranking changes caused)."

Moreover, Thomas Roessler states:

"By merely averaging ranks, small differences in the originating scores (possibly caused by minor errors - the mistake in GNR's score corresponds to an error of about 3.5%!) are exaggerated in the end result... "

Clearly, errors such as these, while inadvertent, are far from trivial. They require either re-tabulation or invalidation of the scores at issue.

General Counsel's Report


The ICANN General Counsel's report raises questions about Criterion 3 (Enhancement of Competition, in the context of technology) and Criterion 10 (VeriSign Endowment) that we would like to address.

Criterion 3: Enhancement of Competition


Global Name Registry does, in fact, plan to use virtually all of the technology for .org that it has been using to operate the .name registry. Our decision not to use the redundant technology provided by VeriSign that has been used to provide real-time registration in .name, however, does not affect our qualifications in the least. In addition to our comprehensive experience described above under "Gartner: Outsourcing", it should be noted that because VeriSign operates the .org registry on RRP, all of the bidders, including ISOC and NeuStar, will be required to develop and operate new technology to support the .org registry. What is relevant, and should be carefully considered by the ICANN Board, is that:
  • While we have experience in operating a RRP gateway, neither Afilias nor NeuStar currently operates, or has operated, a RRP gateway that can be used for .org.

  • .org will require changes to existing EPP gateways by all applicants, including Global Name Registry, ISOC/Afilias and NeuStar.

  • Those applicants that have proposed a RRP/EPP solution (including Global Name Registry and ISOC/Afilias) will have to develop such a solution, which does not currently exist within any registry system.

  • Adding .org to any registry system will result in changes to a multitude of subsystems, including database schemas, authentication and validation procedures, billing systems, and Whois.

  • Global Name Registry has proven and documented its ability to adapt to new protocols, additionally having already developed technology solutions to support the operation by Afilias in the operation of .info (EPP client in C++).

Furthermore, Global Name Registry owns and operates a state-of-the-art registry system that has been built in-house and designed to serve 50 million domain names and thousands of registrars. The fact that Global Name Registry worked with VeriSign to provide certain SRS services for .name to provide for additional stability and redundancy during the start-up period does not in any way make our experience less formidable than the other operators. In fact, it enhances it and provides even greater depth to our registry knowledge and SRS experience. We now have a unique familiarity with VeriSign's technical teams and systems, which will be vital in successfully transitioning the .org registry. As noted above, Global Name Registry will not rely on the incumbent for any part of the .org operation.

We fully understand that providing near real-time capabilities can be quite demanding. Internally, Global Name Registry has put in place rigorous operational procedures, change control management, and performance standards to ensure that its currently 100% operational near real-time capabilities for DNS, Whois and MX are world-class and operate safely and smoothly on the Internet, even during the crucial start-up period.

Criterion 10: VeriSign Endowment

The General Counsel's report calls into question Global Name Registry's eligibility for the VeriSign endowment, and suggests that it would "somewhat reduce the attractiveness" of our proposal (although have no effect on pricing). It is important to correct two misperceptions: (1) we have never suggested that Global Name Registry itself qualifies for the endowment, and (2) the endowment will have no impact on our ability to fulfil all of the commitments in our proposal.

With respect to eligibility, we have said that we believe the non-profit status of the .orgcentre and/or the Causeway Community Foundation will make one, or both, entities eligible for the endowment.

With respect to uses of the endowment, we have made it clear that the current business model for .org does not depend on the VeriSign endowment. Rather, revenues from .org registrations will be sufficient to support fully funded and extensive operations of the .orgcentre and the Causeway Community Foundation. The additional funds provided by the endowment would only be solicited from ICANN on a matching basis to provide additional support to our non-profit partners to provide additional resources to .org and Internet communities, such as by opening regional .orgcentres in Latin America, Africa and Asia. The matching funds basis was suggested to accord ICANN additional security and control over the appropriate uses of the endowment.

Moreover, to be entirely fair, there should be no qualitative difference between a candidate that seeks the funds on behalf of a non-profit affiliate (Global Name Registry), and one who does not seek the funds at all (e.g., NeuStar), as long as neither is dependent upon the funds for start-up or operating costs.

Conclusion

It is vital that the ICANN Board have all the information relevant to its .org decision before it. We hope that our detailed public comment will help ICANN Staff provide the Board with such a report. At a minimum, the Preliminary Report should be revised to include:

  • A critical assessment of the financial stability and viability of the three top candidates - ISOC, NeuStar and Global Name Registry;

  • A fuller discussion of the most important criteria, particularly respective technical experience and pricing models; and

  • An acknowledgment of the shortcomings of key parts of each evaluation teams' report that results in either re-scoring these elements or invalidating scores that were based on inaccurate or incomplete information.

When this information is included in the final report, the advantages of choosing Global Name Registry, and the drawbacks of selecting another top contender, should be clear:

  • Among the top three contenders identified in the report, we are unique in having a sound financial track record, while the financial problems of both ISOC and NeuStar have been documented. Given uncertainty surrounding actual delivery of the VeriSign endowment, the ICANN Board should not select an applicant, like ISOC, that is dependent upon the funds. (But it can select a candidate like Global Name Registry, whose non-profit affiliates could be eligible to use the funds to enhance existing offerings.)

  • While ISOC may be doing a fine job of developing educational tools and fostering development of Internet standards, in addition to its financial problems it does not have any experience in operating a registry. Although ISOC would be the registry operator of record, it would be so far removed from the operation of the registry that little knowledge, if any, about the technical operations would reside with the operator. To mitigate its lack of registry experience, ISOC has teamed with Afilias. But Afilias, in turn, plans to subcontract its key operations to IBM and UltraDNS.

  • While NeuStar has direct experience operating a registry, it too is facing financial uncertainty, as evidenced by a series of lay-offs this year. And awarding a third top-level domain to NeuStar would not be as pro-competitive as selecting Global Name Registry, which operates only one other TLD and would devote its full energy and resources to just .name and .org. Moreover, as reflected in the NCDNCH report, NeuStar does not appear to have a firm sense of what it will give back to the community, or how it will work with .org registrants to build a namespace that is attractive and meaningful. While there is a synergy in the same registry operating .name (geared to individuals) and .org (focused on communities of individuals and organizations), it is not the case with respect to ".biz and .org."
  • Pricing is a key criterion that distinguishes us from ISOC and NeuStar. Because affordability is so important, we adopted an aggressive pricing policy of up to a 40% discount (US$4.51) based on volume and duration. In comparison, ISOC would charge a flat rate of US$6 and NeuStar would charge a flat rate of US$5.

As we have demonstrated in our .org proposal and emphasised in this comment, we believe that Global Name Registry's financial stability and established corporate structure, coupled with our vision for creating .org as the "Community Capital" and our position as one of the strongest technology providers, makes us the best choice to replace VeriSign as operator of the .org registry.