Return-Path: X-Original-To: apmail-ignite-dev-archive@minotaur.apache.org Delivered-To: apmail-ignite-dev-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 1E62A17E14 for ; Fri, 11 Sep 2015 00:39:40 +0000 (UTC) Received: (qmail 49303 invoked by uid 500); 11 Sep 2015 00:39:40 -0000 Delivered-To: apmail-ignite-dev-archive@ignite.apache.org Received: (qmail 49250 invoked by uid 500); 11 Sep 2015 00:39:39 -0000 Mailing-List: contact dev-help@ignite.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@ignite.apache.org Delivered-To: mailing list dev@ignite.apache.org Received: (qmail 49239 invoked by uid 99); 11 Sep 2015 00:39:39 -0000 Received: from Unknown (HELO spamd3-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 11 Sep 2015 00:39:39 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd3-us-west.apache.org (ASF Mail Server at spamd3-us-west.apache.org) with ESMTP id 3E312180425 for ; Fri, 11 Sep 2015 00:39:39 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd3-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 3.751 X-Spam-Level: *** X-Spam-Status: No, score=3.751 tagged_above=-999 required=6.31 tests=[HTML_MESSAGE=3, KAM_INFOUSMEBIZ=0.75, URIBL_BLOCKED=0.001] autolearn=disabled Received: from mx1-us-east.apache.org ([10.40.0.8]) by localhost (spamd3-us-west.apache.org [10.40.0.10]) (amavisd-new, port 10024) with ESMTP id ZJrnX7piX9IW for ; Fri, 11 Sep 2015 00:39:24 +0000 (UTC) Received: from mail-la0-f50.google.com (mail-la0-f50.google.com [209.85.215.50]) by mx1-us-east.apache.org (ASF Mail Server at mx1-us-east.apache.org) with ESMTPS id E18F74456F for ; Fri, 11 Sep 2015 00:39:23 +0000 (UTC) Received: by lahg1 with SMTP id g1so8265401lah.1 for ; Thu, 10 Sep 2015 17:39:16 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:content-type; bh=cUfp4OY6jMzUEdBrluPfOLVIuYooYBKpfXPWpFaDzQk=; b=Kx74QIgCIIzRj3xZaauzkS2vLOfgcbwruZd7Y+m3uOVvjXCXSFhiuoegHvDtumTSJm lj2zP3uyYtrW17lKZVQda7GZVaRVTftqptaqhU7qC6Dh7JBVEDSoBULr49vtho8NWuMB 6RdC5sQ7rJUoiMOuyUmvoPOa9LMcRjLtCN0yto1eCkSKXuy+ICJXqB8flwWSDpo5Xgs/ yUVU+yFgC4mWGaYtr0ihUM47R0WdVHOL3g6Yfl9YQUlTZAAIeCJPp02sQ3GLF7pGtpBS W4HVAjNvlqazKURS7fi+oTvy/sof6pZh16VEwJlWjcSXqSBwlXLxDFRQ+ycIsDyIkWBR 4bBQ== X-Gm-Message-State: ALoCoQn5BgKnioxCDjGgbwJgKqgtTOXCitkmqjf3wEgi55odhuS7qOJtkO3FdF1ng2tV3QUFbrEl X-Received: by 10.112.151.6 with SMTP id um6mr38200666lbb.85.1441931955860; Thu, 10 Sep 2015 17:39:15 -0700 (PDT) MIME-Version: 1.0 Received: by 10.112.9.43 with HTTP; Thu, 10 Sep 2015 17:38:56 -0700 (PDT) In-Reply-To: References: From: Prachi Garg Date: Thu, 10 Sep 2015 17:38:56 -0700 Message-ID: Subject: Re: website changes To: dev@ignite.apache.org Content-Type: multipart/alternative; boundary=047d7b3a80e605138d051f6df2f1 --047d7b3a80e605138d051f6df2f1 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable I've created Google site verification for both, http and https version of Ignite website. I've also added sitemap.xml and robots.txt. If I may, I would like to suggest a server-side 301 redirect from http to https version of the website to ensure that users and search engines are directed to the preferred protocol (I'm guessing https pages are preferred over http pages). Thanks, -Prachi On Tue, Sep 1, 2015 at 5:16 PM, Raul Kripalani wrote: > robots.txt is not functionally important in this context because we don't > have content we want to exclude from crawling. > > But it's always wise to serve at least a generic one because you don't kn= ow > if Google penalises sites that return an HTTP 404 for this file in terms = of > SEO. I wouldn't be surprised if it did. And it's a simple file to add. > > Moreover, I would suggest creating a google-site-verification with a > sitemap controlled by us (if it hasn't been done yet - I'm on mobile now > and it's a pain to check). And also to hint the crawler to also crawl > readme.io and the javadoc. Currently if I google the term IgniteContext I > get the 1.1.0 javadoc page, which tells me that Google needs some hints t= o > crawl more recent javadocs better. > > Regards, > Ra=C3=BAl. > On 2 Sep 2015 00:36, "Dmitriy Setrakyan" wrote: > > > Raul, > > > > Sorry for the late reply, but better late than never :) > > > > On Mon, Aug 24, 2015 at 4:30 AM, Raul Kripalani > wrote: > > > > > wget spider output here: > > > https://gist.github.com/raulk/7d6713aa7b3d21ecaacd > > > > > > No issues with regards to the domain migration, but we have 404 in > > > robots.txt and some jquery JS across many pages. > > > > > > I also ran a spider on our readme.io docs, and it was quite OK except > > that > > > it found these 404s: > > > > > > --2015-08-24 12:16:43-- > > > https://apacheignite.readme.io/docs/distributed-closures%22 HTTP/1.1 > > 404 > > > Not Found > > > --2015-08-24 12:26:04-- > > > > https://apacheignite.readme.io/docs/%7B%7Burl('v'%20+%20v.version)%7D%7D > > > HTTP/1.1 404 Not Found > > > > > > > > Raul, is there a way to find out the referrer pages that have these > links? > > > > > > > With regards to the jquery URL references: > > > > > > --2015-08-24 12:19:31-- > > > http://ignite.apache.org/use-cases/spark/js/jquery-1.11.1.min.js > > > HTTP/1.1 404 Not Found > > > --2015-08-24 12:19:27-- > > > http://ignite.apache.org/use-cases/caching/js/jquery-1.11.1.min.js > > > HTTP/1.1 404 Not Found > > > > > > > Prachi, any chance you can look at these? > > > > > > > > > > Are some examples. I guess these HTMLs are referring to jquery in the > > > context directory rather than in a common directory. > > > > > > Do you think it makes sense to add a robots.txt for SEO purposes? > > > > > > > Raul, I am not sure what we would put into robots.txt. Is there any > benefit > > in having this file vs not having it? > > > > > > > > > > Regards, > > > > > > *Ra=C3=BAl Kripalani* > > > Apache Camel PMC Member & Committer | Enterprise Architect, Open Sour= ce > > > Integration specialist > > > http://about.me/raulkripalani | > http://www.linkedin.com/in/raulkripalani > > > http://blog.raulkr.net | twitter: @raulvk > > > > > > On Mon, Aug 24, 2015 at 10:45 AM, Dmitriy Setrakyan < > > dsetrakyan@apache.org > > > > > > > wrote: > > > > > > > Igniters, > > > > > > > > I have updated the Ignite website to reflect the project graduation > > > (turned > > > > out that many links were not working). > > > > > > > > Would be nice if the community clicked around and verified that all > the > > > > links are working and all the wording and examples are correct. > > > > > > > > Thanks, > > > > D. > > > > > > > > > > --047d7b3a80e605138d051f6df2f1--