[gentoo-user] Caching Proxy alternative to Squid?

[gentoo-user] Caching Proxy alternative to Squid?

[Pandu Poluan]

Hello!

I've been having problems with my Squid-equipped Gentoo box: For some
sites, Squid just times out. But if I access the sites directly, they
appear in my browser. And doing a direct wget from the Squidbox also
works.

Now I'm not sure whose 'fault' it is, but just in case it's Squid's,
I'll experiment with other web proxies.

Unfortunately, the selection in portage seems very limited. Oops,
Polipo, and 3proxy seem to have gone dormant, and Apache Traffic
Server is still Bug#335637 ( http://bugs.gentoo.org/335637 )

So, what can I do?

Rgds,


-- 
--
Pandu E Poluan - IT Optimizer
My website: http://pandu.poluan.info/

Re: [gentoo-user] Caching Proxy alternative to Squid?

[Florian Philipp]

[-- Attachment #1: Type: text/plain, Size: 1862 bytes --]

Am 31.05.2011 19:36, schrieb Pandu Poluan:
> Hello!
> 
> I've been having problems with my Squid-equipped Gentoo box: For some
> sites, Squid just times out. But if I access the sites directly, they
> appear in my browser. And doing a direct wget from the Squidbox also
> works.
> 
> Now I'm not sure whose 'fault' it is, but just in case it's Squid's,
> I'll experiment with other web proxies.
> 
> Unfortunately, the selection in portage seems very limited. Oops,
> Polipo, and 3proxy seem to have gone dormant, and Apache Traffic
> Server is still Bug#335637 ( http://bugs.gentoo.org/335637 )
> 
> So, what can I do?
> 
> Rgds,
> 
> 

Well, apache itself with mod_proxy works reasonably well but it doesn't
support https and ftp, as far as I remember. Make sure to change the
default config. I'll attach my config
(/etc/apache2/modules.d/50_mod_proxy.conf).

<IfModule mod_proxy.c>
  ProxyRequests On

# Allow access from the local net only
  <Proxy *>
    Order deny,allow
    Deny from all
    Allow from 192.168.
    Allow from 127.
  </Proxy>

# Enable/disable the handling of HTTP/1.1 "Via:" headers.
# ("Full" adds the server version;
#  "Block" removes all outgoing Via: headers)
# Set to one of: Off | On | Full | Block
      ProxyVia On

# Enable the cache as well
# (no caching without CacheRoot)
  <IfModule mod_cache.c>
    <IfModule mod_disk_cache.c>
      CacheRoot "/var/cache/apache2/proxy"
      CacheEnable disk /

      # Using many CacheDirLevels makes cache cleanup very slow
      CacheDirLevels 1
      # Using long names can lead to too many files per directory for FS
      CacheDirLength 2
    </IfModule>
  </IfModule>
</IfModule>

There is no size limit for apache's cache. For this, you have to execute
htcacheclean as a cron job.

Hope this helps,
Florian Philipp


[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 262 bytes --]

Re: [gentoo-user] Caching Proxy alternative to Squid?

[Adam Carter]

[-- Attachment #1: Type: text/plain, Size: 529 bytes --]

>
> I've been having problems with my Squid-equipped Gentoo box: For some
> sites, Squid just times out. But if I access the sites directly, they
> appear in my browser. And doing a direct wget from the Squidbox also
> works.
>
> Now I'm not sure whose 'fault' it is, but just in case it's Squid's,
> I'll experiment with other web proxies.
>

No problems with squid here - why not try troubleshooting?
- which version of squid? if arch, have you tried ~arch?
- what does the access and error logs say about the sites that fail?

[-- Attachment #2: Type: text/html, Size: 742 bytes --]

Re: [gentoo-user] Caching Proxy alternative to Squid?

[Florian Philipp]

[-- Attachment #1: Type: text/plain, Size: 795 bytes --]

Am 01.06.2011 03:31, schrieb Adam Carter:
>     I've been having problems with my Squid-equipped Gentoo box: For some
>     sites, Squid just times out. But if I access the sites directly, they
>     appear in my browser. And doing a direct wget from the Squidbox also
>     works.
> 
>     Now I'm not sure whose 'fault' it is, but just in case it's Squid's,
>     I'll experiment with other web proxies.
> 
> 
> No problems with squid here - why not try troubleshooting?
> - which version of squid? if arch, have you tried ~arch?
> - what does the access and error logs say about the sites that fail?
> 

Or even simpler: Tell us Squid users which site it is so we can check it
out. Maybe they dislike HTTP-1.1 Via-headers or something similar.

Regards,
Florian Philipp


[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 262 bytes --]

Re: [gentoo-user] Caching Proxy alternative to Squid?

[Pandu Poluan]

Hi! Sorry for not answering sooner; got sidetracked by other
high-priority job demands...

On 2011-06-01, Florian Philipp <lists@binarywings.net> wrote:
> Am 01.06.2011 03:31, schrieb Adam Carter:
>>     I've been having problems with my Squid-equipped Gentoo box: For some
>>     sites, Squid just times out. But if I access the sites directly, they
>>     appear in my browser. And doing a direct wget from the Squidbox also
>>     works.
>>
>>     Now I'm not sure whose 'fault' it is, but just in case it's Squid's,
>>     I'll experiment with other web proxies.
>>
>>
>> No problems with squid here - why not try troubleshooting?
>> - which version of squid? if arch, have you tried ~arch?
>> - what does the access and error logs say about the sites that fail?
>>
>
> Or even simpler: Tell us Squid users which site it is so we can check it
> out. Maybe they dislike HTTP-1.1 Via-headers or something similar.
>
> Regards,
> Florian Philipp
>
>

Here's one: http://msdn.microsoft.com/en-us/library/aa302323.aspx

--
Pandu E Poluan - IT Optimizer
My website: http://pandu.poluan.info/

Re: [gentoo-user] Caching Proxy alternative to Squid?

[Florian Philipp]

[-- Attachment #1: Type: text/plain, Size: 1304 bytes --]

Am 01.06.2011 22:31, schrieb Pandu Poluan:
> Hi! Sorry for not answering sooner; got sidetracked by other
> high-priority job demands...
> 
> On 2011-06-01, Florian Philipp <lists@binarywings.net> wrote:
>> Am 01.06.2011 03:31, schrieb Adam Carter:
>>>     I've been having problems with my Squid-equipped Gentoo box: For some
>>>     sites, Squid just times out. But if I access the sites directly, they
>>>     appear in my browser. And doing a direct wget from the Squidbox also
>>>     works.
>>>
>>>     Now I'm not sure whose 'fault' it is, but just in case it's Squid's,
>>>     I'll experiment with other web proxies.
>>>
>>>
>>> No problems with squid here - why not try troubleshooting?
>>> - which version of squid? if arch, have you tried ~arch?
>>> - what does the access and error logs say about the sites that fail?
>>>
>>
>> Or even simpler: Tell us Squid users which site it is so we can check it
>> out. Maybe they dislike HTTP-1.1 Via-headers or something similar.
>>
>> Regards,
>> Florian Philipp
>>
>>
> 
> Here's one: http://msdn.microsoft.com/en-us/library/aa302323.aspx
> 
> --
> Pandu E Poluan - IT Optimizer
> My website: http://pandu.poluan.info/
> 

Works without problems with squid-3.1.8 and firefox-4.0.1

Regards,
Florian Philipp


[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 262 bytes --]

Re: [gentoo-user] Caching Proxy alternative to Squid?

[Joost Roeleveld]

On Thursday 02 June 2011 03:31:29 Pandu Poluan wrote:
> 
> Here's one: http://msdn.microsoft.com/en-us/library/aa302323.aspx
> 
> --
> Pandu E Poluan - IT Optimizer
> My website: http://pandu.poluan.info/

Works here:

Squid version = 3.1.8
enabled USE-flags = epoll ipv6 kernel_linux ldap pam ssl

Firefox version = 3.6.17
enables USE-flags = alsa dbus ipc java linguas_de linguas_en linguas_en_GB 
linguas_en_US linguas_fr linguas_it linguas_nl

--
Joost

Re: [gentoo-user] Caching Proxy alternative to Squid?

[Pandu Poluan]

On Thu, Jun 2, 2011 at 14:01, Joost Roeleveld <joost@antarean.org> wrote:
> On Thursday 02 June 2011 03:31:29 Pandu Poluan wrote:
>>
>> Here's one: http://msdn.microsoft.com/en-us/library/aa302323.aspx
>>
>> --
>> Pandu E Poluan - IT Optimizer
>> My website: http://pandu.poluan.info/
>
> Works here:
>
> Squid version = 3.1.8
> enabled USE-flags = epoll ipv6 kernel_linux ldap pam ssl
>
> Firefox version = 3.6.17
> enables USE-flags = alsa dbus ipc java linguas_de linguas_en linguas_en_GB
> linguas_en_US linguas_fr linguas_it linguas_nl
>

Hmmm... I'll try enabling "epoll kernel_linux ldap pam ssl" and updating...

Rgds,
-- 
Pandu E Poluan
~ IT Optimizer ~
Visit my Blog: http://pepoluan.posterous.com
Google Talk:    pepoluan
Y! messenger: pepoluan
MSN / Live:      pepoluan@hotmail.com (do not send email here)
Skype:            pepoluan
More on me:  My LinkedIn Account  My Facebook Account

Re: [gentoo-user] Caching Proxy alternative to Squid?

[Pandu Poluan]

On Fri, Jun 3, 2011 at 13:48, Pandu Poluan <pandu@poluan.info> wrote:
> On Thu, Jun 2, 2011 at 14:01, Joost Roeleveld <joost@antarean.org> wrote:
>> On Thursday 02 June 2011 03:31:29 Pandu Poluan wrote:
>>>
>>> Here's one: http://msdn.microsoft.com/en-us/library/aa302323.aspx
>>>
>>> --
>>> Pandu E Poluan - IT Optimizer
>>> My website: http://pandu.poluan.info/
>>
>> Works here:
>>
>> Squid version = 3.1.8
>> enabled USE-flags = epoll ipv6 kernel_linux ldap pam ssl
>>
>> Firefox version = 3.6.17
>> enables USE-flags = alsa dbus ipc java linguas_de linguas_en linguas_en_GB
>> linguas_en_US linguas_fr linguas_it linguas_nl
>>
>
> Hmmm... I'll try enabling "epoll kernel_linux ldap pam ssl" and updating...
>

No joy.

Apache TS, then :-)

Rgds,
-- 
Pandu E Poluan
~ IT Optimizer ~
Visit my Blog: http://pepoluan.posterous.com
Google Talk:    pepoluan
Y! messenger: pepoluan
MSN / Live:      pepoluan@hotmail.com (do not send email here)
Skype:            pepoluan
More on me:  My LinkedIn Account  My Facebook Account

Re: [gentoo-user] Caching Proxy alternative to Squid?

[kashani]

On 6/2/2011 11:48 PM, Pandu Poluan wrote:
> On Thu, Jun 2, 2011 at 14:01, Joost Roeleveld<joost@antarean.org>  wrote:
>>
>> Works here:
>>
>> Squid version = 3.1.8
>> enabled USE-flags = epoll ipv6 kernel_linux ldap pam ssl
>>
>> Firefox version = 3.6.17
>> enables USE-flags = alsa dbus ipc java linguas_de linguas_en linguas_en_GB
>> linguas_en_US linguas_fr linguas_it linguas_nl
>>
>
> Hmmm... I'll try enabling "epoll kernel_linux ldap pam ssl" and updating...

	My question is why did you mess with the defaults? epoll should have 
been enabled unless you wanted to make Squid 100x slower.

kashani

Re: [gentoo-user] Caching Proxy alternative to Squid?

[Pandu Poluan]

On Fri, Jun 3, 2011 at 14:57, kashani <kashani-list@badapple.net> wrote:
> On 6/2/2011 11:48 PM, Pandu Poluan wrote:
>>
>> On Thu, Jun 2, 2011 at 14:01, Joost Roeleveld<joost@antarean.org>  wrote:
>>>
>>> Works here:
>>>
>>> Squid version = 3.1.8
>>> enabled USE-flags = epoll ipv6 kernel_linux ldap pam ssl
>>>
>>> Firefox version = 3.6.17
>>> enables USE-flags = alsa dbus ipc java linguas_de linguas_en
>>> linguas_en_GB
>>> linguas_en_US linguas_fr linguas_it linguas_nl
>>>
>>
>> Hmmm... I'll try enabling "epoll kernel_linux ldap pam ssl" and
>> updating...
>
>        My question is why did you mess with the defaults? epoll should have
> been enabled unless you wanted to make Squid 100x slower.
>
> kashani
>
>

Well it's neither specified nor disabled, so I just put in the
keywords in make.conf, hoping it will be the 'magic spell incantation'
needed to solve my problem.

But apparently not *sigh*

Rgds,
-- 
Pandu E Poluan
~ IT Optimizer ~
Visit my Blog: http://pepoluan.posterous.com

Re: [gentoo-user] Caching Proxy alternative to Squid?

[Pandu Poluan]

On Fri, Jun 3, 2011 at 14:50, Pandu Poluan <pandu@poluan.info> wrote:
> On Fri, Jun 3, 2011 at 13:48, Pandu Poluan <pandu@poluan.info> wrote:
>> On Thu, Jun 2, 2011 at 14:01, Joost Roeleveld <joost@antarean.org> wrote:
>>> On Thursday 02 June 2011 03:31:29 Pandu Poluan wrote:
>>>>
>>>> Here's one: http://msdn.microsoft.com/en-us/library/aa302323.aspx
>>>>

--- snip ---

>>
>> Hmmm... I'll try enabling "epoll kernel_linux ldap pam ssl" and updating...
>>
>
> No joy.
>
> Apache TS, then :-)
>

Oookay... something's wrong with the box itself...

Even Apache TS failed for the pages where Squid failed o_O

Time to rebuild the box, then >.<

Rgds,
-- 
Pandu E Poluan
~ IT Optimizer ~
Visit my Blog: http://pepoluan.posterous.com
Google Talk:    pepoluan
Y! messenger: pepoluan
MSN / Live:      pepoluan@hotmail.com (do not send email here)
Skype:            pepoluan
More on me:  My LinkedIn Account  My Facebook Account

Re: [gentoo-user] Caching Proxy alternative to Squid?

[Peter Humphrey]

On Thursday 02 June 2011 08:01:30 Joost Roeleveld wrote:

> Works here:
> 
> Squid version = 3.1.8
> enabled USE-flags = epoll ipv6 kernel_linux ldap pam ssl
> 
> Firefox version = 3.6.17
> enables USE-flags = alsa dbus ipc java linguas_de linguas_en
> linguas_en_GB linguas_en_US linguas_fr linguas_it linguas_nl

What is USE flag kernel_linux? It doesn't appear on my systems.

-- 
Rgds
Peter

Re: [gentoo-user] Caching Proxy alternative to Squid?

[Joost Roeleveld]

On Friday 03 June 2011 10:30:25 Peter Humphrey wrote:
> On Thursday 02 June 2011 08:01:30 Joost Roeleveld wrote:
> > Works here:
> > 
> > Squid version = 3.1.8
> > enabled USE-flags = epoll ipv6 kernel_linux ldap pam ssl
> > 
> > Firefox version = 3.6.17
> > enables USE-flags = alsa dbus ipc java linguas_de linguas_en
> > linguas_en_GB linguas_en_US linguas_fr linguas_it linguas_nl
> 
> What is USE flag kernel_linux? It doesn't appear on my systems.

I believe it's a default one telling the ebuild that it runs on Linux :)

--
Joost

Re: [gentoo-user] Caching Proxy alternative to Squid?

[Stroller]

On 3 June 2011, at 09:59, Pandu Poluan wrote:
> ...
> Oookay... something's wrong with the box itself...
> 
> Even Apache TS failed for the pages where Squid failed o_O
> 
> Time to rebuild the box, then >.<

emerge -e everything!

Re: [gentoo-user] Caching Proxy alternative to Squid?

[Florian Philipp]

[-- Attachment #1: Type: text/plain, Size: 522 bytes --]

Am 04.06.2011 02:54, schrieb Stroller:
> 
> On 3 June 2011, at 09:59, Pandu Poluan wrote:
>> ...
>> Oookay... something's wrong with the box itself...
>>
>> Even Apache TS failed for the pages where Squid failed o_O
>>
>> Time to rebuild the box, then >.<
> 
> emerge -e everything!
> 

That doesn't help if some config file is bogus.

However, before doing anything drastic, I'd boot a live-cd or a virtual
machine and check if it works there. Maybe it is a network issue.

Regards,
Florian Philipp


[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 262 bytes --]

RE: [gentoo-user] Caching Proxy alternative to Squid?

[Pandu Poluan]

-original message-
Subject: Re: [gentoo-user] Caching Proxy alternative to Squid?
From: Florian Philipp <lists@binarywings.net>
Date: 2011-06-04 15:45

Am 04.06.2011 02:54, schrieb Stroller:
>> 
>> On 3 June 2011, at 09:59, Pandu Poluan wrote:
>>> ...
>>> Oookay... something's wrong with the box itself...
>>>
>>> Even Apache TS failed for the pages where Squid failed o_O
>>>
>>> Time to rebuild the box, then >.<
>> 
>> emerge -e everything!
>> 

Far easier to install a box from scratch then swap the IP addresses :)

>That doesn't help if some config file is bogus.

Well, my config file has passed the check by the Squid people, so it's certainly not that...

>However, before doing anything drastic, I'd boot a live-cd or a virtual
>machine and check if it works there. Maybe it is a network issue.
>
>Regards,
>Florian Philipp

Well, wget works. So it's not *strictly* a network issue.

Yet there might be light at the end of the tunnel... A guy in the Netfilter mailing list had indirectly given me a probable solution; he's been having trouble accessing www.apple.com through the proxy (and actually, www.apple.com is also one of the sites I can't access via my proxy box). He managed to make his proxy work by adding a rule to iptables to allow incoming access to port 80. Despite having no web server listening at that port.

Doesn't really make sense, I know: why the heck does a target web server need access to *my* port 80, but it worked after all.

So, come Monday, I'm going to change the policy for incoming port 80 from DROP to REJECT or ACCEPT, and we'll see if there's going to be joy in mudville :)

Rgds,
--
Pandu E Poluan
~ IT Optimizer ~

Sent from Nokia E72-1

Re: [gentoo-user] Caching Proxy alternative to Squid?

[Stroller]

On 4 June 2011, at 09:45, Florian Philipp wrote:
> Am 04.06.2011 02:54, schrieb Stroller:
>> 
>> On 3 June 2011, at 09:59, Pandu Poluan wrote:
>>> ...
>>> Oookay... something's wrong with the box itself...
>>> 
>>> Even Apache TS failed for the pages where Squid failed o_O
>>> 
>>> Time to rebuild the box, then >.<
>> 
>> emerge -e everything!
> 
> That doesn't help if some config file is bogus.

In which case there's no point in reinstalling, either.

Stroller.

Re: [gentoo-user] Caching Proxy alternative to Squid?

[Florian Philipp]

[-- Attachment #1: Type: text/plain, Size: 748 bytes --]

Am 04.06.2011 23:03, schrieb Stroller:
> 
> On 4 June 2011, at 09:45, Florian Philipp wrote:
>> Am 04.06.2011 02:54, schrieb Stroller:
>>>
>>> On 3 June 2011, at 09:59, Pandu Poluan wrote:
>>>> ...
>>>> Oookay... something's wrong with the box itself...
>>>>
>>>> Even Apache TS failed for the pages where Squid failed o_O
>>>>
>>>> Time to rebuild the box, then >.<
>>>
>>> emerge -e everything!
>>
>> That doesn't help if some config file is bogus.
> 
> In which case there's no point in reinstalling, either.
> 
> Stroller.
> 
> 

If you start from scratch and don't migrate any config files, hidden
directories in /home/* etc., then it might - unless you repeat your
mistake, of course.

Regards,
Florian Philipp


[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 262 bytes --]