Hacker Newsnew | past | comments | ask | show | jobs | submit | gerpsh's commentslogin

I


OnlyFonz?


You win the fridge!


I’m getting into Gary Shteyngart. Just read Lake Success and now reading Super Sad True Love Story. Both sort of dark and really funny.


Oh man, Super Sad True Love Story had me seeing its storylines surface in American culture for months. Even new news I’m like; “this is just how it happened in the book!” Great read and great author.


I have a Raspberry Pi 3 that functions as a multi-purpose home server (Pi Hole, laptop backups, data scraping jobs, etc).

I have another 3 running MotionEyeOS that I keep pointed out the front of my house to catch package thieves.


Dude, you're making ScraperAPI requests (with your API key in plain text as a parameter) directly from the client app...this thing is a nice idea but it'd probably be a good idea to clean it up and repost.


I thought these multi-region searches were against Craigslist's terms of service.


Craigslist is famously aggressive about scraping, too. While helping with some university research, I found that their anti-scraping defenses were really difficult to get around.

They've also been litigious about this in the past, so this project would undoubtedly get a cease-and-desist if it ever became a blip on their radar.


I'm guessing that's because of AirBnB and how they got their start by essentially stealing posts from Craigslist.


I thought Padmapper got their start that way, by essentially providing a better apartment hunt interface than CL had at the time.


Which was a shame, because padmapper stuck it on a map and linked to Craigslist, instead of just taking the content. If Google Maps did it nobody would think twice.


CraigsList might make them think twice. I don't think they want to overly exhaust their own resources, what they have works for them.


And they got the banhammer, too.

Not too hard to see where the fulcrum of this "settlement" is: https://www.eff.org/deeplinks/2015/06/padmapper-and-3taps-se...


> I found that their anti-scraping defenses were really difficult to get around

What sort of defenses are they using?


They had fantastic detection of headless Chrome and curl requests, a thorough IP blacklist, aggressive rate limiting, and possibly some JS stuff.


I was a contractor at a company where one of the divisions did Craiglist scraping as part of the business model and they had a closet full of laptops doing the scraping part of the job - thirdhand what I heard was separate PC's were necessary for the anti-scraping workaround they were using.


All scrapey automated stuff is. I doubt this will be alive next week, or tomorrow.


already appears broken.


What a shame to have invested so much in an app that will immediately be shut down by CL.


i'm not seeing this, has it already been cleaned up, or am i missing it?


I clicked on the “search” button.

Then it sent 503 XHR requests:

https://i.imgur.com/R9D23iU.png


I see it.


I know. It’s just a poc


Even a PoC needs basic security before being released publicly. It wouldn't even delay the release by a single day.


Proof of Concept is a vague term and doesn't give you any sort of protection or defense. If it's against Craigslist's terms you're taking on some risk by making and public and promoting it.


> School officials worry that rising tuition and soaring loan balances are pushing new doctors into high-paying fields and contributing to a shortage of researchers and primary care physicians.

I think this is only partially true, because it misunderstands the motivations of many would-be doctors. Sure, the cost of medical education factors into specialty decisions, but as long as derm and ortho are regarded as more _prestigious_ than family med and general peds, you're going to see similar residency application numbers. There's still a social hierarchy within the medical profession, which the price of tuition doesn't immediately change.

Still, this is great for people set on primary care as a career. Interestingly enough, my general observation has been that students who need the money the _least_ (i.e. people whose families are paying for their educations) are the ones who are gunning for the highest paid (and typically most prestigious) specialties.


In my experience, the people who go for the extra money in derm and ortho don't need it from a wealth perspective, but often need it from a social and self-worth perspective.

Over time this dynamic translates into to the prestige gap.


Is derm really about prestige? Or is it about a relatively high salary with little to no on call time and mostly 9-5 hours?


Its important to clarify these arent 'doctors', these are Physicians.

There are doctors of physical therapy who make 60-100k.

Physicians have a government monopoly on prescription and referrals.

The scarcity in MD and DO licenses drives up the cost due to the power granted by the license.


Let's take a specific example. For grad school, I went to a university with a generally well regarded MBA program, which drew on-campus recruiting from MBB. The recruiting process for MBA students was short recruiter interview -> case interviews. Non-MBA students interested in positions at MBB had it a bit different: in between the recruiter interview and the case interviews was an extremely difficult written exam designed to test the candidate's "reasoning" ability. A couple of my (pretty smart) classmates tried to prepare for these exams and eventually took them, failing miserably. They both reported that it was the hardest test they ever took. Both ended up at second-tier consulting firms.

Let's get more general and rigorous. Kellogg Business School professor Lauren Rivera studies the effects of educational credentials on employment opportunity. Her research confirms that educational pedigree is the single most important factor for gaining employment in elite positions in finance, consulting, and law, with the implication that your education is an indication of your social class, and your comfort in the upper echelons of society. [Link to her work] (http://www.kellogg.northwestern.edu/faculty/directory/rivera...)

I would say it's bit ignorant to say that a Harvard MBA has no effect on employability or opportunity.


Comparing MBAs' & undergrads' experiences is specious, at best. And if you're comparing other graduate students against MBAs, the recruiting process for MBB is exactly the same. (source: I did my time at McKinsey, the 'M' in MBB.)

Regarding Prof. Rivera's study, I'm curious whether it attempts to separate causation & correlation. At HBS, the number of ex-MBB consultants in the program is roughly equal to the number who leave into MBB - many swap out and in, but the figures are in the same range. Does she account for that?

Also, any analysis which groups JDs & MBAs together is 100% flawed. Those two may have similar prestige, but wildly different career progressions.


> Comparing MBAs' & undergrads' experiences is specious, at best. And if you're comparing other graduate students against MBAs, the recruiting process for MBB is exactly the same. (source: I did my time at McKinsey, the 'M' in MBB.)

I'm talking about other graduate students, and (at least in this example) the recruiting process is NOT the same. It didn't matter if you were getting a master's in basket weaving or a PhD in physics, you were required to take the test, again at least at this particular university. MBAs were spared the test and went straight to the normal interview process. Also, had you not done an elite MBA, what do you think your path to McKinsey would have consisted of?

> Regarding Prof. Rivera's study, I'm curious whether it attempts to separate causation & correlation. At HBS, the number of ex-MBB consultants in the program is roughly equal to the number who leave into MBB - many swap out and in, but the figures are in the same range. Does she account for that?

Prof. Rivera's research consists of multiple related studies whose findings confirm that, regardless of skills and relevant experience, the most important factor in hiring for elite firms in business and law are educational pedigree, creating a discrepancy in opportunity for those that get an elite education and those that don't. She accomplishes this through ethnographic research on the recruitment practices of the firms.

> Also, any analysis which groups JDs & MBAs together is 100% flawed. Those two may have similar prestige, but wildly different career progressions.

I disagree in this context. The point of her research is that careers which tend to lead to powerful positions in society are practically closed off to those that don't have elite educations. If you want get into high finance or MBB consulting or BigLaw, it behooves you to attend an elite university, and while you're there, do as the Romans do. Prof. Rivera's research is _really_ interesting, you should check it out.


This Onion article really nails this point: http://www.theonion.com/article/unambitious-loser-with-happy...


> Husmer is unlikely to change at this point, and may in fact remain a good-natured and highly fulfilled layabout for the rest of his life.

Great link. The Onion rarely disappoints.


Hmmm, this makes me wonder whether the scores reported on Credit Karma are real or "educational"...


I've always filed them under "educational".

When I was applying for a home loan about a year and a half ago, plus a car loan about a year ago, I got to see my actual TransUnion, Experian, and Equifax scores. At least, the scores the bank saw. My scores were about 30 points higher than Credit Karma.

Now, my current credit card statement gives me a score about 50 points higher than Credit Karma.

I'm pretty sure Credit Karma has always been up front about their scores not being your actual FICO scores.


Section 10 coming soon?


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: