Link to the exercises:
<a href="https:&#x2F;&#x2F;developers.google.com&#x2F;machine-learning&#x2F;crash-course&#x2F;exercises" rel="nofollow">https:&#x2F;&#x2F;developers.google.com&#x2F;machine-learning&#x2F;crash-course&#x2F;...</a>

the deep nets and conv nets stuff was excellent. i wish the explanation of rnns was a little better.

For those interested in a deeper dive to just deep learning, &quot;Tensorflow and deep learning - without a PhD&quot; is really good, and covers a lot of material in a single 2hr talk.<a href="https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=vq2nnJ4g6N0" rel="nofollow">https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=vq2nnJ4g6N0</a>

Clicking through to the homepage, the full title is: &quot;Machine Learning Crash Course with TensorFlow APIs&quot;.

Which languages and libraries does it use? Is it based in Google libs, like Tensor Flow?

This has been an internal course at Google for many years.

Also 4) will increment the usage of TPU&#x27;s on Google Cloud Platform and subsequently the revenue of their cloud offerings.

IMO teaching people ML is good in general for Google. 1. it spreads the use of tensorflow, 2. it increases not only tensorflow, but also Google&#x27;s mindshare, 3. it trains people that may become future Google employees, and&#x2F;or serves as a useful resource for existing employees

I wonder if they are doing this to complete with course.fast.ai

I&#x27;ve been itching to learn a bit about the industry and to be able to create &amp; train ML models myself; I&#x27;m glad Google decided to put out a course where I wouldn&#x27;t have to worry about the quality of instruction.

On the positive side with PyTorch you don’t need nearly as much documentation as you would with TF. TF in general feels like it’s fighting you every step of the way. There’s a lot of cognitive overhead. Not so with PyTorch. Everything is straightforward, and can be run&#x2F;examined in ipython.

Except there aren&#x27;t many good resources to learn it and the documentation isn&#x27;t very good. Hopefully this will improve soon.

Unless you have already invested a lot of time into learning (and building on top of) TF, I would advise to pick up PyTorch. It’s much easier to learn and use (imperative!), and has higher performance on common workloads.

I went through the first a couple of topics. It seemed very disjointed. Different people presenting, different exercises. Was it like this internally? Or is this heavily &quot;annotated&quot;?

As someone who just did this internally:Do it. It&#x27;s worth your time. Very well paced exercises, and it walks you through the flow quite nicely.

Isn&#x27;t this meant to be an introduction? I&#x27;m not sure who comes out of a crash course assuming they&#x27;re an expert.

&gt; &quot;you can&#x27;t use AI&#x2F;ML unless you have a PhD&#x2F;5 years research experience&quot;This is not true since a few years ago. But the fact that you can use it doesn&#x27;t mean you understand what is happening and why it works in development but not in production. Everybody can copy a jupyter notebook and train a TensorFlow model in ImageNet. Now go to a new domain with very few information like 3D models and create a new network to be trained in that dataset. How many people that can train ImageNet can do the latter? Even inside deep learning experts in image classification fail in reinforcement learning domains and need a couple of years to be completely productive.

No but you&#x27;ll ready yourself for the (geometric) programming of the next twenty years or so.

I have a feeling that they&#x27;re trying to get people familiar with TensorFlow and thus very compatible with their cloud computing services.

Look at it from an interview perspective. If I ask &quot;are you interested in exploring ML&quot;, and you&#x27;re enthusiastic, my next questions are : What have you done? Have you taken any courses? GitHub? Blog Posts?If the answer is that you&#x27;re waiting for a special sign that it&#x27;s worth doing before making an effort, then that really tells me that your enthusiasm for doing ML is not reality-based. Doing the ML thing is a pretty different mindset from other software jobs.

&gt; The obsolete gatekeeping by the AI&#x2F;ML elites who say &quot;you can&#x27;t use AI&#x2F;ML unless you have a PhD&#x2F;5 years research experience&quot; is one of the things I really hate about the industry.So what are they hoping to achieve with this course? I&#x27;m genuinely asking because part of me wants to take the course, but another part of me feels like what&#x27;s the point if, even through many additional courses to build up a skill set, Google wouldn&#x27;t hire you as an ML engineer unless you basically start your career back to a junior engineer but in machine learning at another company.

You probably can&#x27;t communicate effectively. If you are describing &quot;Type two error&quot; of course you will get eyes glossing over. A huge problem with research fields is their terse banal labels. Confusion matrix anyone?

For anyone else who wondered what the Jaccard index is, it&#x27;s also referred to as Intersection over Union....and if you haven&#x27;t come across that either, see <a href="https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Jaccard_index" rel="nofollow">https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Jaccard_index</a> for details.

What&#x27;s a &quot;type two&quot; error?I had to google it. It&#x27;s a false negative.A &quot;Type 1&quot; error, is a false positive.Is this like how people overuse the term &quot;orthogonal&quot;?

I took a machine learning graduate-level course from Andrew Ng himself, and I don&#x27;t recall learning about Jaccard indexes or topic drift. Maybe your sense of what counts as &quot;very, very, very basic&quot; is skewed toward your own experience. There&#x27;s a phenomenon known to psychologists where people tend to think that the stuff that they know is very easy and basic, so they conclude that anybody who doesn&#x27;t know what they know must be uneducated. But then it turns out that the person you think is uneducated knows about a bunch of surprising stuff that you don&#x27;t. I can&#x27;t remember the term for this phenomenon, but I often remember it whenever I find myself beginning to judge another person&#x27;s expertise. This phenomenon is also super relevant to the failings of most technical interviews, in my opinion.

&gt; Jaccard indexesFunny you mention Jaccard; I was looking up if IoU (Intersection over Union) has any other name known to ML people when I was preparing my self-driving car presentation (IoU is used in semantic segmentation), and found out it is called Jaccard index as well. To my surprise, all ML experts I know knew about IoU but nobody about Jaccard. I guess it might depend on which university you attended?

Was the project the person was working on having any success? If so, you might be unfairly ignoring their positive contributions and focusing only on this one negative sign that you observed.

My ML model is 99.7% sure you&#x27;re a gatekeeper. Might be a type 1 error, though.

Unless you work for a company obviously known for their ML the &quot;expertise&quot; out there right now is brutal. People are building recommendation engines without knowing the very, very, very basics like Jaccard indexes, ROC Curves, or topic drift. I&#x27;ve even had to explain type two error to someone working on one of these before.I agree with your general thrust, and you&#x27;re right, messy data is often 95% of the problem, but even going through just the Google courses will put people in the top 15% in most cities.

Even people getting a quickie masters is hit&#x2F;miss in my experience. At the end of the day, successful machine learning engineers require a whole suit of different skills, both technical, communicative, and even life skills that don&#x27;t really exist for software devs. Not all those can be taught in 3 months, 2 years or even 6 years.

I agree with this comment. My experience has been that people don&#x27;t really look at your resume unless you have machine learning experience on your resume or one of the stats type majors

Gate keeping is only obsolete when it ceases to have impact. The reality right now is that ML is extremely hard to enter even for a very knowledgeable and deeply experienced but non-credentialed (by degree) person.It will be interesting to see how the situation evolves but my own observations are that people trying to enter the space might be better off getting a quickie masters if they can afford the time or cost than to try and bootstrap it.

Understanding NNs is easy. Understanding, collecting, and cleaning up data is the hard part.Also, DL != ML.Paraphrasing &quot;The Tao of Network Protocols&quot;: If all you see is DL, you see nothing.

I fully agree with you that after a MOOC you&#x27;ve barely scratched the surface and until you&#x27;re implementing them yourself then you&#x27;re not going to jump into a ML job.However personally I view the rest of the opposite way round. Getting through a course on Deep Learning takes months [0]. Then reading through Keras code once you understand the appropriate NNs is easy.For example it takes a while of going through Neural Networks to understand ResNets. But if you understand ResNets then looking though Keras code that creates a ResNet [1] is easy.If I want to build a NN of any sort in Keras I can just Google for it. However there&#x27;s no simple Googling you can do to teach yourself NN in an easy to follow structured way.[0]: <a href="https:&#x2F;&#x2F;www.deeplearning.ai&#x2F;" rel="nofollow">https:&#x2F;&#x2F;www.deeplearning.ai&#x2F;</a>[1]: <a href="https:&#x2F;&#x2F;github.com&#x2F;Hyperparticle&#x2F;one-pixel-attack-keras&#x2F;blob&#x2F;master&#x2F;networks&#x2F;resnet.py" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;Hyperparticle&#x2F;one-pixel-attack-keras&#x2F;blob...</a>

Exactly. Somewhat akin to graphics programming. There are much smaller groups that work on actually building 3D graphics engines, however, many developers take those engines and use them to build successful applications and games.

Will we reach a state where ML is as accessible for implementers as SQL databases? I still remember the time when databases were only for experts.

They really don&#x27;t. There is a link to the Wikipedia page for matrix multiplication. If these are the people you want to hire, you might as well start outsourcing or generating random numbers

&gt;you can reasonably work under PhD level people and write code to test, scale, and deploy their ideas.Which phd, though? All PhDs are not equal (see politics vs computer vision). Also, PhDs are hardly the holy grail of demonstrating capability, accuracy or intellect, especially given the reproducibility crisis, phds as a measure of any of those things should be used carefully.

We have to separate AI researcher and implementation engineer. These types of crash courses help get you to the point where you can reasonably work under PhD level people and write code to test, scale, and deploy their ideas.For many current applications of ML this is acceptable because you&#x27;re just stealing an idea from a paper or stealing ImageNet to recognize your problem. For anything else you really need to pay up and fight with Google for a real expert.

TLDR: Taking a class is fine, but nothing beats real-world practice.Wonder where I&#x27;ve heard this one before. :)

I can&#x27;t help but think in 3-5 years how quaint our tools of the day will seem.

What&#x27;s an example of a problem that needs that troubleshooting? (Curious)

&gt; It is also absolutely true, in my experience, that you need a graduate-level education or years of hands-on experience to troubleshoot cases where AI&#x2F;ML fails on a deceptively-simple problem, or to tweak an AI&#x2F;ML algorithm (or develop a new one) so it can solve a novel problem.How much of that is critical domain specific knowledge and how much of that is just general engineering debugging&#x2F;problem solving experience though? Certainly the person who does have the masters&#x2F;PhD and a few years of applying that to real-world ML problems will have the edge but an experienced developer who&#x27;s got a knack for maths (though no direct ML experience) may be able to get up to speed quicker than you think. Part of that will be experience with knowing how and when to ask the right questions when you get stuck.

&gt; The obsolete gatekeeping by the AI&#x2F;ML elites who say &quot;you can&#x27;t use AI&#x2F;ML unless you have a PhD&#x2F;5 years research experience&quot; is one of the things I really hate about the industry.It is absolutely true that you do not need a graduate degree to apply AI&#x2F;ML to vanilla problems.It is also absolutely true, in my experience, that you need a graduate-level education or years of hands-on experience to troubleshoot cases where AI&#x2F;ML fails on a deceptively-simple problem, or to tweak an AI&#x2F;ML algorithm (or develop a new one) so it can solve a novel problem.That said, I think these MOOCs are good enough to get someone to a place where they can create nice &#x2F;r&#x2F;dataisbeautiful-style visualizations, or pair with a senior-level DS to deliver something.(Edited to add folks who have worked on problems for years and add a final note.)

Why? Most of that cruft is abstracted away, computation only gets cheaper over time (a world class AI rig cost ~30k, a decent one for 2k) and most applications of ML run on commodity hardware.

Why does an ML-expert need to know the halting problem?Considering that ML is really a CS-oriented form of statistics, why would you expect a statistician to know CS theory?

&gt; But if so-called ML experts don&#x27;t even know undergraduate computer scienceTo be fair, Machine learning seems more closely related to applied mathematics - statistics&#x2F;optimization than to computer science.

Maybe I&#x27;m an iconoclast, but I&#x27;d respect that person more for not trying to bullshit his way out of it.

How does knowing that it&#x27;s impossible to predict whether an infinite loop exists in a piece of code yield an actionable piece of wisdom that this ML expert should have?I&#x27;d suppose that most developers, formal education or not, would have encountered an infinite loop at some point in their initial work with iteration or recursion.How does knowing that Turing proved you can&#x27;t predict this bug in a piece of code change anything?I might genuinely be missing something important here - not trying to be snarky in my questioning.It seems like obviously infinite loops are a disastrous bug for critical code - but what does knowing the formal name of the problem and background of its discovery give you?I could understand if you were arguing in favor of test code or static analysis.

I could have the same reverse worldview:&quot;I attended a big software dev conference. Someone I met did not know about data bias. They heard of gradient boosting but nothing more than hearing them. If so-called dev experts don&#x27;t even know undergraduate statistics, that should really give you pause before you open up your wallet for them.&quot;

The other day I met with someone who was visiting my city to attend a big ML conference. In the course of our discussion, it transpired this person did not know the Halting Problem. He&#x27;d &quot;heard of&quot; Turing machines, but nothing more than &quot;hearing&quot; of them.Gatekeepers shouldn&#x27;t keep gates just for gatekeeping sake. But if so-called ML experts don&#x27;t even know undergraduate computer science, that should really give you pause before you open up your wallet for them.

&gt; Yes, AI&#x2F;ML MOOCs teach the corresponding tools well, and the creation of new tools like Keras make the field much more accessible. The obsolete gatekeeping by the AI&#x2F;ML elites who say &quot;you can&#x27;t use AI&#x2F;ML unless you have a PhD&#x2F;5 years research experience&quot; is one of the things I really hate about the industry.The problem is that having a hammer makes one see everything as a nail. Sure, given a suitably clean set of images, anyone who&#x27;s done a couple of tutorials will be able to apply a pre-trained neural on them to get something.The hard part is getting an understanding of what tweaks to use when, and when to give up on a method. Otherwise, it is very easy to get carried away and waste time&#x2F;resources.For that, one needs to develop a good understanding of the landscape of ML algorithms, why each of them works and how they could break. That typically takes (intensive) experience or an understanding of the theory. Otherwise you&#x27;ll be doing a brute-force search through a list of possible algorithms. As they say, &quot;a few days in the lab might save a few hours in the library...&quot;Yes, things can get painful during hiring because the process is broken as it is, with additional complications due to not knowing how to vet for quality in a nascent field. But the &quot;ML elite&quot; are not morons and they don&#x27;t mean to be obnoxious gatekeepers.

The real barrier to entry to ML is statistics. Most computer science degrees require an intro to statistics class, but if you really want to understand ML and where it should and can be applied appropriately you need a much deeper understanding.IMO, it&#x27;s much easier to pick up the programming required for ML than the statistics. This was reflected in the classes I took as a double statistics&#x2F;computer science major. Most of the people in my CS department&#x27;s machine learning course were statistics students looking to go into data science, not computer programmers looking to get in on the ML trend.

&gt; taking and passing a crash course doesn&#x27;t mean you&#x27;ll be an expert in the field (and this applies for most MOOCs, honestly)Any field that you can become an expert in with a 6-week course or less is not a field that should be paying even high 5-figure salaries. Or, conversely, any field which pays 6-figure salaries is either not accessible via an MOOC, or is massively overinflated and probably in a bubble.

&gt; taking and passing a crash course doesn&#x27;t mean you&#x27;ll be an expert in the field (and this applies for most MOOCs, honestly)You&#x27;re stating the painfully obvious here. I doubt anyone reading HN is under the impression that they&#x27;ll be an expert after a single online course.This is just a marketing stunt by Google to ensure their tooling is the defacto standard for AI&#x2F;ML so that Google can dominate the AI&#x2F;ML market they way they dominated Internet Search.

&gt; The obsolete gatekeeping by the AI&#x2F;ML elites who say &quot;you can&#x27;t use AI&#x2F;ML unless you have a PhD&#x2F;5 years research experience&quot; is one of the things I really hate about the industry.It&#x27;s the main reason why I decided to present a talk at the next PyCon Italy, as a very junior data scientist, to inspire other Python developers to learn some practical machine learning. If I could do it (and use it for a work project already) many other people can do (and no, I don&#x27;t even have a degree in CS, just years of work experience)

&gt;&gt; The obsolete gatekeeping by the AI&#x2F;ML elites who say &quot;you can&#x27;t use AI&#x2F;ML unless you have a PhD&#x2F;5 years research experience&quot; is one of the things I really hate about the industry.I&#x27;m going to have to ask who exactly are those AI&#x2F;ML elites who say &quot;you can&#x27;t use AI&#x2F;ML unless you have a PhD&#x2F;5 years research experience&quot;.

Looking through the topics covered, the standard AI-course caveats (<a href="https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=16247629" rel="nofollow">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=16247629</a>) apply.Yes, AI&#x2F;ML MOOCs teach the corresponding tools well, and the creation of new tools like Keras make the field much more accessible. The obsolete gatekeeping by the AI&#x2F;ML elites who say &quot;you can&#x27;t use AI&#x2F;ML unless you have a PhD&#x2F;5 years research experience&quot; is one of the things I really hate about the industry.However, contrary to the thought pieces that tend to pop up, taking and passing a crash course doesn&#x27;t mean you&#x27;ll be an expert in the field (and this applies for most MOOCs, honestly). They&#x27;re very good for learning an overview of the technology, but nothing beats applying the tools on a real-world, noisy dataset, and solving the inevitable little problems that crop up during the process.Reviewing the Keras documentation (<a href="https:&#x2F;&#x2F;keras.io" rel="nofollow">https:&#x2F;&#x2F;keras.io</a>) and examples (<a href="https:&#x2F;&#x2F;github.com&#x2F;keras-team&#x2F;keras&#x2F;tree&#x2F;master&#x2F;examples" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;keras-team&#x2F;keras&#x2F;tree&#x2F;master&#x2F;examples</a>) are honestly much better teachers of AI&#x2F;ML than any MOOC, in my opinion.(Of course, Keras is now a part of TensorFlow, so there&#x27;s a neat Google vertical intergration with this crash course!)

I agree.I expect that as companies increase their focus on finding practical applications of ML &#x2F; AI, the topic will start to get more attention in these tutorials, as well as from researchers. Right now, too many people assume you already have a feature matrix, which is rarely the case when working on real world problems.

Although I&#x27;m normally skeptical of AI&#x2F;ML courses, that section on feature engineering do&#x27;s-and-do-nots is new and surprisingly under-discussed. It&#x27;s very useful even outside of AI&#x2F;ML.

OTOH, automating feature engineering is a thing. There are papers on using unsupervised methods to do that.The 1st place in Kaggle&#x27;s Porto Seguro competition trained an Autoencoder on raw data to extract features.

10 seconds into the video of feature engineering they say that feature engineering takes up about 75% of the time <a href="https:&#x2F;&#x2F;developers.google.com&#x2F;machine-learning&#x2F;crash-course&#x2F;representation&#x2F;video-lecture" rel="nofollow">https:&#x2F;&#x2F;developers.google.com&#x2F;machine-learning&#x2F;crash-course&#x2F;...</a>They understand the value, but but if you keep watching, they don’t seen go beyond the basic.

Your comment got me interested in this course. However, all I could find about feature engineering there is what you linked to, directly.Given that entire scientific careers, books, and conferences are built around the topic of feature engineering, and at least IMO good ML tools live or die with good feature engineering (in its broadest sense, for you deep learning fanatics :-)) that doesn&#x27;t seem like more than the bare minimum I&#x27;d expect from any ML &quot;crash-course&quot; that is to be taken serious (and I wouldn&#x27;t expect an ounce less from Google... :-)).Am I missing something, maybe?In any case, nice work of your own, and thanks for sharing it!

How do you select features created with featuretools? The problem with automated feature engineering is that you end with too many irrelevant features, and I haven&#x27;t found a good guide on feature selection.

Great to see they have a nice introductory section to feature engineering! Feature engineering is often the most impactful thing you can do to improve quality of models and a place where I often see beginners (and experts for that matter) get stuck. Google walks through how to work with json files and categorical variables <a href="https:&#x2F;&#x2F;developers.google.com&#x2F;machine-learning&#x2F;crash-course&#x2F;representation&#x2F;feature-engineering" rel="nofollow">https:&#x2F;&#x2F;developers.google.com&#x2F;machine-learning&#x2F;crash-course&#x2F;...</a>.If anyone is looking to get more indepth, I work on an open source python library for automated feature engineering called Featuretools <a href="https:&#x2F;&#x2F;github.com&#x2F;featuretools&#x2F;featuretools&#x2F;" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;featuretools&#x2F;featuretools&#x2F;</a>. It can help when your data is more complex such as when it comprised of multiple tables.We have several demos you can run yourself to apply it to real datasets here: <a href="https:&#x2F;&#x2F;www.featuretools.com&#x2F;demos" rel="nofollow">https:&#x2F;&#x2F;www.featuretools.com&#x2F;demos</a>.

Having done this course 6 months ago, this is a fantastic introduction to the major concerns of practical machine learning.

<a href="http:&#x2F;&#x2F;p.migdal.pl&#x2F;2017&#x2F;04&#x2F;30&#x2F;teaching-deep-learning.html" rel="nofollow">http:&#x2F;&#x2F;p.migdal.pl&#x2F;2017&#x2F;04&#x2F;30&#x2F;teaching-deep-learning.html</a> -&gt; &quot;What mathematicians thing I do&quot;(Full disclaimer - I did theoretical physics, so understand both sides. :))

It sounds like you are describing curves that are strictly convex. Curves that are convex, but not strictly convex, can intersect their tangents at more than one point, or even at every point.I&#x27;m going by the definition of convex function given in Rudin&#x27;s &quot;Principles of Mathematical Analysis&quot;, Apostol&#x27;s &quot;Calculus&quot;, Wikipedia, and MathWorld.

&gt; This hyperplane is not convex. A convex curve by definition can not be equal to its tangent at any point.No, my math is fully correct, and your claim is wrong.For a lecture Convexity 101, see my<a href="https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=16498564" rel="nofollow">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=16498564</a>

You don&#x27;t want to consider just &quot;tangents&quot; and, instead, consider what I defined as supporting hyperplanes of the epigraph and subgradients of the function. If the gradient exists, that is, if the function is differentiable, then the subgradient really is a tangent. Otherwise can have many different subgradients supporting at one point on the curve and its epigraph.It&#x27;s simple: A cube has supporting planes at each point that is an edge or corner, but those points do not have tangents.

You should recheck your definitions on convexity.&gt;function f: R^n --&gt; R where for all x in R^n f(x) = 0This hyperplane is not convex. A convex curve by definition can not be equal to its tangent at any point.Edit: I should specify, I mean a convex curve cannot be completely equal to any of its tangents, obviously it will equal each tangent at a single point.

If you find something wrong mathematically or otherwise with something I write, then by all means let me know. So far you have found nothing. Details:The Google statement I quoted was flatly wrong. It is really important for students to be told that.I gave some references to more in statistics.&gt; the measure-theoretic issuesI didn&#x27;t mention measure theory, and the statistics references I gave don&#x27;t mention measure theory either. I referenced Fleming only as background on convexity, and there is no measure theory in that part of Fleming.You mentioned the role of calculus for the math of regression: That use of calculus, for deriving the normal equations, is neither necessary nor, really, sufficient. There is another derivation, nicer, fully detailed mathematically, with no calculus at all. The core of the idea is that the minimization of the squared error has to be an orthogonal projection and, then, presto, bingo, get the normal equations. And there are more advantages to that derivation. To keep my post simple, I omitted that derivation, but a good treatment of regression without calculus could use it.I omitted the standard definition of convexity, but apparently in this discussion we need that. By omitting the definition, the Google material was not so good.Definition (convex function): For the set of real numbers R and a positive integer n, a function f: R^n --&gt; R is convex provided for any u, v in R^n and any a in [0,1] we havef(au + (1-a)v) &lt;= af(u) + (1-a)f(v)So, for a picture, on the graph of f(x), we have two points (maybe not distinct) (u, f(u)) and (v, f(v)). Then we draw the line between these two points. The number a determines where we are on that line. With a = 0, we are at point (v, f(v)). With a = 1, we are at point (u, f(u)). Then as we move a from 0 to 1, we move along that line. We also have on the graph the point, say,
P(au + (1 - a)v, f( au + (1-a)v ) )And on the line we drew, we have point, say,
Q(au + (1 - a)v, af(u) + (1-a)f(v))Well, we are asking that point Q be the same as point P or directly above point P. That is, the line we drew is on or above the graph of (x, f(x)). The line is sometimes called a secant line and is said to over estimate the function.Definition (concave):
The function -f is concave if and only if the function f is convex.As in Fleming, a convex function is continuous. Intuitively, the proof is based on two cones, and as we approach a point we get herded between the two cones. The cones are from the convexity assumption. Draw a picture.IIRC, there is a result in Rockafellar that a convex function is differentiable almost surely with respect to Lebesgue measure, but this is the only connection I would make with convexity and measure theory.For convex f, the set of all (x, y) where y &gt;= f(x) is the epigraph of f, that is, the region on or above the graph of f.Definition (convex set): A subset C of R^n is convex provided for any u, v in C and any a in [0,1] the pointau + (1-a)vis also in set A.Well, as in Fleming, the epigraph is convex. It is also closed in the usual topology of R^n.Definition (closed set): A subset C of R^n is closed (in the usual topology of R^n) provided for any sequence x_n, n = 1, 2, ... in C that converges to y in R^n, y is also in C.In particular, if we define the boundary of C, set C contains is boundary. So, the interval [0,1] is closed and the interval (0,1) is not closed.Well, for any closed convex set and point u on its boundary, there exists a hyperplane that passes through point x and where set C is a subset of the closed half space on one side of the hyperplane.Such a hyperplane is said to be supporting for set C at point x.Intuitively, in R^3, push convex set C to be in contact with a wall. Suppose point x on the boundary of set C is in contact with the wall. Then the wall is a supporting plane for set C at x, and set C is a subset of the room side of the wall.Or think of a big, solid, irregular piece of cheese and John Belushi as his Samurai Tailor swinging his sword: John keeps swinging his sword in arcs that are in flat planes and cuts down the irregular cheese to a convex hunk. So, the convex C has been determined (formed) from the supporting hyperplanes from Belushi&#x27;s sword.For another way to make a convex set, take a piece of wood and press it against a belt sander until the boundary consists of only flat sides.Let a solid rock roll around in a steam of water for a few thousand years, and may end up with a smooth, shiny, convex rock.Faster a chicken egg is convex.In general, a closed convex set is the intersection of its supporting hyperplanes.Then, we can approximate a convex set with some of its supporting hyperplanes. In particular, we can approximate a convex function with some supporting hyperplanes of its epigraph. At times, this can be useful -- it&#x27;s the main idea behind Lagrangian relaxation in constrained optimization (I used that once).In particular, the epigraph of a convex function is the intersection of the supporting hyperplanes. In that case, a supporting hyperplane is called a subgradient. The function is differentiable at the point of contact if and only if the subgradient is unique. If the subgradient is unique, then it is just the tangent hyperplane from the gradient of the function.In R^3, a cube is a convex set. Each of its sides is part of a supporting hyperplane. For a point on the boundary of the cube that is not on an edge, the supporting hyperplane at that point is unique. The corners and edges of the cube also have supporting hyperplanes, but they are not unique.In R^3 a sphere is convex. Then it is also the intersection of its supporting hyperplanes. At each point on the boundary of the sphere, the supporting hyperplane is unique.Similarly for epigraphs.So, the function f: R*n --&gt; R where for each x f(x) = 0 is convex, concave, and linear, and each x is both a maximum and a minimum of f. So, the minimum of a convex function need not be unique. In this case, the epigraph is just a closed half space.&quot;Look, Ma! No calculus!&quot; And no measure theory.Exercise: Derive the regression normal equations via perpendicular projections and without calculus.Exercise: Argue the role of perpendicular projections in the minimization in regression.

i would request that you stop critiquing &quot;machine learning&quot; based on the presentation in introductory online materials like this and the ng coursera course. you provide a lot of signal in general but i think these critiques do decrease your SNR.i am certain that you are familiar with the &quot;usual&quot; statistics sequence. (for others: there are lower-division courses that use calculus in a few places but otherwise avoid it, focusing instead on memorizing procedures. there is the upper-division probability&#x2F;math stat sequence that uses calculus heavily but avoids analysis. and there is an intro phd sequence that finally gets into measure theory.) if you look at a coursera course that gives an high-level overview of practical statistics and simplifies its presentation to be accessible to people who never took calculus, you can criticize the very idea of a course that does not explain the measure-theoretic issues, but it makes no sense to use it to criticize the field of statistics, or to criticize the competence of others in the institution that produced it.here, google is producing introductory training materials for developers. many developers have never taken calculus, let alone optimization, statistics, or analysis, and when i took MLCC internally, you were supposed to go through this whole thing (lectures and coding) in two days. it&#x27;s supposed to give you enough understanding of the concepts to understand the API and apply it.

In the course, in lecture&quot;Reducing Loss: Gradient Descent&quot;is&quot;Convex problems have only one minimum; that is, only one place where the slope is exactly 0. That minimum is where the loss function converges.&quot;The first sentence is flatly wrong: E.g., for positive integer n and the set of real numbers R, function f: R^n --&gt; R where for all x in R^n f(x) = 0, f is convex, concave, and linear, and for all x in R^n x is a minimum and a maximum of f.Can there be uncountably infinitely many alternative minima for the Google ML problems? Yes, e.g., just enter one of the independent variables twice.The second sentence is nonsense.Grotesque, outrageous incompetence!!!!It has long been known that minimizing a convex function, even a differentiable convex function, with just gradient descent can be just horribly inefficient. A LOT is known about how to do much better than just gradient descent. E.g., there is Newton iteration (right, that Newton, hundreds of years ago) and quasi-Newton. And there&#x27;s more.Why so inefficient? Well, draw a picture like Google did except use just two independent variables instead of just the one in the Google picture. Then see that the resulting, convex &quot;bowl&quot; can be like a long, narrow boat with a very gentle slope in one direction and a very steep slope in an orthogonal direction. Yes the cross section of the bowl can be, first cut, an ellipse with one short axis and one long one. Sure, the axes are eigenvectors, etc. and the ellipse is part of a local quadratic approximation. Well, gradient descent keeps going back and forth nearly parallel to the short axis of the ellipse and making nearly no progress on the long axis. People have known this and known good things to do about it for, uh, at least half a century.For the Google ML problems, might (1) tweak Newton iteration to improve the rate of convergence to a minimum or (2) at each iteration don&#x27;t get a gradient descent but get a supporting hyperplane of the epigraph of the convex function, as the iterations proceed, accumulate these hyperplanes, notice that they lead to an approximation of the full epigraph, and use linear programming or some tweak of that to minimize the hyperplane approximation to the convex function -- there is much more that can be said here. By the way, the convex function for that ML problem is quite special, e.g., quadratic.A lot has long been known and well polished in regression and classification, e.g., with TeX markup:N.\ R.\ Draper and
H.\ Smith,
{\it Applied Regression Analysis,\&#x2F;}
John Wiley and Sons,
New York,
1968.\ \Leo Breiman,
Jerome H.\ Friedman,
Richard A.\ Olshen,
Charles J.\ Stone,
{\it Classification and Regression Trees,\&#x2F;}
ISBN 0-534-98054-6,
Wadsworth \&amp; Brooks&#x2F;Cole,
Pacific Grove, California,
1984.\ \C.\ Radhakrishna Rao,
{\it Linear Statistical Inference and
Its Applications:\ \
Second Edition,\&#x2F;}
ISBN 0-471-70823-2,
John Wiley and Sons,
New York,
1967.\ \A good start on convexity isWendell H.\ Fleming,
{\it Functions of Several Variables,\&#x2F;}
Addison-Wesley,
Reading, Massachusetts,
1965.\ \Total, fun, dessert ice cream on convexity is Jensen&#x27;s inequality; right away can use it to prove a lot of classic inequalities.Gee, look on the upside!!!! From this sample, the claims of machine learning (ML) revolutionizing the economy are nonsense!!!! And for startups, don&#x27;t much have to worry about serious competition from Google!!!!

is there a more fleshed out outline for what will be covered here? sounds interesting

Shameless plug: Lambda School (YC S17) is also putting on a free Machine Learning crash course (we call it a mini bootcamp), followed by an optional 6-12 month course that you pay for once you get a job in data science (it’s free until then, and always free if you don’t get a job in ML).<a href="https:&#x2F;&#x2F;lambdaschool.com&#x2F;machine-learning-bootcamp&#x2F;" rel="nofollow">https:&#x2F;&#x2F;lambdaschool.com&#x2F;machine-learning-bootcamp&#x2F;</a>

The Google AI courses are also good for old seasoned ML practitioners who want to learn more about more recent deep learning techniques

I think you&#x27;re right. Did you happen to open-source your code from the hackathon? I&#x27;d love to take a look at your approach if you don&#x27;t mind.

It&#x27;s not very sexy, but I think you might find it easier and more robust just to use an NLP library.I built something similar (albeit for a relatively limited database of recipes) for a hackathon a couple of weeks back. I didn&#x27;t even use a proper NLP library, just some simple hand-rolled pattern-matching, and got pretty good results.Good luck!

This seems relevant: <a href="https:&#x2F;&#x2F;open.blogs.nytimes.com&#x2F;2015&#x2F;04&#x2F;09&#x2F;extracting-structured-data-from-recipes-using-conditional-random-fields&#x2F;" rel="nofollow">https:&#x2F;&#x2F;open.blogs.nytimes.com&#x2F;2015&#x2F;04&#x2F;09&#x2F;extracting-structu...</a>

This is an NLP problem if all you&#x27;re trying to do is extract nouns.

I did the same a while back, and i suggest using an NLP library to extract parts of speech and parse trees and building a quick dirty solution. I did the same a while back and the strong solution isn&#x27;t much better (took a week+) than the hacky manual one based on specific keywords like &quot;teaspoon&quot; and parts of speech&#x2F;parse trees (took a few hours).

Whether you end up using a machine learning approach or hand-crafting the solution, I recommend you work in a ML-like manner, dividing up the data you have into test and training sets and using cross-validation to evaluate your work.For you actual question, yes, as others have said it might be just an NLP&#x2F;regexp problem. Otherwise, you could look at ingredients identification as a classification approach. I recommend checking FastText, NLTK, familiarize yourself with word dictionaries and pre-trained vectors that are available, these tools might help generalize your work beyond the data you have at hand.(E.g. if it works well on your data using pre-trained word vectors from wikipedia, chances are it might work on examples you don&#x27;t even have.)

I have a new project at work: I need to take in a free form text of recipe ingredients (e.g. &quot;1&#x2F;2 cup diced onions&quot;, &quot;two potatoes, cut into 1-inch cubes&quot;, etc.) and build a program that identifies the ingredient (e.g. onion, potato), as well as the quantity (e.g. 0.5 cup, 2.0 units). Would machine learning be an applicable approach to solving this? Right now I&#x27;m just planning on using an NLP library to parse out the various parts of the ingredient text.

This is what got me a proper intuition for why a blockchain can be useful.

I loved this one a lot: <a href="https:&#x2F;&#x2F;anders.com&#x2F;blockchain&#x2F;" rel="nofollow">https:&#x2F;&#x2F;anders.com&#x2F;blockchain&#x2F;</a>

Cool! Does anybody also know a good blockchain crash course of similar kind so one could grok all the major buzzwords of  today?

If you are willing to do the work, Frank Harrell&#x27;s Regression Modeling Strategies is a pretty good introduction to a lot of this.It&#x27;s written for a very different set of problems than typical ML, but it has lots of really good advice for practical problems in data analysis and prediction (which is another term for ML).Mostly people learn this stuff by experience. Find a dataset, choose a predictor, filter, clean and massage your data till you get better metrics&#x2F;understanding (preferably both). Rinse, repeat on many different datasets and problems, and you&#x27;ll know how to do this.

Thanks for the response!&gt; There are various feature engineering and feature extraction techniques. Filter methods, wrapper methods, and embedded methods. Principle component analysis, autoencoding, variance analysis, linear discriminant analysis, Gini index, genetic algorithms, etc -- the feature selection process will depend on the dataset, the problem domain, the analysis algorithm you ultimately use, etc.Obviously thats a big toolbox and Im sure it takes time to develop an intuitive understanding for all these techniques. What I hope for is some sort guidebook on what to look for when I stumble across problems. So lets say you try out an algorithm and your accuracy(or whatever evaluation criteria you might have) is low. How do you figure out if thats due to the algorithm, or is it due to (or due to the lack of) feature selection?An analogy that might be useful is, when I see my database queries are slow, I can use EXPLAIN to guide what knobs to tune. Obviously it requires understanding what indexes are, what a full table scan is etc. etc. but the EXPLAIN plan provides a guidebook of sorts.

&gt; How did you figure out what features would be useful?There are various feature engineering and feature extraction techniques. Filter methods, wrapper methods, and embedded methods. Principle component analysis, autoencoding, variance analysis, linear discriminant analysis, Gini index, genetic algorithms, etc -- the feature selection process will depend on the dataset, the problem domain, the analysis algorithm you ultimately use, etc.&gt; How did you figure out what algorithm(s) are appropriate?Also depends on the problem domain. Discrete or continuous data? Categorical features, numeric features, features as bitmasks. Do you need a probabilistic outcome? Etc.Generally you start with the easiest algorithms in your toolbox to see how viable they are. For a classification task I&#x27;ll almost always start with a naive Bayes classifier (if the data allows) and&#x2F;or a random forest and see how they perform. If the problem domain is highly non-linear you might start with a support vector or kernel method. Neural network is a last resort for me, as I find most classification problems can be solved to a high accuracy much more simply.&gt; how and why did you massage the data in a specific way?This relates back to #1 -- you should only massage data based on what your feature engineering tells you to do. Sometimes you might want to remove outliers or clean up the training data, but only if the outliers really should be removed from consideration entirely.

Georgia Tech has an graduate course on Machine Learning CS-7641. There are four major projects in that course where the students must analyze (and re-analyze) a chosen dataset. Here is an example of the code one student used: <a href="https:&#x2F;&#x2F;github.com&#x2F;JonathanTay&#x2F;CS-7641-assignment-1" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;JonathanTay&#x2F;CS-7641-assignment-1</a> 
Unfortunately all the plotting code was intentionally removed. Sometimes the project reports make it online (<a href="http:&#x2F;&#x2F;www.dudonwai.com&#x2F;docs&#x2F;gt-omscs-cs7641-a3.pdf?pdf=gt-omscs-cs7641-a3" rel="nofollow">http:&#x2F;&#x2F;www.dudonwai.com&#x2F;docs&#x2F;gt-omscs-cs7641-a3.pdf?pdf=gt-o...</a>) . Having spent several months of my life on the assignments I&#x27;d say that only way to learn it is to try a whole bunch of different things and try and figure out why some work and why some don&#x27;t. Sometimes you learn from the failures, sometimes from the unexpected successes.

Take a look at some of the highly rated kernels on Kaggle - they’re often well annotated with the types of things you’re looking for, including actual experimentation to test ideas.Edit: fix autocorrect

As someone who is trying to learn ML, all the courses available are hugely helpful. One thing I wish I had easy access to is the process that someone goes through while trying to build a model on a real dataset.Specifically following questions are the ones I struggle with:1. How did you figure out what features would be useful?2. How did you figure out what algorithm(s) are appropriate?3. how and why did you massage the data in a specific way?

I think Weka gets used in the java world.
<a href="https:&#x2F;&#x2F;www.cs.waikato.ac.nz&#x2F;ml&#x2F;weka&#x2F;" rel="nofollow">https:&#x2F;&#x2F;www.cs.waikato.ac.nz&#x2F;ml&#x2F;weka&#x2F;</a>

ML concepts are independent of programming language. I suggest not to let language preferences stand in the way of listening to lectures and understanding the subject.For implementing exercises using Java, you have a bunch of 
good options:1) The most direct equivalent to Pandas+Tensorflow I can think of is DL4J. They have a good comprehensive set of concept and implementation tutorials [1].2) TF APIs have a Java port and can be used from java desktop and console applications [2]. So a second but slightly more difficult option is using TF Java port + Spark
APIs.[1]: <a href="https:&#x2F;&#x2F;deeplearning4j.org&#x2F;documentation" rel="nofollow">https:&#x2F;&#x2F;deeplearning4j.org&#x2F;documentation</a>[2]: <a href="https:&#x2F;&#x2F;www.tensorflow.org&#x2F;install&#x2F;install_java" rel="nofollow">https:&#x2F;&#x2F;www.tensorflow.org&#x2F;install&#x2F;install_java</a>

Is there something like this for Java programmers?

The hype is and isn&#x27;t warranted.ML is a much broader field than just neural networks. The hype for ML, in general, I think is warranted. We hit an inflection point when AWS launched and scalable processing power became cheap. It became cheap to process tons of data and generate insights. I don&#x27;t have hard numbers on this, but probably 90-95% of machine learning used in practice is NOT neural networks, and have accuracies in the 90%+ arena. So ML in general -- sure, hype warranted.Neural networks are the new hot topic, and the hype isn&#x27;t fully warranted yet. TensorFlow made them very popular in the developer community; this is a good thing because it&#x27;s spurring more investment and research in ANNs. But for any given problem, odds are that a neural network is not the best (ie, most accurate or cheapest) way to solve it. Neural networks do have specific problem domains where they are the state of the art, but for most other problem domains there exists a better solution. So I&#x27;d say that neural networks are a little over-hyped right now, but with a new generation of developers learning about and experimenting with ANNs, that will change in a few years. I think we&#x27;re about to see an explosion of ANN usefulness over the next few years.TLDR: ML is very useful but is more than neural networks; neural networks need a little more progress to catch up to the tensorflow hype.

Computers are automation tools that increase human efficiency by doing the grunt work for you - but they are limited to automating the tasks that can be captured as a set of rules in code. When we figure a new way to model more complex tasks in code, a whole new set of things can be automated.Here&#x27;s a concrete example: Before spreadsheets existed, there used to be legions of accountants who created complex ledgers on paper and added up all numbers to track how a business was doing. You&#x27;d literally mail off your sales numbers to an accounting team somewhere and wait three days to get the latest report generated and sent back. Sure they had calculators to add numbers, but the computers of the day didn&#x27;t understand how those numbers related to each other. The human still had to do most of the work to create the reports.The big idea of spreadsheets was to make the computer manage the more complex task of knowing how different numbers in a report related to each other. It made most ledger tasks totally automatic once the initial report was defined. Now a single accountant could do the work of the entire accounting team - and more accurately and in less time! There were stories of the first spreadsheet testers having to delay mailing back their financial reports by a few days because their clients would be suspicious if they mailed them back too fast.Nearly overnight accounting got a lot more efficient and companies made more money. T&quot;What If&quot; modeling that used to be too slow and cost prohibitive to do was now it was quick and easy. Companies could plan more intelligently. The spreadsheet was a true game changer.This same pattern happens every time the bar is raised on the complexity of what can be automated and Machine Learning raises the bar one giant notch. Previously we were limited to automating tasks that a smart coder could describe as discrete steps in code. But with ML, the computer can figure out it&#x27;s own rules just by looking at data. That means in many cases you can solve very hard problems just by collecting a lot of data. Lots and lots of things that used to be done by large groups of people will now be able to be done with a single computer.In that sense, ML is a total game changer. Don&#x27;t focus on the specific applications thus far. Focus on the idea that all kinds of tasks that used to require humans can now be automated with a little bit of applied ML. The opportunities are literally everywhere.In a few years, ML won&#x27;t be some esoteric technique used by a few people. It will be a core skill that everyone uses or touches in some way. It&#x27;s going to creep into everything everywhere because it&#x27;s just so darn useful.

I&#x27;ve been reading about it &quot;getting popular during the last two years&quot; for at least 6 years.

Deep nets are deservedly big because they&#x27;ve managed to improve upon all of the decades-old state-of-the-art methods in the world of signal processing (DSP): voice, image, video, game play, and a much of natural language. No other single computational&#x2F;algorithmic method has achieved so much, in so many domains, ever. That&#x27;s revolutionary.The advances made by deep nets in signal processing will likely slow down now, but they aren&#x27;t going away, not in the foreseeable future.The hype around DNNs arose when we took our unbridled enthusiasm for what&#x27;s they&#x27;ve achieved in DSP and extend it to other domains with data that&#x27;s less &#x27;dense&#x27; and thus aren&#x27;t as amenable to de&#x2F;convolution in N-D space or time.Will DNNs revolutionize or introduce all the techniques needed to achieve AGI&#x2F;Strong AI? I very much doubt it. As yet, there&#x27;s little sign that DNNs can perform relational operations on interdependent symbols, like the transforms available via type theory, bayesian nets, or predicate logic.The multitude of disparate facts and semantics in a rich knowledgebase can&#x27;t be organized into dense matrices the way that continuous signals can, so the SIMD operations that are so effective in DSP won&#x27;t implement the rich transformations needed in a relational fact-based knowledge space equally as well, if at all. Thus DNNs almost surely aren&#x27;t going to take us to the heights of logical or compositional thinking that human level intelligence requires.But how far up relational mountain will DNNs take us? I suspect that won&#x27;t be known for a decade or longer. But even if we don&#x27;t reach the summit, it&#x27;ll be higher than we were before.

just commenting to thank you for a very accessible assessment of a simple question &quot;is the hype warranted&quot;. please do more of these on HN (or elsewhere!)

This is a really fantastic and interesting look at ML, for someone who’s just beginning first steps. Any recommendations on where else I can read about the areas DNNs and associated stuff (GANs, RL, etc) in terms of what they’ll likely not be capable of in the near mid term?

Deep nets are deservedly big because they&#x27;ve managed to improve upon most of the decades-old state-of-the-art methods in the world of signal processing (DSP): voice, image, video, game play, and a significant amount of natural language. No other single computational&#x2F;algorithmic method has achieved so much in so many domains, ever. That&#x27;s revolutionary.The rate of advance using deep nets in signal processing will likely slow down now, but they aren&#x27;t going away, not in the foreseeable future.The hype around DNNs arose when we took our unbridled enthusiasm for what&#x27;s they&#x27;ve achieved in DSP and extended it to other domains where data is less &#x27;dense&#x27; and thus aren&#x27;t as amenable to fast de&#x2F;convolution in N-D space or time.Will DNNs revolutionize or introduce all the techniques needed to achieve AGI&#x2F;Strong AI? I very much doubt it. As yet, there&#x27;s little sign that DNNs can perform relational operations on interdependent symbols, like the transforms available via type theory, bayesian nets, or predicate logic.The multitude of disparate facts and semantics in a rich knowledgebase can&#x27;t be organized into dense matrices the way that continuous signals can, so the SIMD operations that are so effective in DSP won&#x27;t implement the rich transformations needed in a relational fact-based knowledge space equally as well, if at all. Thus DNNs almost surely aren&#x27;t going to take us to the heights of logical or compositional thinking that human level intelligence requires.But how far up relational mountain will DNNs take us? I suspect that won&#x27;t be known for a decade or longer. But even if we don&#x27;t reach the summit, we&#x27;ll be considerably closer than we were before.

I want to ask people who know ML well if the hype is warranted?Billions of courses, web sites, job applications and HN posts. The subject seem to have taken off massively in the last two years. I mean image and speech recognition is pretty cool (when it works!), but hardly that earth shattering, is it?

Thanks Google! Now I know that I am a ML guy, as an economist and econometrician. Yes, we shoot this on all kind of stuff, though with a clear business acumen or economic policy thinking.

Thanks for taking the time to write such a comprehensive reply - much appreciated. &quot;ML is maths&quot; is something that I&#x27;m getting used to now. I do have some real uses in mind for what I&#x27;m learning&#x27; both in my job and some side projects, particularly image feature recognition, and I&#x27;m looking forward so seeing how it all works in out. Thanks again!

I teach ML and am currently writing my 2nd book on it.I always advocate learning the fundamentals. Machine learning is math, and neural networks in particular rely on linear algebra and vector calculus. (You can build a NN without using linear algebra directly, likely it&#x27;ll be slower and besides, the concept still relies on linear algebra).Frameworks abstract away a lot of the mathiness, which is a net good for society (ie, exposing lots of developers to neural networks), but I consider that a net-negative for the individual developer.When working on anything but trivial toy problems, you should make sure you understand your problem domain and implementation thoroughly. Is the activation function you&#x27;ve chosen ideal for your problem domain? If not, choose a better one. If no better one exists, you can invent it; but you&#x27;ll also need to know how to design the backpropagation algorithm for that new activation function (which requires some vector calculus).Learning the math, as you have, helps you tune your algorithm based on actual knowledge rather than guesswork. I don&#x27;t think it will be misleading when you move on to a framework. The frameworks are built on the same math.That said -- if all you&#x27;re looking to do is play around, then you don&#x27;t need the math as much.

Andrew Ng’s older machine learning MOOC class was excellent. I took it once, and took it again a few years later. In the last 8 months I also took his new deep learning set of courses. All really good stuf! (I have been working in the field since the 1980s, but constantly refreshing helps me. And Andrew’s lectures are great fun, he is a teaching artist.

I&#x27;ve taken the CNN and RNN (parts 4 and 5) classes of his new DL specialization, and they both area about as rigorous as you wanted. I do have to give a warning though that the last class starts so see some confusing mistakes in the HW. For example, the expected output given is from an outdated HW version.

i completed the andrew ng course recently, and felt that the difficulty dropped a lot in the second half of the course (for example, he stops giving homeworks). im hoping for more in his new DL courses

Use the time you spend trying to find how to download the videos actually watching them, doing the readings and practising the exercises.

Where are the videos anyway? I don&#x27;t see any play button or ay console to play the videos.

I used to download all ML videos for offline ad hoc watching. But, this crash course videos cannot be downloaded using &#x27;youtube-dl&#x27;. Any recommendations?

This looks like a well put-together course, and a good way to learn TensorFlow. Keras and TensorFlow are top of my list of technologies to explore in the very near future.Is anyone here doing Andrew Ng&#x27;s Machine Learning course [1]? I&#x27;m about half-way through and really enjoying it. I&#x27;m particularly appreciating that the programming exercises are done in MatLab&#x2F;Octave, so I feel that I&#x27;m really understanding the fundamentals without an API getting in the way, and developing some good intuition. Obviously frameworks are the way to go for production ML work, but I wonder whether ML people here think this bottom-up approach is advisable or could it be misleading when I move on to Keras&#x2F;TensorFlow&#x2F;whatever?[1] <a href="https:&#x2F;&#x2F;www.coursera.org&#x2F;learn&#x2F;machine-learning" rel="nofollow">https:&#x2F;&#x2F;www.coursera.org&#x2F;learn&#x2F;machine-learning</a>Edit: brevity

I like this move from google. Sure it is targeted for you to use Tensorflow but more courseware and MOOCs help everyone. I love doing self study and Tensorflow&#x27;s tutorials are top notch. Since I can also use Tensorflow on my own hardware and anywhere else I really love better docs and MOOCs in general. What I really want to do is understand enough Tensorflow to reproduce other people&#x27;s experiments in their papers on github and I think this would be one of the best ways to do this. Of course, this may eat into a bunch of companies that have paid programs for ML but its Google&#x27;s prerogative to make ML cheaper and easier to deploy and learn so I am all for that.

Add to that that TensorFlow was practically a latecomer, not the first to market.

The choice of TensorFlow is a bit disappointing for a beginner-focused course which looks really solid otherwise. Business seems to have gotten priority over pedagogy in that case.I see TensorFlow as the Angular of machine learning: first on the market, powerful but unwiedly. Like Angular, it will ultimately get superseded by tools with a nicer API (scikit-learn, Keras) or more versatility (PyTorch). Like Angular, it&#x27;s probably not the best choice for a beginner to invest time into.

I love the prework section: <a href="https:&#x2F;&#x2F;developers.google.com&#x2F;machine-learning&#x2F;crash-course&#x2F;prereqs-and-prework" rel="nofollow">https:&#x2F;&#x2F;developers.google.com&#x2F;machine-learning&#x2F;crash-course&#x2F;...</a> It&#x27;s a very good mix of topic and skills that I think everyone should learn, even if not directly planning to do ML or DL. If y&#x27;all are looking for a compact (and inexpensive) textbook on linear algebra that comes with all prerequisites you can check out: <a href="https:&#x2F;&#x2F;gum.co&#x2F;noBSLA" rel="nofollow">https:&#x2F;&#x2F;gum.co&#x2F;noBSLA</a> (disclaimer: I wrotes it)

CS229 @ Stanford is very math&#x2F;proof intensive. This might be somewhat similar to CS221 or the Coursera course.

How does this compare to the CS229 lectures by Andrew Ng? (the recorded lectures, not the MOOC)

I&#x27;ve compiled this into a Todoist template you can import - it&#x27;s got links to each module + times.To preview: <a href="http:&#x2F;&#x2F;todotemplates.com&#x2F;posts&#x2F;HRtYanEq8zMgRL5fz&#x2F;google-ml-crash-course" rel="nofollow">http:&#x2F;&#x2F;todotemplates.com&#x2F;posts&#x2F;HRtYanEq8zMgRL5fz&#x2F;google-ml-c...</a>To import directly: <a href="https:&#x2F;&#x2F;todoist.com&#x2F;importFromTemplate?t_url=https%3A%2F%2Fd1aspxi4rjqbaz.cloudfront.net%2F24fc6edd6dff480670528e9f842cb494_Google%2520ML%2520crash%2520course.csv" rel="nofollow">https:&#x2F;&#x2F;todoist.com&#x2F;importFromTemplate?t_url=https%3A%2F%2Fd...</a>

On a sidenote, can someone talk about what kind of tools are being used to integrate the subtitles and scrolling behavior over a youtube video in this course? Is there an OS implementation?

While I like the idea, in principle, that you don&#x27;t need a CS education to use AI&#x2F;ML, I doubt it. Here&#x27;s a problem that cropped up today: Our instance ran out of hard drive space on a training set of ~400,000 images. The individual images were only 375 GB, but took up 1.5T when converted to Numpy matrices. Why? The arrays were converted to standard int arrays (32-bit x 3 channels) when they could&#x27;ve fit into short (8-bit x 3 channels). Each image was 4x as large as it needed to be.You can certainly use high-level ML tools (like Keras), but it takes a great deal of work to wrangle your data into a usable format, and even more knowledge to debug an ineffective network.

A shame Google doesn’t just link to the Khan Academy course.

I always liked the Saxon books[1], since they involved so much spaced repetition if you did the problem sets that it beat the symbolic manipulation into your long-term memory.[1] <a href="http:&#x2F;&#x2F;amzn.to&#x2F;2FH3bXL" rel="nofollow">http:&#x2F;&#x2F;amzn.to&#x2F;2FH3bXL</a>

If you&#x27;re looking for books, have a look at Schaum&#x27;s Outline of Precalculus [0]. Khan Academy [1] is also good and there&#x27;s this MOOC on coursera called Data Science Math Skills [2].[0] <a href="https:&#x2F;&#x2F;www.amazon.com&#x2F;Schaums-Outline-Precalculus-3rd-Problems&#x2F;dp&#x2F;0071795596" rel="nofollow">https:&#x2F;&#x2F;www.amazon.com&#x2F;Schaums-Outline-Precalculus-3rd-Probl...</a>[1] <a href="https:&#x2F;&#x2F;www.khanacademy.org&#x2F;math" rel="nofollow">https:&#x2F;&#x2F;www.khanacademy.org&#x2F;math</a>[2] <a href="https:&#x2F;&#x2F;www.coursera.org&#x2F;learn&#x2F;datasciencemathskills" rel="nofollow">https:&#x2F;&#x2F;www.coursera.org&#x2F;learn&#x2F;datasciencemathskills</a>

we recommend that students meet the following prerequisites:Mastery of intro-level algebra. You should be comfortable with variables and coefficients, linear equations, graphs of functions, and histogramsAny book suggestions to getting up to speed in this area?

this site is so broken on firefox mobile they should be embarrassed.

Cool tutorial, but I&#x27;m not entirely sure what makes this ML -- aside from neural nets, this is more or less the material you&#x27;d encounter in a basic applied statistics or regression analysis course, minus material on estimating uncertainty, modeling survival or time-series data, and causal inference. I suspect you&#x27;d benefit more from a 50 minute tutorial on those than neural nets.

They do have pre-reqs training material with reference links. <a href="https:&#x2F;&#x2F;developers.google.com&#x2F;machine-learning&#x2F;crash-course&#x2F;prereqs-and-prework#prerequisites" rel="nofollow">https:&#x2F;&#x2F;developers.google.com&#x2F;machine-learning&#x2F;crash-course&#x2F;...</a>

&gt;serving videos from youtube without alternatives doesn&#x27;t make it accessible.Why is that?

serving videos from youtube without alternatives doesn&#x27;t make it accessible. proxying  for identified videos esspecially videos from this crash course would be useful.

Can&#x27;t view. Requires a Google account.

The ulterior motive behind this is to increase usage of Google Cloud (according to this answer on Quora: <a href="https:&#x2F;&#x2F;www.quora.com&#x2F;Why-did-Google-release-their-machine-learning-crash-course&#x2F;answer&#x2F;Carlos-Matias-La-Borde?share=00711d71&amp;srid=XvlZ" rel="nofollow">https:&#x2F;&#x2F;www.quora.com&#x2F;Why-did-Google-release-their-machine-l...</a>)