Font
Large
Medium
Small
Night
Prev Index    Favorite Next

Chapter 22 Ideas crash

 Ian, who was born in 1985, has been under a lot of pressure in recent years.

For an ordinary doctoral student, there is nothing wrong with him. On the contrary, he is smart and hard-working, and has been studying in a prestigious school.

He graduated from Stanford with both his undergraduate and master's degrees. His mentor was Andrew Ng, the founder of Google Brain. He studied for his PhD in Montreal and studied under the guidance of Bengio, one of the three giants of AI.

It is not an exaggeration to say that his academic experience and personal wisdom are one in a million, but if you want to compare them with his mentors, they are indeed a little bleak.

Ian, 28, is in the last year of his Ph.D., and data generation algorithms are the direction he has been thinking about during his Ph.D.

Many researchers have also been trying to use neural networks to simulate the human brain to generate new data.

Unfortunately, so far, these data usually have big problems and are completely unusable.

And a big obstacle is that the generated images are often indescribable. These useless grams of images lack the means to utilize them, and it is not easy to evaluate them.

A few days ago, the results on IMAGE that the model performance exceeded human standards gave him new inspiration.

If deep networks can already reach human level in some image tasks, can we avoid the problem of difficult evaluation of the results of generative networks and complete such a process through the mutual confrontation between the two networks?

The more Ian thought about it, the more reasonable it became. He didn't even bother to sleep last night. Instead, he spent the whole night implementing a prototype version of generative-confrontation, and tried training it, and found that the results seemed to be basically as expected.

Consistent.

Unable to contain his excitement, he wanted to discuss the principles and practices with his instructor as soon as possible.

Ian wandered back and forth at the door of Bengio's office for more than 20 minutes before Bengio strode over from a distance.

If you ignore the white color in his hair and beard, the 49-year-old Bengio actually looks quite young. Judging from his appearance, he is at most a man in his mid-thirties.

In particular, the two thick eyebrows that look a bit like Mr. Bean make him look more loyal and approachable.

Ian hurriedly took a few big steps forward, and at the same time unfolded the notes and experimental records in his hands. He pointed at the core formulas in the above lines, and when he was about to speak, he was ruthlessly interrupted by Bengio.
p>

"I know you are in a hurry, but don't be in a hurry yet." Bengio looked at Ian's irritable look and joked, "What we pay attention to in academics is to have a solid foundation and work steadily. What's the use of rushing? There's no point in rushing."

"What can't we talk about after we go in?" Bengio said, taking out his key and opening the office door. "Come in, it's only around seven o'clock and you're already squatting in my office.

In front of the door, you must have made some major discovery, right?"

"I'm very anxious, I'm really anxious." Ian has been deeply involved in the field of generation for some time. When he thought of this idea yesterday, he already realized that this would be a major change in the entire model.

After ten years of sharpening his sword from the beginning to the present as an undergraduate, Ian is very excited. He has a good academic sense and can feel the extraordinaryness of this idea. Is his day of success coming soon?

At this moment, he can feel that this is an excellent opportunity to rely on his own strength to get rid of Ng Enda's disciples and Bengio's disciples, which is both a halo and a shadow.

Let the world truly understand himself and re-see himself through the technologies and algorithms he proposed.

"Are the two networks fighting each other?" Bengio pondered for a while after listening. Unlike several of Ian's friends who were eager to raise objections and doubts, Bengio has always been interested in imaginative and creative ideas.

Very encouraging attitude.

"Train two models at the same time instead of one. The generator and the discriminator can spirally improve each other with left foot and right foot. You want to use this model to make the distribution of the generator as close as possible to the provided real world.

Data."

"In this way, we also get rid of the ordinary thinking. We train the discriminator not so that it can judge 100% whether the image is generated. Instead, our purpose is to make the discriminator no longer unclear about which ones are real and which ones.

It’s fake." Ian added.

"Confrontation is just a form, and its purpose is to train a generative network. I am confident that this method can get rid of the dependence on data labels, and a large amount of other data can be utilized without additional processing.

Get up."

Until now, Ian's excitement has not subsided.

"Not only that, generation is only the most preliminary application." Bengio thought for a while and said, "It can achieve special purposes by filtering data. It only requires a small amount of code adjustments, and I believe it can work well.

It is a very dangerous technique to process groups with simple layouts, especially in the direction of human faces."

"What are you going to name it?" Bengio said as he turned on the computer. Naming technology is a difficult problem and an art.

If you choose a bad name, your work will be in vain.

A resounding name and an interesting and concise abbreviation are likely to increase the visibility, popularity and application scope of the work.

"Generate...and...confrontation. How about calling it a generative adversarial network?" Ian added the two most critical elements of this idea to the name before he thought about it carefully.

"Generative Adversarial, let me take a look." The first step in choosing a name is naturally to search to see if anyone has already occupied the slot.

After Bengio's search, Meng Fanqi, who was far away in the world, suddenly sneezed and thought to himself, how could he still catch a cold in this summer?

"This name seems to have been taken by someone, just two days ago, which is very unfortunate." Bengio did not realize the seriousness of the problem at this time, "It seems that we have to change to another name."

While talking, Bengio clicked on the preprint.

"What kind of network is Dream? I haven't seen it before." Bengio vaguely felt that someone had mentioned this name in the past two days, but he was busy with other research matters and didn't pay much attention to it.

But just after reading the summary, Bengio's eyes sharpened and his expression became very serious.

Ian was still thinking hard about what kind of name would be better.

Bengio ruthlessly broke through his defense with one sentence, "Ian, it seems that it's not just a name we can't use."
Chapter completed!
Prev Index    Favorite Next