Expanding Bard’s understanding of YouTube videos — via AI Valley

  • What: We’re taking the first steps in Bard’s ability to understand YouTube videos. For example, if you’re looking for videos on how to make olive oil cake, you can now also ask how many eggs the recipe in the first video requires.
  • Why: We’ve heard you want deeper engagement with YouTube videos. So we’re expanding the YouTube Extension to understand some video content so you can have a richer conversation with Bard about it.

Reshaping the tree: rebuilding organizations for AI — from oneusefulthing.org by Ethan Mollick
Technological change brings organizational change.

I am not sure who said it first, but there are only two ways to react to exponential change: too early or too late. Today’s AIs are flawed and limited in many ways. While that restricts what AI can do, the capabilities of AI are increasing exponentially, both in terms of the models themselves and the tools these models can use. It might seem too early to consider changing an organization to accommodate AI, but I think that there is a strong possibility that it will quickly become too late.

From DSC:
Readers of this blog have seen the following graphic for several years now, but there is no question that we are in a time of exponential change. One would have had an increasingly hard time arguing the opposite of this perspective during that time.

 


 



Nvidia’s revenue triples as AI chip boom continues — from cnbc.com by Jordan Novet; via GSV

KEY POINTS

  • Nvidia’s results surpassed analysts’ projections for revenue and income in the fiscal fourth quarter.
  • Demand for Nvidia’s graphics processing units has been exceeding supply, thanks to the rise of generative artificial intelligence.
  • Nvidia announced the GH200 GPU during the quarter.

Here’s how the company did, compared to the consensus among analysts surveyed by LSEG, formerly known as Refinitiv:

  • Earnings: $4.02 per share, adjusted, vs. $3.37 per share expected
  • Revenue: $18.12 billion, vs. $16.18 billion expected

Nvidia’s revenue grew 206% year over year during the quarter ending Oct. 29, according to a statement. Net income, at $9.24 billion, or $3.71 per share, was up from $680 million, or 27 cents per share, in the same quarter a year ago.



 

What happens to teaching after Covid? — from chronicle.com by Beth McMurtrie

It’s an era many instructors would like to put behind them: black boxes on Zoom screens, muffled discussions behind masks, students struggling to stay engaged. But how much more challenging would teaching during the pandemic have been if colleges did not have experts on staff to help with the transition? On many campuses, teaching-center directors, instructional designers, educational technologists, and others worked alongside professors to explore learning-management systems, master video technology, and rethink what and how they teach.

A new book out this month, Higher Education Beyond Covid: New Teaching Paradigms and Promise, explores this period through the stories of campus teaching and learning centers. Their experiences reflect successes and failures, and what higher education could learn as it plans for the future.

Beth also mentioned/link to:


How to hold difficult discussions online — from chronicle.com by Beckie Supiano

As usual, our readers were full of suggestions. Kathryn Schild, the lead instructional designer in faculty development and instructional support at the University of Alaska at Anchorage, shared a guide she’s compiled on holding asynchronous discussions, which includes a section on difficult topics.

In an email, Schild also pulled out a few ideas she thought were particularly relevant to Le’s question, including:

  • Set the ground rules as a class. One way to do this is to share your draft rules in a collaborative document and ask students to annotate it and add suggestions.
  • Plan to hold fewer difficult discussions than in a face-to-face class, and work on quality over quantity. This could include multiweek discussions, where you spiral through the same issue with fresh perspectives as the class learns new approaches.
  • Start with relationship-building interactions in the first few weeks, such as introductions, low-stakes group assignments, or peer feedback, etc.
 

Adobe revealed 4 new AI heavy hitters — from aivalley.com

  1. Project Stardust
  2. Project Primrose
  3. Project Poseable
  4. Project Dub Dub Dub


Adobe is working on generative AI video manipulation — from theverge.com by Umar Shakir
The company revealed Project Fast Fill, a new way to remove people, add objects, and replace colors in videos using generative AI and text-prompt interactions.

Adobe is showing off a new generative fill feature, Project Fast Fill, that can easily add or remove objects in videos with the power of AI. It’s one of several new, wild, experimental AI features announced today at the company’s MAX conference. Project Fast Fill has the ability to swap in clothing accessories on people in motion or remove tourists from the background of a landscape pan.



 

Canva’s new AI tools automate boring, labor-intensive design tasks — from theverge.com by Jess Weatherbed
Magic Studio features like Magic Switch automatically convert your designs into blogs, social media posts, emails, and more to save time on manually editing documents.


Canva launches Magic Studio, partners with Runway ML for video — from bensbites.beehiiv.com by Ben Tossell

Here are the highlights of launched features under the new Magic Studio:

  • Magic Design – Turn ideas into designs instantly with AI-generated templates.
  • Magic Switch – Transform content into different formats and languages with one click.
  • Magic Grab – Make images editable like Canva templates for easy editing.
  • Magic Expand – Use AI to expand images beyond the original frame.
  • Magic Morph – Transform text and shapes with creative effects and prompts.
  • Magic Edit – Make complex image edits using simple text prompts.
  • Magic Media – Generate professional photos, videos and artworks from text prompts.
  • Magic Animate – Add animated transitions and motion to designs instantly.
  • Magic Write – Generate draft text and summaries powered by AI.



Adobe Firefly

Meet Adobe Firefly -- Adobe is going hard with the use of AI. This is a key product along those lines.


Addendums on 10/11/23:


Adobe Releases New AI Models Aimed at Improved Graphic Design — from bloomberg.com
New version of Firefly is bigger than initial tool, Adobe says Illustrator, Express programs each get own generative tools


 



Adobe video-AI announcements for IBC — from provideocoalition.com by Rich Young

For the IBC 2023 conference, Adobe announced new AI and 3D features to Creative Cloud video tools, including Premiere Pro Enhance Speech for faster dialog cleanup, and filler word detection and removal in Text-Based Editing. There’s also new AI-based rotoscoping and a true 3D workspace in the After Effects beta, as well as new camera-to-cloud integrations and advanced storage options in Frame.io.

Though not really about AI, you might also be interested in this posting:


Airt AI Art Generator (Review) — from hongkiat.com
Turn your creative ideas into masterpieces using Airt’s AI iPad app.

The Airt AI Generator app makes it easy to create art on your iPad. You can pick an art style and a model to make your artwork. It’s simple enough for anyone to use, but it doesn’t have many options for customizing your art.

Even with these limitations, it’s a good starting point for people who want to try making art with AI. Here are the good and bad points we found.

Pros:

  • User-Friendly: The app is simple and easy to use, making it accessible for users of all skill levels.

Cons:

  • Limited Advanced Features: The app lacks options for customization, such as altering image ratios, seeds, and other settings.

 

10 Free AI Tools for Graphic Designing — from medium.com by Qz Ruslan

With the advancements in Artificial Intelligence (AI), designers now have access to a wide array of free AI-powered tools that streamline their creative process, enhance productivity, and add a touch of uniqueness to their designs. In this article, we will explore ten such free AI tools websites for graphic designing that have revolutionized the way designers approach their craft.


Generative Art in Motion — from heatherbcooper.substack.com by Heather Cooper
Animation and video tools create an explosion of creative expression


World’s first AI cinema opening in Auckland to make all your Matrix fantasies come true — from stuff.co.nz by Jonny Mahon-Heap
Review: My HyperCinema experience was futuristic, sleek – and slightly insane as I became the star of my own show.


AI That Alters Voice and Imagery in Political Ads Will Require Disclosure on Google and YouTube — from usnews.com by Associated Press
Political ads using artificial intelligence on Google and YouTube must soon be accompanied by a prominent disclosure if imagery or sounds have been synthetically altered

Google will soon require that political ads using artificial intelligence be accompanied by a prominent disclosure if imagery or sounds have been synthetically altered.

AI-generated election ads on YouTube and other Google platforms that alter people or events must include a clear disclaimer located somewhere that users are likely to notice, the company said in an update this week to its political content policy.


 


ElevenLabs’ AI Voice Generator Can Now Fake Your Voice in 30 Languages — from gizmodo.com by Kyle Barr
ElevenLabs said its AI voice generator is out of beta, saying it would support video game and audiobook creators with cheap audio.

According to ElevenLabs, the new Multilingual v2 model promises it can produce “emotionally rich” audio in a total of 30 languages. The company offers two AI voice tools, one is a text-to-speech model and the other is the “VoiceLab” that lets paying users clone a voice by inputting fragments of theirs (or others) speech into the model to create a kind of voice cone. With the v2 model, users can get these generated voices to start speaking in Greek, Malay, or Turkish.

Since then, ElevenLabs claims its integrated new measures to ensure users can only clone their own voice. Users need to verify their speech with a text captcha prompt which is then compared to the original voice sample.

From DSC:
I don’t care what they say regarding safeguards/proof of identity/etc. This technology has been abused and will be abused in the future. We can count on it. The question now is, how do we deal with it?



Google, Amazon, Nvidia and other tech giants invest in AI startup Hugging Face, sending its valuation to $4.5 billion — from cnbc.com by Kif Leswing

But Hugging Face produces a platform where AI developers can share code, models, data sets, and use the company’s developer tools to get open-source artificial intelligence models running more easily. In particular, Hugging Face often hosts weights, or large files with lists of numbers, which are the heart of most modern AI models.

While Hugging Face has developed some models, like BLOOM, its primary product is its website platform, where users can upload models and their weights. It also develops a series of software tools called libraries that allow users to get models working quickly, to clean up large datasets, or to evaluate their performance. It also hosts some AI models in a web interface so end users can experiment with them.


The global semiconductor talent shortage — from www2.deloitte.com
How to solve semiconductor workforce challenges

Numerous skills are required to grow the semiconductor ecosystem over the next decade. Globally, we will need tens of thousands of skilled tradespeople to build new plants to increase and localize manufacturing capacity: electricians, pipefitters, welders; thousands more graduate electrical engineers to design chips and the tools that make the chips; more engineers of various kinds in the fabs themselves, but also operators and technicians. And if we grow the back end in Europe and the Americas, that equates to even more jobs.

Each of these job groups has distinct training and educational needs; however, the number of students in semiconductor-focused programs (for example, undergraduates in semiconductor design and fabrication) has dwindled. Skills are also evolving within these job groups, in part due to automation and increased digitization. Digital skills, such as cloud, AI, and analytics, are needed in design and manufacturing more than ever.

The chip industry has long partnered with universities and engineering schools. Going forward, they also need to work more with local tech schools, vocational schools, and community colleges; and other organizations, such as the National Science Foundation in the United States.


Our principles for partnering with the music industry on AI technology — from blog.youtube (Google) by Neal Mohan, CEO, YouTube
AI is here, and we will embrace it responsibly together with our music partners.

  • Principle #1: AI is here, and we will embrace it responsibly together with our music partners.
  • Principle #2: AI is ushering in a new age of creative expression, but it must include appropriate protections and unlock opportunities for music partners who decide to participate.
  • Principle #3: We’ve built an industry-leading trust and safety organization and content policies. We will scale those to meet the challenges of AI.

Developers are now using AI for text-to-music apps — from techcrunch.com by Ivan Mehta

Brett Bauman, the developer of PlayListAI (previously LinupSupply), launched a new app called Songburst on the App Store this week. The app doesn’t have a steep learning curve. You just have to type in a prompt like “Calming piano music to listen to while studying” or “Funky beats for a podcast intro” to let the app generate a music clip.

If you can’t think of a prompt the app has prompts in different categories, including video, lo-fi, podcast, gaming, meditation and sample.


A Generative AI Primer — from er.educause.edu by Brian Basgen
Understanding the current state of technology requires understanding its origins. This reading list provides sources relevant to the form of generative AI that led to natural language processing (NLP) models such as ChatGPT.


Three big questions about AI and the future of work and learning — from workshift.opencampusmedia.org by Alex Swartsel
AI is set to transform education and work today and well into the future. We need to start asking tough questions right now, writes Alex Swartsel of JFF.

  1. How will AI reshape jobs, and how can we prepare all workers and learners with the skills they’ll need?
  2. How can education and workforce leaders equitably adopt AI platforms to accelerate their impact?
  3. How might we catalyze sustainable policy, practice, and investments in solutions that drive economic opportunity?

“As AI reshapes both the economy and society, we must collectively call for better data, increased accountability, and more flexible support for workers,” Swartsel writes.


The Current State of AI for Educators (August, 2023) — from drphilippahardman.substack.com by Dr. Philippa Hardman
A podcast interview with the University of Toronto on where we’re at & where we’re going.

 

Some incredible creativity!!!

Against the Ream: An Expansive Exhibition Invites Thirteen Artists to Explore the Vast ‘Possibilities of Paper’ — Colossal — from thisiscolossal.com by Kate Mothes & various artists

Jaq Belcher, “All in Good Time” (2023), hand-cut paper, dimensions variable. Courtesy of Jayne H. Baum/JHB Gallery



The Master’s Pupil is a hand-painted video game informed by Monet’s artworks — from dezeen.com by Amy Peacock and Pat Naoum

Game developer Pat Naoum has launched a video game with backgrounds, creatures and scenery entirely painted by hand, which took seven years to complete.

Available on Nintendo Switch and Steam for Windows and Mac, The Master’s Pupil is a 12-level puzzle-adventure game that explores a painterly world through the eyes of French artist Claude Monet.

The Master’s Pupil is the first game Naoum developed and took him seven years to complete.


 


Gen-AI Movie Trailer For Sci Fi Epic “Genesis” — from forbes.com by Charlie Fink

The movie trailer for “Genesis,” created with AI, is so convincing it caused a stir on Twitter [on July 27]. That’s how I found out about it. Created by Nicolas Neubert, a senior product designer who works for Elli by Volkswagen in Germany, the “Genesis” trailer promotes a dystopian sci-fi epic reminiscent of the Terminator. There is no movie, of course, only the trailer exists, but this is neither a gag nor a parody. It’s in a class of its own. Eerily made by man, but not.



Google’s water use is soaring. AI is only going to make it worse. — from businessinsider.com by Hugh Langley

Google just published its 2023 environmental report, and one thing is for certain: The company’s water use is soaring.

The internet giant said it consumed 5.6 billion gallons of water in 2022, the equivalent of 37 golf courses. Most of that — 5.2 billion gallons — was used for the company’s data centers, a 20% increase on the amount Google reported the year prior.


We think prompt engineering (learning to converse with an AI) is overrated. — from the Neuron

We think prompt engineering (learning to converse with an AI) is overrated. Yup, we said it. We think the future of chat interfaces will be a combination of preloading context and then allowing AI to guide you to the information you seek.

From DSC:
Agreed. I think we’ll see a lot more interface updates and changes to make things easier to use, find, develop.


Radar Trends to Watch: August 2023 — from oreilly.com by Mike Loukides
Developments in Programming, Web, Security, and More

Artificial Intelligence continues to dominate the news. In the past month, we’ve seen a number of major updates to language models: Claude 2, with its 100,000 token context limit; LLaMA 2, with (relatively) liberal restrictions on use; and Stable Diffusion XL, a significantly more capable version of Stable Diffusion. Does Claude 2’s huge context really change what the model can do? And what role will open access and open source language models have as commercial applications develop?


Try out Google ‘TextFX’ and its 10 creative AI tools for rappers, writers — from 9to5google.com by Abner Li; via Barsee – AI Valley 

Google Lab Sessions are collaborations between “visionaries from all realms of human endeavor” and the company’s latest AI technology. [On 8/2/23], Google released TextFX as an “experiment to demonstrate how generative language technologies can empower the creativity and workflows of artists and creators” with Lupe Fiasco.

Google’s TextFX includes 10 tools and is powered by the PaLM 2 large language model via the PALM API. Meant to aid in the creative process of rappers, writers, and other wordsmiths, it is part of Google Labs.

 

A cam/mic/light/teleprompter remote kit for non-tech-savvy guests, including Shure MV7 — from provideocoalition.com by Allan Tépper

Excerpt (emphasis DSC):

Inspired by my recent Review: Shure MV7 dynamic hybrid studio microphone – near, far and beyond, Beaker Films of Fairfield, Connecticut, US has developed and deployed a first batch of 10 kits to capture remote conversations from different locations worldwide. Beaker Films is frequently contracted to record remote interviews or testimonials from medical professionals. For this project, Beaker Films’ clients wanted consistent, high quality audio and video, but with 3 additional challenges: they preferred to have no visible microphone in the shot, they needed a teleprompter function and the whole kit needed to be as simple as possible for non-technical guests.




Speaking of A/V-related items, also see:

Seven worlds one planet at the BBC Earth Experience — from inavateonthenet.net by Paul Milligan

‘Holographic’ animal-free zoo opens in Australia — from inavateonthenet.net

XR Lab opens in UK college — from inavateonthenet.net

West Suffolk College in the UK has opened its Extended Reality Lab (XR Lab), the facilities comprise of four distinct areas: an Immersion Lab, a Collaboration Theatre, a Green Room, and a Conference Room. The project was designed by architects WindsorPatania for Eastern Colleges Group.

CJP to create virtual studio for Solent University — from inavateonthenet.net

Systems integrator CJP Broadcast Service Solutions, has won a tender to build a virtual production environment for Solent University in the UK.

The new facilities, converted from an existing studio space, will provide students on the film production courses with outstanding opportunities to develop their creative output.

 

Camera fixed on a surgery being used to provide remote learning and feeds

Learning Experience — from inavateemea.com by Tim Kridel

“Some of the stuff we’re doing is creating templates and workflows that capture multiple feeds: not just the teacher, [but also] the white board, an overhead camera,” Risby says.

“The student can then go in and pick what they look at, so it’s more interactive. You might be watching it the first time to listen to the lecturer, but you might watch the second time to concentrate on the experiment. It makes the stream more valuable.”

 

Teaching Assistants that Actually Assist Instructors with Teaching — from opencontent.org by David Wiley

“…what if generative AI could provide every instructor with a genuine teaching assistant – a teaching assistant that actually assisted instructors with their teaching?”

Assignment Makeovers in the AI Age: Reading Response Edition — from derekbruff.org by Derek Bruff

For my cryptography course, Mollick’s first option would probably mean throwing out all my existing reading questions. My intent with these reading questions was noble, that is, to guide students to the big questions and debates in the field, but those are exactly the kinds of questions for which AI can write decent answers. Maybe the AI tools would fare worse in a more advanced course with very specialized readings, but in my intro to cryptography course, they can handle my existing reading questions with ease.

What about option two? I think one version of this would be to do away with the reading response assignment altogether.

4 Steps to Help You Plan for ChatGPT in Your Classroom — from chronicle.com by Flower Darby
Why you should understand how to teach with AI tools — even if you have no plans to actually use them.


Some items re: AI in other areas:

15 Generative AI Tools A billion+ people will be collectively using very soon. I use most of them every day — from stefanbauschard.substack.com by Stefan Bauschard
ChatGPT, Bing, Office Suite, Google Docs, Claude, Perplexity.ai, Plug-Ins, MidJourney, Pi, Runway, Bard, Bing, Synthesia, D-ID

The Future of AI in Video: a look forward — from provideocoalition.com by Iain Anderson

Actors say Hollywood studios want their AI replicas — for free, forever — from theverge.com by Andrew Webster; resource from Tom Barrett

Along these lines of Hollywood and AI, see this Tweet:

Claude 2: ChatGPT rival launches chatbot that can summarise a novel –from theguardian.com by Dan Milmo; resource from Tom Barrett
Anthropic releases chatbot able to process large blocks of text and make judgments on what it is producing

Generative AI imagines new protein structures — from news.mit.edu by Rachel Gordon; resource from Sunday Signal
MIT researchers develop “FrameDiff,” a computational tool that uses generative AI to craft new protein structures, with the aim of accelerating drug development and improving gene therapy.

Google’s medical AI chatbot is already being tested in hospitals — from theverge.com by Wes Davis; resource via GSV

Ready to Sing Elvis Karaoke … as Elvis? The Weird Rise of AI Music — from rollingstone.com by Brian Hiatt; resource from Misha da Vinci
From voice-cloning wars to looming copyright disputes to a potential flood of nonhuman music on streaming, AI is already a musical battleground

 

Actors say Hollywood studios want their AI replicas — for free, forever — from theverge.com by Andrew Webster
The reveal came as SAG-AFTRA actors confirmed they were going on strike.

When asked about the proposal during the press conference, Crabtree-Ireland said that “This ‘groundbreaking’ AI proposal that they gave us yesterday, they proposed that our background performers should be able to be scanned, get one day’s pay, and their companies should own that scan, their image, their likeness and should be able to use it for the rest of eternity on any project they want, with no consent and no compensation. So if you think that’s a groundbreaking proposal, I suggest you think again.”

 

Does the ADA Require Captions for Internet Videos? — from boia.org

Excerpt:

According to Accessibility.com, at least 2,387 web accessibility lawsuits were filed in 2022. Those lawsuits were either filed under the Americans with Disabilities Act (ADA) or California’s Unruh Act; any violation of the ADA is considered a violation of the Unruh Act.

While the plaintiffs cited a variety of issues, multimedia accessibility is a common point of concern. In 2015, the National Association of the Deaf (NAD) and other plaintiffs settled a lawsuit with Netflix, which cited a lack of captions for certain featured movies and TV shows.

That prompts an interesting question: Does the ADA require captions for internet videos — and if so, how can businesses make sure that they’re compliant?


267: College Learning Disability Specialist Elizabeth Hamblet and 7 Steps to College Success (Author Series) — from learnsmarterpodcast.com

Rachel Kapp, M.Ed., BCET, and Stephanie Pitts, M.Ed., BCET welcome back College Learning Disability Specialist Elizabeth Hamblet to discuss her new book 7 Steps to College Success: A Pathway for Students with Disabilities. She discusses the origin story of the book and the disconnect between what college disability services can do for learners and what learners and parents expect. She talks about reading this book when the learner is in 8th grade because of the specific impact it can have on parent and learner decisions on course selection. Elizabeth discusses how parents and learners can get surprised in the college disability process. Elizabeth talks about the critical importance of non-academic skills and how the drive for success in high school can stand in the way of independence necessary for college success.


What Web Designers Can Learn From Apple’s Assistive Access Feature — from boia.org

Excerpt:

If you’re interested in accessible digital design, pay attention to Apple. The company seems to approach accessibility from the perspective of users with disabilities

Apple’s messaging treats accessibility as a fundamental design principle: Accessibility must be built into digital systems from the start, not tacked on as an afterthought. In other words, they take an accessibility-first mindset, and their commitment seems consistent.

The company’s track record continued in May 2023, when Apple announced its latest suite of accessibility features to launch later that year. One of these features, Assistive Access for iPhone and iPad, holds valuable lessons that web designers can apply to their own work.     

Here’s what Apple accomplished with Assistive Access, plus a few ways web designers can achieve similar goals.

 

Peanuts Sing Roundabout — from theawesomer.com; I hadn’t seen this yet…so for those of my generation, you might like this as well! 🙂

 
© 2022 | Daniel Christian