Keras ImageDataGenerator with flow, Got ValueError: `x` (images tensor) and `y` (labels) should have the same length

阿布塞克·甘古利

我正在 Coursera 上学习 CNN 课程,当我尝试解决作业笔记本时,这是向我抛出的错误。

ValueError: `x` (images tensor) and `y` (labels) should have the same length. Found: x.shape = (27455, 28, 28, 1), y.shape = (7172, 28, 28, 1)

但是它们的长度不一样吗?(即维度。)以下是我创建问题的代码块:

# GRADED FUNCTION: train_val_generators
def train_val_generators(training_images, training_labels, validation_images, validation_labels):
  """
  Creates the training and validation data generators
  
  Args:
    training_images (array): parsed images from the train CSV file
    training_labels (array): parsed labels from the train CSV file
    validation_images (array): parsed images from the test CSV file
    validation_labels (array): parsed labels from the test CSV file
    
  Returns:
    train_generator, validation_generator - tuple containing the generators
  """
  ### START CODE HERE

  # In this section, you will have to add another dimension to the data
  # So, for example, if your array is (10000, 28, 28)
  # You will need to make it (10000, 28, 28, 1)
  # Hint: np.expand_dims

  training_images = np.expand_dims(training_images, axis=3)
  validation_images = np.expand_dims(validation_images, axis=3)

  print(training_images.shape)
  print(validation_images.shape)

  

  # Instantiate the ImageDataGenerator class 
  # Don't forget to normalize pixel values 
  # and set arguments to augment the images (if desired)
  train_datagen = ImageDataGenerator(
    # Your Code Here
    rescale = 1./255,
    rotation_range = 40,
    width_shift_range = 0.2,
    height_shift_range = 0.2,
    shear_range = 0.2,
    zoom_range = 0.2,
    horizontal_flip = True,
    fill_mode = 'nearest'
    )


  # Pass in the appropriate arguments to the flow method
  train_generator = train_datagen.flow(x=training_images,
                                       y=validation_images,
                                       batch_size=32) 

  
  # Instantiate the ImageDataGenerator class (don't forget to set the rescale argument)
  # Remember that validation data should not be augmented
  validation_datagen = ImageDataGenerator(
      rescale = 1./255
  )

  # Pass in the appropriate arguments to the flow method
  validation_generator = validation_datagen.flow(x=training_images,
                                                 y=validation_images,
                                                 batch_size=32) 

  ### END CODE HERE

  return train_generator, validation_generator

运行此单元后,它工作正常并为我的图像添加了额外的维度。以下代码单元引发了上述问题。

# Test your generators
train_generator, validation_generator = train_val_generators(training_images, training_labels, validation_images, validation_labels)

print(f"Images of training generator have shape: {train_generator.x.shape}")
print(f"Labels of training generator have shape: {train_generator.y.shape}")
print(f"Images of validation generator have shape: {validation_generator.x.shape}")
print(f"Labels of validation generator have shape: {validation_generator.y.shape}")

这是我的整个错误消息:

(27455, 28, 28, 1)
(7172, 28, 28, 1)
---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
<ipython-input-27-c93bf4854fbc> in <module>()
      1 # Test your generators
----> 2 train_generator, validation_generator = train_val_generators(training_images, training_labels, validation_images, validation_labels)
      3 
      4 print(f"Images of training generator have shape: {train_generator.x.shape}")
      5 print(f"Labels of training generator have shape: {train_generator.y.shape}")

3 frames
/usr/local/lib/python3.7/dist-packages/keras_preprocessing/image/numpy_array_iterator.py in __init__(self, x, y, image_data_generator, batch_size, shuffle, sample_weight, seed, data_format, save_to_dir, save_prefix, save_format, subset, dtype)
     87                              'should have the same length. '
     88                              'Found: x.shape = %s, y.shape = %s' %
---> 89                              (np.asarray(x).shape, np.asarray(y).shape))
     90         if sample_weight is not None and len(x) != len(sample_weight):
     91             raise ValueError('`x` (images tensor) and `sample_weight` '

ValueError: `x` (images tensor) and `y` (labels) should have the same length. Found: x.shape = (27455, 28, 28, 1), y.shape = (7172, 28, 28, 1)

我尝试在 StackOverflow 中搜索许多类似的问题,其中谈到了更改其尺寸,但我认为我的尺寸是正确的,因为更改它绝对没有任何作用。对此有何见解?请帮忙。谢谢!:_)

马赫迪

train_datagen.flowandvalidation_datagen.flow中,你犯了两个小错误。对于y参数,您传递validation_images,但您需要传递training_labelsand validation_labels

我纠正了上述错误,并用随机图像和一个简单的 CNN 模型编写了完整的代码并对其进行了拟合。

from tensorflow.keras.preprocessing.image import ImageDataGenerator
import tensorflow as tf
import numpy as np


def train_val_generators(training_images, training_labels, validation_images, validation_labels):
  training_images = np.expand_dims(training_images, axis=3)
  validation_images = np.expand_dims(validation_images, axis=3)

  print(training_images.shape)
  print(validation_images.shape)

  train_datagen = ImageDataGenerator(
    rescale = 1./255,
    rotation_range = 40,
    width_shift_range = 0.2,
    height_shift_range = 0.2,
    shear_range = 0.2,
    zoom_range = 0.2,
    horizontal_flip = True,
    fill_mode = 'nearest'
    )

  train_generator = train_datagen.flow(x=training_images,
                                       y=training_labels,
                                       batch_size=32) 

  
  validation_datagen = ImageDataGenerator(
      rescale = 1./255
  )

  validation_generator = validation_datagen.flow(x=validation_images,
                                                 y=validation_labels,
                                                 batch_size=32) 

  return train_generator, validation_generator


train_generator, validation_generator = train_val_generators(
    training_images = np.random.rand(27455, 28,28), 
    training_labels = np.random.randint(0,2,27455),
    validation_images = np.random.rand(7172, 28,28),
    validation_labels = np.random.randint(0,2,7172),
    )

model = tf.keras.Sequential([
  tf.keras.layers.Conv2D(16, 3, padding='same', activation='relu', input_shape=(28, 28, 1)),
  tf.keras.layers.MaxPooling2D(),
  tf.keras.layers.Conv2D(32, 3, padding='same', activation='relu'),
  tf.keras.layers.MaxPooling2D(),
  tf.keras.layers.Flatten(),
  tf.keras.layers.Dense(64, activation='relu'),
  tf.keras.layers.Dropout(0.4),
  tf.keras.layers.Dense(2)
])

model.compile(optimizer='adam',
              loss=tf.keras.losses.SparseCategoricalCrossentropy(from_logits=True))


model.fit(train_generator,
          epochs=2,
          validation_data=validation_generator)

输出:

(27455, 28, 28, 1)
(7172, 28, 28, 1)
Epoch 1/2
858/858 [==============================] - 25s 25ms/step - loss: 0.6933 - val_loss: 0.6931
Epoch 2/2
858/858 [==============================] - 18s 21ms/step - loss: 0.6932 - val_loss: 0.6930

本文收集自互联网,转载请注明来源。

如有侵权,请联系 [email protected] 删除。

编辑于
0

我来说两句

0 条评论
登录 后参与评论

相关文章

ValueError: x and y must have same first dimension, but have shapes (2140699,) and (4281398,)

Keras.ImageDataGenerator结果显示[flow()]

具有color_mode的keras ImageDataGenerator.flow

Keras ImageDataGenerator.flow_from_dataframe 不断加载

在R上安装Keras / Tensor Flow

keras ValueError:生成器的输出应为元组(x,y,sample_weight)或(x,y)。找到:无

Keras-ValueError:生成器的输出应为元组`(x,y,sample_weight)`或`(x,y)`。找到:[[[[0.54901963] [0.5372549]

Raspberry Pi安装Tensor-flow和Keras

如何在keras中使用ImageDataGenerator和flow_from_directory保存调整大小的图像

处理Keras的ImageDataGenerator.flow_from_directory中的无效/损坏的图像文件

来自tf.keras.preprocessing.image.ImageDataGenerator.flow_from_directory的tf.data.Dataset吗?

Keras-如何将图像数组传递给ImageDataGenerator.flow

如何在Keras中获取ImageDataGenerator的.flow_from_directory函数扫描的类的名称?

Keras ImageDataGenerator flow_from_directory 用于以 numpy 数组作为图像类型进行分割

ImageDataGenerator用于使用flow_from_directory在Keras中进行多任务输出

如何从ImageDataGenerator获取x_train和y_train?

Keras播种ImageDataGenerator与序列

Keras ImageDataGenerator 亮度范围

Keras ImageDataGenerator 不同的图像

Keras ImageDataGenerator验证_拆分

如何修复'ValueError:无法为张量Y馈送形状X的值,其在Keras上具有形状Z

使用keras ImageDataGenerator flow_from_dataframe时,验证集仅从一个类获取图像

Keras:从ImageDataGenerator或predict_generator获取True标签(y_test)

具有参数x的ImageDataGenerator(Keras)的流方法中的数据等级4的含义是什么

如何设置 Keras Autoencoder 和 reshape() 以使用 ImageDataGenerator 处理 224 x 224 jpg 图像?

Keras:ImageDataGenerator的性能不佳

ImageDataGenerator keras - save_to_dir

keras自定义ImageDataGenerator

Keras ImageDataGenerator:随机变换