如何使用Keras进行超参数调优

在Keras中进行超参数调优通常使用GridSearchCV或RandomizedSearchCV来完成。以下是一个使用GridSearchCV进行超参数调优的示例:

定义模型和参数网格

from keras.models import Sequential
from keras.layers import Dense
from keras.wrappers.scikit_learn import KerasClassifier
from sklearn.model_selection import GridSearchCV

def create_model(optimizer='adam', activation='relu'):
    model = Sequential()
    model.add(Dense(units=64, activation=activation, input_shape=(X_train.shape[1],)))
    model.add(Dense(units=1, activation='sigmoid'))
    model.compile(optimizer=optimizer, loss='binary_crossentropy', metrics=['accuracy'])
    return model

model = KerasClassifier(build_fn=create_model, epochs=5, batch_size=32)
param_grid = {'optimizer': ['adam', 'sgd'],
              'activation': ['relu', 'tanh']}

使用GridSearchCV进行超参数调优

grid = GridSearchCV(estimator=model, param_grid=param_grid, cv=3)
grid_result = grid.fit(X_train, y_train)

print("Best: %f using %s" % (grid_result.best_score_, grid_result.best_params_))

获取最佳模型和参数

best_model = grid_result.best_estimator_
best_params = grid_result.best_params_

通过这种方法,您可以使用GridSearchCV来搜索最佳的超参数组合,以优化模型的性能。您还可以尝试使用RandomizedSearchCV来进行随机搜索超参数调优。

阅读剩余
THE END